-- Logs begin at Thu 2022-08-04 01:10:33 UTC, end at Thu 2022-08-04 02:54:11 UTC. -- Aug 04 02:17:31.783031 dv-cinder-740146-17-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 04 02:17:31.791983 dv-cinder-740146-17-smb devstack@keystone.service[80630]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 04 02:17:31.794000 dv-cinder-740146-17-smb devstack@keystone.service[80630]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 02:17:31 2022] *** Aug 04 02:17:31.794000 dv-cinder-740146-17-smb devstack@keystone.service[80630]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 02:17:31.794000 dv-cinder-740146-17-smb devstack@keystone.service[80630]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 02:17:31.794000 dv-cinder-740146-17-smb devstack@keystone.service[80630]: nodename: dv-cinder-740146-17-smb Aug 04 02:17:31.794000 dv-cinder-740146-17-smb devstack@keystone.service[80630]: machine: x86_64 Aug 04 02:17:31.794000 dv-cinder-740146-17-smb devstack@keystone.service[80630]: clock source: unix Aug 04 02:17:31.794000 dv-cinder-740146-17-smb devstack@keystone.service[80630]: pcre jit disabled Aug 04 02:17:31.794000 dv-cinder-740146-17-smb devstack@keystone.service[80630]: detected number of CPU cores: 4 Aug 04 02:17:31.794000 dv-cinder-740146-17-smb devstack@keystone.service[80630]: current working directory: / Aug 04 02:17:31.794000 dv-cinder-740146-17-smb devstack@keystone.service[80630]: detected binary path: /usr/bin/uwsgi-core Aug 04 02:17:31.794800 dv-cinder-740146-17-smb devstack@keystone.service[80630]: your processes number limit is 47680 Aug 04 02:17:31.794800 dv-cinder-740146-17-smb devstack@keystone.service[80630]: your memory page size is 4096 bytes Aug 04 02:17:31.794800 dv-cinder-740146-17-smb devstack@keystone.service[80630]: detected max file descriptor number: 2048 Aug 04 02:17:31.794800 dv-cinder-740146-17-smb devstack@keystone.service[80630]: lock engine: pthread robust mutexes Aug 04 02:17:31.794800 dv-cinder-740146-17-smb devstack@keystone.service[80630]: thunder lock: enabled Aug 04 02:17:31.794800 dv-cinder-740146-17-smb devstack@keystone.service[80630]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 04 02:17:31.794800 dv-cinder-740146-17-smb devstack@keystone.service[80630]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 02:17:31.835595 dv-cinder-740146-17-smb devstack@keystone.service[80630]: Python main interpreter initialized at 0x56194a9e69c0 Aug 04 02:17:31.835595 dv-cinder-740146-17-smb devstack@keystone.service[80630]: python threads support enabled Aug 04 02:17:31.835595 dv-cinder-740146-17-smb devstack@keystone.service[80630]: your server socket listen backlog is limited to 100 connections Aug 04 02:17:31.835595 dv-cinder-740146-17-smb devstack@keystone.service[80630]: your mercy for graceful operations on workers is 90 seconds Aug 04 02:17:31.838862 dv-cinder-740146-17-smb devstack@keystone.service[80630]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 02:17:31.838862 dv-cinder-740146-17-smb devstack@keystone.service[80630]: *** Operational MODE: preforking *** Aug 04 02:17:31.838862 dv-cinder-740146-17-smb devstack@keystone.service[80630]: *** uWSGI is running in multiple interpreter mode *** Aug 04 02:17:31.838862 dv-cinder-740146-17-smb devstack@keystone.service[80630]: spawned uWSGI master process (pid: 80630) Aug 04 02:17:31.838862 dv-cinder-740146-17-smb devstack@keystone.service[80630]: spawned uWSGI worker 1 (pid: 80641, cores: 1) Aug 04 02:17:31.838862 dv-cinder-740146-17-smb devstack@keystone.service[80630]: spawned uWSGI worker 2 (pid: 80642, cores: 1) Aug 04 02:17:31.838862 dv-cinder-740146-17-smb devstack@keystone.service[80630]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 02:17:31.836464 dv-cinder-740146-17-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 04 02:17:37.383022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:17:37.383022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: from cryptography.utils import int_from_bytes Aug 04 02:17:37.383799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:17:37.383799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: from cryptography.utils import int_from_bytes Aug 04 02:17:37.384209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:17:37.384209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: from cryptography.utils import int_from_bytes Aug 04 02:17:37.384311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:17:37.384311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: from cryptography.utils import int_from_bytes Aug 04 02:17:37.434160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 02:17:37.434331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 02:17:37.434428 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 02:17:37.434542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 02:17:37.434619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] command line args: [] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 02:17:37.434685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] command line args: [] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 02:17:37.434827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 02:17:37.434914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 02:17:37.435009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ================================================================================ {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 02:17:37.435093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ================================================================================ {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 02:17:37.435267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] admin_token = **** {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.435351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] admin_token = **** {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.435507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] config_dir = [] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.435589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] config_dir = [] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.435693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.435771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.435875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] config_source = [] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.435953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] config_source = [] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.436052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] debug = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.436133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] debug = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.436294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.436526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.436674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.436779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.436873 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.437015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.437126 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.437221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.437312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.437431 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.437550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] list_limit = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.437644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] list_limit = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.437744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] log_config_append = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.437844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] log_config_append = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.437942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.438041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.438139 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] log_dir = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.438237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] log_dir = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.438340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] log_file = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.438439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] log_file = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.438581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.438717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.438794 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.438866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.438992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.439071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.439146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.439252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.439338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.439464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.439539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.439654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.439727 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.439846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.439949 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.440038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.440190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.440316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.440429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.440504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.440915 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.441002 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.441152 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.441237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.441396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.441492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.441638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.441766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.441909 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.441987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.442395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.442501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.442587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] publish_errors = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.442659 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] publish_errors = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.442827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.442904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.443050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.443176 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.443255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.443329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.443492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.443658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.443742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.443813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.443933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] standard_threads = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.444018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] standard_threads = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.444111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.444187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.444350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.444426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.444547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.444628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.444698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] use_journal = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.444773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] use_journal = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.444847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] use_json = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.444917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] use_json = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.444990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] use_stderr = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.445068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] use_stderr = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.445159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] use_syslog = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.445235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] use_syslog = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.445385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.445462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:17:37.445635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.445791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.445870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.445940 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.446113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.446189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.446346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.446479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.446615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.446702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.446854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.446929 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.447100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.447186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.447337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.447411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.447588 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.447670 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.447833 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.447920 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.448079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.448155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.448308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.448391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.448551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.448639 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.448783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.448859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.449027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.449104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.449275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.449356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.449504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.449579 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.449755 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.449836 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.450006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.450083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.450250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.450330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.450479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.450586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.450757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.450876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.451016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.451099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.451265 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.451342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.451497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.451577 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.451736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.452308 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.452481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.452573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.452708 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.452792 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.452940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.453061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.453185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.453318 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.453431 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.453572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.453656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.453808 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.453885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.454050 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.454133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.454300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.454377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.454576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.454657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.454871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.454973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.455046 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.455121 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.455262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.455338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.455498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.455583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.455728 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.455801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.455960 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.456070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.456183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.456258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.456415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.456531 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.456646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.456724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.456897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.457016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.457126 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.457214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.457333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.457409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.457564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.457656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.457794 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.457880 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.458027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.458104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.458263 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.458345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.458505 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.458597 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.458749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.458825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.458983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.459101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.459220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.459299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.459458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.459539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.459691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.459786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.459929 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.460006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.460159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.460236 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.460400 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.460492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.460637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.460714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.460868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.460954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.461101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.461185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.461347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.461430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.461576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.461654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.461810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.461895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.462041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.462119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.462278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.462353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.462551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.462630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.462801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.462881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.463044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.463120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.463278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.463354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.463501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.463576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.463729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.463808 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.463970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.464053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.464203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.464281 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.464437 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.464520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.464674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.464750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.464909 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.465016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.465145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.465223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.465377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.465453 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.465609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.465698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.465840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.465917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.466076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.466159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.466320 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.466405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.466578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.466658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.466814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.466891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.467052 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.467141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.467284 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.467366 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.468128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.468255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.468392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.468533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.468656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.468789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.468922 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.469013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.469092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.469172 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.469244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.469407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.469485 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.469644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.469721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.469880 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.469963 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.470124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.470201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.470356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.470431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.470631 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.470712 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.470872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.470956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.471119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.471196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.471363 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] auth.external = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.471467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.471580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.471662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.471846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] auth.external = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.471923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.472062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.472169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.472305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] auth.password = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.472385 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.472535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] auth.token = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.472613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.472772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.472850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] auth.password = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.473004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.473083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] auth.token = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.473246 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.473322 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.473473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.473550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.473717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.473796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.473955 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.474038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.474182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.474268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.474416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] credential.caching = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.474552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.474683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.474763 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.474923 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] credential.caching = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.475000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.475167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.475252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.475401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.475479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.475641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.475726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.475872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.475950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.476117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.476194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.476356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.476442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.476592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.476669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.476841 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.476919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.477089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.477174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.477346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.477432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.477602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.477686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.477843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.478000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.478097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.478176 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.478329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] federation.caching = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.478406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.478604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.478726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.478876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] federation.caching = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.478960 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.479077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.479158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.479299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.479395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.479540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.479621 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.479772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.479851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.480018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.480105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.480249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.480328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.480501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.480578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.480738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.480824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.480982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.481060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.481212 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.caching = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.481290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.481456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.481541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.481690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.caching = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.481766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.481921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.481998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.482152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.482238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.482396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.482475 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.482648 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.482726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.482884 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.482974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.483158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.483235 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.483410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.483486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.483640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.483733 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.483870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.483980 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.484097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.484216 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.484335 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.484450 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.484577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.484670 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.484822 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.484909 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.485072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.485160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.485316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.485394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.485580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.485657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.485814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.485893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.486050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.486126 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.486277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.486354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.486527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.486611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.486758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.486839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.486991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.487070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.487228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.487308 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.487463 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.487540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.487707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.487783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.487935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.488013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.488179 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.488256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.488410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.488487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.488641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.488719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.488886 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.488963 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.489121 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.489198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.489354 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.489432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.489590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.489669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.489816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.489894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.490052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.490132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.490282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.490358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.490537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.490615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.490778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.490857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.491009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.491086 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.491249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.491326 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.491489 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.491577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.491716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.491793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.491945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.492022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.492191 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.492271 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.492430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.492506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.492661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.492737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.492893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.492972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.493125 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.493202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.493353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.493430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.493589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.493667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.493828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.493906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.494058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.494134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.494302 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.494381 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.494563 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.494644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.494806 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.494883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.495039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.495120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.495267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.495345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.495498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.495576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.495729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.495809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.495962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.496039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.496187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.496270 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.496427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.496506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.496662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.496774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.496902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.496979 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.497148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.497257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.497396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.497504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.497735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.497811 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.497980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.498060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.498218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.498469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.498590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.498782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.498862 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.499021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.499208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.499286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.499455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.499542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.499697 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.499775 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.499939 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.500018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.500189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.500274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.500418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.500495 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.500663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.500741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.500895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.501050 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.501126 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.501197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.501348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.501427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.501586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.501671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.501824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.501908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.502053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.502132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.502287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.502373 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.502544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.502685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] resource.caching = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.502790 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.502868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.503033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] resource.caching = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.503127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.503265 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.503342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.503516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.503594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.503755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.503840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.503986 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.504063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.504232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.504309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.504464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.504549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.504702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.504779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.504933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] role.caching = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.505010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.505172 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.505256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] role.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.505399 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.505475 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] role.caching = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.505643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.505720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] role.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.505876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.505961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.506123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.506199 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.506368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.506445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.506635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.506727 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.506881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.506966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.507130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.507346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.507471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.507604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.507728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.507851 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.507974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.508097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.508219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.508349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.508474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.508627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.508748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.508873 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.509003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.509003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.509238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.509361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.509482 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.509605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.509735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.509859 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.509987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.510110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.510242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.510365 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.510528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.510653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.510776 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.510900 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.511022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.511146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.511284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.511408 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.511531 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.511654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.511777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.511900 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.512043 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.512167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.512291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.512413 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.512535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.512658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.512789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.512913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.513034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.513157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.513279 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.513401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.513530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.513663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.513785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.513908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] token.caching = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.514030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.514152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.514869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] token.caching = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.515007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.515175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.515262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.515532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.515655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.515788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.515788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.516040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.516173 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.516300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.516426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.516560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.516688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.516814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.516957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.517079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.517205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.517339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.517466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.517591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.517790 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.517934 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.518061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.518195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.518322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.518448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.518448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.518697 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.518829 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.518960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.518960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.519192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.519192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.connection = **** {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.519431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.519571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.519706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.connection = **** {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.519843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.519978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.520102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.520225 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.520348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.520471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.520601 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.520731 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.520856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.520978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.521101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.521224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.521347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.521564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.521691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.521815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.521939 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.522061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.522184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.522315 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.522439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.522603 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.522731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.522857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.522983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.523119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.523244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.523379 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.523504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.523629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.523755 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.523888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.524014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.524139 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.524262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 02:17:37.524388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:17:37.524388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 02:17:37.552127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.552343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.552567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.553891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.554129 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.554357 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.560876 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.562822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.591089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.591317 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.593764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.593999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.644782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.645286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.695010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.695241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.695780 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.696020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.761289 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.761449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.761529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.761626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.761707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.761845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.761930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.762061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.762153 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.762275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.762451 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.762586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.793631 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.793819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.793927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.794060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.794143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.794279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.794361 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.794522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.794609 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.794726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.794809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.794935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.795029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.795147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.812567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.812964 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.825529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.825757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.825981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.826064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.826199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.826280 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.826409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.826529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.826643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.826742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.827448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.827590 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.827755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.827972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80641) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:17:37.844937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.845073 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.845156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 02:17:37.845250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 02:17:37.845457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.845539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.845653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 02:17:37.845734 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 02:17:37.845915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.846005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.846169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.846250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.846421 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.846519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.846697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.846791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.856472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.856746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.856827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.857010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.857105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.857282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.857362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.857586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.865037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.865358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.869776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.870052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.870133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.870325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.870417 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.870618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.870700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.870894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.870975 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.871150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.871251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.871415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.871496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.871680 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.871764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.871943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.872024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.872209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.872296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.872469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.872557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.872763 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.895753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.896200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.897185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.897460 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.897710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.897990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.902355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.902665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.902749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.905574 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.905719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.905719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.910108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.910410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.910735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.911025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.914980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.915263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.915344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.915637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.915837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.915919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.916109 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.916190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.916401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.916484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.916666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.916746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.916930 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.917018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.917328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.933544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.933818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.934342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.934647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.937887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.938892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.941367 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.941657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.942343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.942665 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.946087 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.947118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.949498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.950339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.952872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.953172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.953453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.953811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.953892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.954095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.954179 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.954383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.954466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.954695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.954977 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.955270 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.971290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.971569 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.971832 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.972093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.972174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.972395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.972664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.972928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.979041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.979931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.980604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.980877 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.981509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.981786 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.984348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.984639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.984927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.985195 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.985281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.985476 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.985560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.985768 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.986067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.986349 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.997072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.997349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.997626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.997906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.997992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:37.998182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.998265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.998462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.998571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.999311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.999407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.999596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:37.999882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.000167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.016107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:38.016665 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:38.019097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:38.019718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:38.022047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.022715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.024586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.025219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.026103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:38.026387 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.026699 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.026782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:38.027135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.027452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.033399 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.034348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.035036 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:38.035995 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:38.037972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.038260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.038870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.038870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.039076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.039286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.039575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.039856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.047328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:38.047652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.047898 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.048117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:38.048411 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.048695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.054806 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:38.055083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.055368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.055638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.055717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80641) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:17:38.055905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.055989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.056174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.056255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.056444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.056535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.056721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.056801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.057019 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.057098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.057302 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.057391 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.057580 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.057661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.057858 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.057970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.058118 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.058255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.058379 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.058558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.058827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.059095 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.059364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80641) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:17:38.093504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56194a9e69c0 pid: 80642 (default app) Aug 04 02:17:38.095052 dv-cinder-740146-17-smb devstack@keystone.service[80641]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56194a9e69c0 pid: 80641 (default app) Aug 04 02:17:38.096876 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad2b05-4c1b-4070-bdf1-31100d5880ba None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:38.097167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad2b05-4c1b-4070-bdf1-31100d5880ba None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:38.097446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad2b05-4c1b-4070-bdf1-31100d5880ba None None] PATH_INFO: `/v3` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:38.101700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Thu Aug 4 02:17:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:17:46.625461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709b55a-063d-4056-89e1-183e50cf72de None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:46.626023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709b55a-063d-4056-89e1-183e50cf72de None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:46.626023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709b55a-063d-4056-89e1-183e50cf72de None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:46.630526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:17:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:17:46.636017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2cccf-c9eb-4e8f-85b4-3ef5991a87cd None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:46.636423 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2cccf-c9eb-4e8f-85b4-3ef5991a87cd None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:46.636571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2cccf-c9eb-4e8f-85b4-3ef5991a87cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:46.706287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: INFO dbcounter [None req-b4f2cccf-c9eb-4e8f-85b4-3ef5991a87cd None None] Registered counter for database keystone Aug 04 02:17:46.725501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG oslo_db.sqlalchemy.engines [None req-b4f2cccf-c9eb-4e8f-85b4-3ef5991a87cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:17:46.731592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writer thread running {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:17:46.910772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG passlib.handlers.bcrypt [None req-b4f2cccf-c9eb-4e8f-85b4-3ef5991a87cd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80642) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 02:17:46.911123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG passlib.handlers.bcrypt [None req-b4f2cccf-c9eb-4e8f-85b4-3ef5991a87cd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80642) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 02:17:46.966135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b4f2cccf-c9eb-4e8f-85b4-3ef5991a87cd None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:17:46.967939 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b4f2cccf-c9eb-4e8f-85b4-3ef5991a87cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:17:47.100527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:17:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 04 02:17:47.237257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709b55a-063d-4056-89e1-183e50cf72de None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:47.306341 dv-cinder-740146-17-smb devstack@keystone.service[80641]: INFO dbcounter [None req-7709b55a-063d-4056-89e1-183e50cf72de None None] Registered counter for database keystone Aug 04 02:17:47.328026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG oslo_db.sqlalchemy.engines [None req-7709b55a-063d-4056-89e1-183e50cf72de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:17:47.334161 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writer thread running {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:17:47.452837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709b55a-063d-4056-89e1-183e50cf72de None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:47.457158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa7703-f9d7-4d76-ad01-369d53d602a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:47.457785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7703-f9d7-4d76-ad01-369d53d602a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:47.458065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7703-f9d7-4d76-ad01-369d53d602a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:47.458337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7703-f9d7-4d76-ad01-369d53d602a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:47.466515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa7703-f9d7-4d76-ad01-369d53d602a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:47.520859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: WARNING keystone.common.rbac_enforcer.enforcer [None req-43aa7703-f9d7-4d76-ad01-369d53d602a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 02:17:47.521145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa7703-f9d7-4d76-ad01-369d53d602a1 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:47.531101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Thu Aug 4 02:17:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:17:47.537048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2cccf-c9eb-4e8f-85b4-3ef5991a87cd None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:47.551598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2cccf-c9eb-4e8f-85b4-3ef5991a87cd None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:47.556074 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554bb8d-3724-441e-b0b5-fb1ae9899928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:47.557178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554bb8d-3724-441e-b0b5-fb1ae9899928 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:47.557469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554bb8d-3724-441e-b0b5-fb1ae9899928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:47.557754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554bb8d-3724-441e-b0b5-fb1ae9899928 admin admin] PATH_INFO: `/v3/projects/7aa60e5b58354576a0cb898fee2dc9ca` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:47.559265 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554bb8d-3724-441e-b0b5-fb1ae9899928 admin admin] RBAC: Authorizing `identity:get_project(project_id=7aa60e5b58354576a0cb898fee2dc9ca)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:47.612285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3554bb8d-3724-441e-b0b5-fb1ae9899928 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 02:17:47.612628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554bb8d-3724-441e-b0b5-fb1ae9899928 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:47.617247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Thu Aug 4 02:17:47 2022] GET /identity/v3/projects/7aa60e5b58354576a0cb898fee2dc9ca => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:17:49.714177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac67c-0953-4075-87f4-24b8ae360a5c None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:49.714749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac67c-0953-4075-87f4-24b8ae360a5c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:49.714749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac67c-0953-4075-87f4-24b8ae360a5c None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:49.719568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:17:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:17:49.725135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5c134-139d-4565-b962-7cfec8c8a07b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:49.725536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5c134-139d-4565-b962-7cfec8c8a07b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:49.725700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5c134-139d-4565-b962-7cfec8c8a07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:49.756442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-45e5c134-139d-4565-b962-7cfec8c8a07b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:17:49.757977 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-45e5c134-139d-4565-b962-7cfec8c8a07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:17:49.767209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:17:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 02:17:49.790240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac67c-0953-4075-87f4-24b8ae360a5c None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:49.802977 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac67c-0953-4075-87f4-24b8ae360a5c None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:49.807277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd66ca-4720-43b0-a384-c3e7fb52e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:49.807918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd66ca-4720-43b0-a384-c3e7fb52e22e admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:49.808206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd66ca-4720-43b0-a384-c3e7fb52e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:49.808480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd66ca-4720-43b0-a384-c3e7fb52e22e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:49.817717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd66ca-4720-43b0-a384-c3e7fb52e22e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:49.819553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd66ca-4720-43b0-a384-c3e7fb52e22e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:49.829147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Thu Aug 4 02:17:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:17:49.835049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5c134-139d-4565-b962-7cfec8c8a07b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:49.844538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5c134-139d-4565-b962-7cfec8c8a07b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:49.849130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae616-42c1-46eb-a621-dc010a48ae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:49.849783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae616-42c1-46eb-a621-dc010a48ae22 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:49.850073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae616-42c1-46eb-a621-dc010a48ae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:49.850356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae616-42c1-46eb-a621-dc010a48ae22 admin admin] PATH_INFO: `/v3/users/41158534548d42db82795c2a83978403` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:49.851815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae616-42c1-46eb-a621-dc010a48ae22 admin admin] RBAC: Authorizing `identity:get_user(user_id=41158534548d42db82795c2a83978403)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:49.853666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae616-42c1-46eb-a621-dc010a48ae22 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:49.855287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Thu Aug 4 02:17:49 2022] GET /identity/v3/users/41158534548d42db82795c2a83978403 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:17:51.914564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2ac99-4542-4476-86ee-81345a590cda None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:51.915095 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2ac99-4542-4476-86ee-81345a590cda None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:51.915095 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2ac99-4542-4476-86ee-81345a590cda None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:51.916468 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:17:51.921512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7746ca-58ef-46cf-940d-66aa362bfaa3 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:51.921893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7746ca-58ef-46cf-940d-66aa362bfaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:51.922195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7746ca-58ef-46cf-940d-66aa362bfaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:51.941788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-7f7746ca-58ef-46cf-940d-66aa362bfaa3 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:17:51.943018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7f7746ca-58ef-46cf-940d-66aa362bfaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:17:51.956154 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d359c8-37f1-40f7-a6c5-19bf525d6d9f None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:51.956439 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d359c8-37f1-40f7-a6c5-19bf525d6d9f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:51.956714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d359c8-37f1-40f7-a6c5-19bf525d6d9f None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:51.958056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:17:51.963026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2cf0d-3f32-4361-8129-b7872ffbe745 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:51.963313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2cf0d-3f32-4361-8129-b7872ffbe745 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:51.963593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2cf0d-3f32-4361-8129-b7872ffbe745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:52.005667 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG passlib.handlers.bcrypt [None req-8ba2cf0d-3f32-4361-8129-b7872ffbe745 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80641) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 02:17:52.006121 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG passlib.handlers.bcrypt [None req-8ba2cf0d-3f32-4361-8129-b7872ffbe745 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80641) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 02:17:52.023995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:17:52.046806 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7746ca-58ef-46cf-940d-66aa362bfaa3 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:52.051781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8ba2cf0d-3f32-4361-8129-b7872ffbe745 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:17:52.053395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8ba2cf0d-3f32-4361-8129-b7872ffbe745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:17:52.071843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:52.153422 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7746ca-58ef-46cf-940d-66aa362bfaa3 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:52.155515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:17:52.176792 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2cf0d-3f32-4361-8129-b7872ffbe745 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:52.187200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868cc3f-7c5e-4cf3-acff-4580d5ffea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:52.187859 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868cc3f-7c5e-4cf3-acff-4580d5ffea03 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:52.188149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868cc3f-7c5e-4cf3-acff-4580d5ffea03 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:52.188435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868cc3f-7c5e-4cf3-acff-4580d5ffea03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:52.199936 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868cc3f-7c5e-4cf3-acff-4580d5ffea03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-5868cc3f-7c5e-4cf3-acff-4580d5ffea03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:17:52.209442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:17:52.210464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:17:52.211443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:17:52.217623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868cc3f-7c5e-4cf3-acff-4580d5ffea03 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:52.277567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2cf0d-3f32-4361-8129-b7872ffbe745 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:52.280358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:52.301689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:52.315529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b666ca-3bc3-47e3-938e-d796978dd61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:52.316454 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b666ca-3bc3-47e3-938e-d796978dd61f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:52.316745 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b666ca-3bc3-47e3-938e-d796978dd61f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:52.317021 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b666ca-3bc3-47e3-938e-d796978dd61f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:52.320210 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868cc3f-7c5e-4cf3-acff-4580d5ffea03 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:52.354937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743dcb5-ebbf-4d2a-a494-15f518d60081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:52.355563 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743dcb5-ebbf-4d2a-a494-15f518d60081 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:52.355852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743dcb5-ebbf-4d2a-a494-15f518d60081 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:52.356134 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743dcb5-ebbf-4d2a-a494-15f518d60081 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:52.356961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743dcb5-ebbf-4d2a-a494-15f518d60081 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:17:52.357956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743dcb5-ebbf-4d2a-a494-15f518d60081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:52.359482 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743dcb5-ebbf-4d2a-a494-15f518d60081 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:52.373748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:17:52.379333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743dcb5-ebbf-4d2a-a494-15f518d60081 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:52.386617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b666ca-3bc3-47e3-938e-d796978dd61f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:52.388210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b666ca-3bc3-47e3-938e-d796978dd61f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:52.494634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 02:17:52.501256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b666ca-3bc3-47e3-938e-d796978dd61f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:52.505128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:52.586526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743dcb5-ebbf-4d2a-a494-15f518d60081 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:52.598986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b666ca-3bc3-47e3-938e-d796978dd61f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:52.620806 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff750b5-c016-418c-bd1e-6b660d0839ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:52.621460 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff750b5-c016-418c-bd1e-6b660d0839ab None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:52.621746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff750b5-c016-418c-bd1e-6b660d0839ab None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:52.622026 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff750b5-c016-418c-bd1e-6b660d0839ab None admin] PATH_INFO: `/v3/users/41158534548d42db82795c2a83978403` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:52.623270 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff750b5-c016-418c-bd1e-6b660d0839ab None admin] RBAC: Authorizing `identity:get_user(user_id=41158534548d42db82795c2a83978403)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:52.624746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff750b5-c016-418c-bd1e-6b660d0839ab None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:52.626342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:17:52 2022] GET /identity/v3/users/41158534548d42db82795c2a83978403 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:17:52.631756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff750b5-c016-418c-bd1e-6b660d0839ab None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:52.633345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f825d0-11e4-4585-a2e9-e5cac498d225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:52.634215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f825d0-11e4-4585-a2e9-e5cac498d225 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:52.634514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f825d0-11e4-4585-a2e9-e5cac498d225 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:52.634786 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f825d0-11e4-4585-a2e9-e5cac498d225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:52.647056 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:52.654002 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f825d0-11e4-4585-a2e9-e5cac498d225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:52.656041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f825d0-11e4-4585-a2e9-e5cac498d225 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-91f825d0-11e4-4585-a2e9-e5cac498d225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:17:52.674257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:17:52.675145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:17:52.675948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:17:52.675948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:17:52.675948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:17:52.675948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:17:52.675948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:17:52.681346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f825d0-11e4-4585-a2e9-e5cac498d225 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:52.735375 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff750b5-c016-418c-bd1e-6b660d0839ab None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:52.738795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:52.770223 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271457d-c7ed-4e48-ac99-414fcef2a06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:52.770829 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271457d-c7ed-4e48-ac99-414fcef2a06c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:52.771158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271457d-c7ed-4e48-ac99-414fcef2a06c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:52.771432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271457d-c7ed-4e48-ac99-414fcef2a06c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:52.772585 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271457d-c7ed-4e48-ac99-414fcef2a06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:52.774045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271457d-c7ed-4e48-ac99-414fcef2a06c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:52.775656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:17:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:17:52.782530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271457d-c7ed-4e48-ac99-414fcef2a06c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:52.784966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f825d0-11e4-4585-a2e9-e5cac498d225 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:52.820144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3ee85-e5ce-41c8-9991-f7c067d668c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:52.820762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ee85-e5ce-41c8-9991-f7c067d668c5 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:52.821044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ee85-e5ce-41c8-9991-f7c067d668c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:52.821316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ee85-e5ce-41c8-9991-f7c067d668c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:52.821999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3ee85-e5ce-41c8-9991-f7c067d668c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:17:52.822386 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3ee85-e5ce-41c8-9991-f7c067d668c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:52.823813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3ee85-e5ce-41c8-9991-f7c067d668c5 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:52.842032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 10/20] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:17:52.868286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:52.889528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271457d-c7ed-4e48-ac99-414fcef2a06c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:52.928009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed01449-713e-4a10-92d9-94a60d2b0648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:52.928673 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed01449-713e-4a10-92d9-94a60d2b0648 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:52.928929 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed01449-713e-4a10-92d9-94a60d2b0648 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:52.929213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed01449-713e-4a10-92d9-94a60d2b0648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:52.930021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed01449-713e-4a10-92d9-94a60d2b0648 None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.domain.id=default, user.id=41158534548d42db82795c2a83978403) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:17:52.930336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed01449-713e-4a10-92d9-94a60d2b0648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:52.931874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed01449-713e-4a10-92d9-94a60d2b0648 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:52.939424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 11/21] 10.222.0.60 () {56 vars in 1322 bytes} [Thu Aug 4 02:17:52 2022] GET /identity/v3/role_assignments?user.id=41158534548d42db82795c2a83978403&scope.domain.id=default&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:17:55.125888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870a787-0af9-433b-8f6a-6f7bb8373d14 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:55.126416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870a787-0af9-433b-8f6a-6f7bb8373d14 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:55.126416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870a787-0af9-433b-8f6a-6f7bb8373d14 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:55.127831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 11/22] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:17:55.144973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434984c7-665a-4cfa-9b86-9637c4f5891c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:55.145492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434984c7-665a-4cfa-9b86-9637c4f5891c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:55.145578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434984c7-665a-4cfa-9b86-9637c4f5891c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:55.170038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-434984c7-665a-4cfa-9b86-9637c4f5891c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:17:55.171516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-434984c7-665a-4cfa-9b86-9637c4f5891c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:17:55.261124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 12/23] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:17:55.296430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870a787-0af9-433b-8f6a-6f7bb8373d14 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:55.305996 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbfb20-3044-47df-9647-4fcb55853608 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:55.306289 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbfb20-3044-47df-9647-4fcb55853608 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:55.306612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbfb20-3044-47df-9647-4fcb55853608 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:55.311724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:17:55 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:17:55.315900 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25c89d-bb53-42ca-ace4-1429375e3091 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:55.316196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25c89d-bb53-42ca-ace4-1429375e3091 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:55.316486 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25c89d-bb53-42ca-ace4-1429375e3091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:55.354730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-be25c89d-bb53-42ca-ace4-1429375e3091 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:17:55.355944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-be25c89d-bb53-42ca-ace4-1429375e3091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:17:55.481557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 14/25] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:17:55.502463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870a787-0af9-433b-8f6a-6f7bb8373d14 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:55.504780 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25c89d-bb53-42ca-ace4-1429375e3091 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:55.507971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:55.541163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:55.576575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234cff8-0103-4860-84eb-60f1b8de827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:55.577358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234cff8-0103-4860-84eb-60f1b8de827b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:55.577652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234cff8-0103-4860-84eb-60f1b8de827b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:55.577928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234cff8-0103-4860-84eb-60f1b8de827b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:55.593973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234cff8-0103-4860-84eb-60f1b8de827b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:55.595487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234cff8-0103-4860-84eb-60f1b8de827b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-e234cff8-0103-4860-84eb-60f1b8de827b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:17:55.622972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:17:55.623848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:17:55.624630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:17:55.624630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:17:55.624630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:17:55.624630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:17:55.624630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 12/26] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:17:55.631318 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234cff8-0103-4860-84eb-60f1b8de827b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:55.647429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25c89d-bb53-42ca-ace4-1429375e3091 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:55.684897 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89296c96-f19b-477c-a129-6787d0863232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:55.685691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89296c96-f19b-477c-a129-6787d0863232 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:55.685981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89296c96-f19b-477c-a129-6787d0863232 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:55.686256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89296c96-f19b-477c-a129-6787d0863232 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:55.710725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89296c96-f19b-477c-a129-6787d0863232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-89296c96-f19b-477c-a129-6787d0863232 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:17:55.724356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:17:55.725259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:17:55.726240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 15/27] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:17:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:17:55.735635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89296c96-f19b-477c-a129-6787d0863232 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:55.806288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:55.824687 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234cff8-0103-4860-84eb-60f1b8de827b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:55.889541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89296c96-f19b-477c-a129-6787d0863232 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:55.900271 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8484a64-f014-4e35-bc6e-5a8ffc93d80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:55.901190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8484a64-f014-4e35-bc6e-5a8ffc93d80f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:55.901694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8484a64-f014-4e35-bc6e-5a8ffc93d80f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:55.902163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8484a64-f014-4e35-bc6e-5a8ffc93d80f None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:55.903088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8484a64-f014-4e35-bc6e-5a8ffc93d80f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:17:55.904197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8484a64-f014-4e35-bc6e-5a8ffc93d80f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:55.906084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8484a64-f014-4e35-bc6e-5a8ffc93d80f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:55.917791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 13/28] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:17:55.920082 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1b929-e433-4b53-8b34-50e39a8e8a4c None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:55.920730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1b929-e433-4b53-8b34-50e39a8e8a4c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:55.921200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1b929-e433-4b53-8b34-50e39a8e8a4c None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:55.922671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 14/29] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:17:55.927349 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1683c79-979d-47ae-ad72-752f7355c59c None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:55.927648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1683c79-979d-47ae-ad72-752f7355c59c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:55.927929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1683c79-979d-47ae-ad72-752f7355c59c None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:55.930209 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 15/30] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:17:55.930209 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1683c79-979d-47ae-ad72-752f7355c59c None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:55.934397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79ed31-c0ec-4486-982c-faaf93dcafc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:55.935701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79ed31-c0ec-4486-982c-faaf93dcafc1 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:55.935701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79ed31-c0ec-4486-982c-faaf93dcafc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:55.935982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79ed31-c0ec-4486-982c-faaf93dcafc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:55.936860 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79ed31-c0ec-4486-982c-faaf93dcafc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:17:55.937261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79ed31-c0ec-4486-982c-faaf93dcafc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:55.938798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79ed31-c0ec-4486-982c-faaf93dcafc1 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:55.948560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 16/31] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:17:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:17:55.954331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1bc0b-d57d-48dc-9cd6-d0b930eae83b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:55.954331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1bc0b-d57d-48dc-9cd6-d0b930eae83b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:55.954331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1bc0b-d57d-48dc-9cd6-d0b930eae83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:55.971565 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-04f1bc0b-d57d-48dc-9cd6-d0b930eae83b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:17:55.972938 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-04f1bc0b-d57d-48dc-9cd6-d0b930eae83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:17:56.051271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 17/32] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:17:56.052815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580846d-61ae-46d1-a921-2387ef10c109 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:56.053327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580846d-61ae-46d1-a921-2387ef10c109 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:56.053805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580846d-61ae-46d1-a921-2387ef10c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:56.073349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-9580846d-61ae-46d1-a921-2387ef10c109 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:17:56.074920 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9580846d-61ae-46d1-a921-2387ef10c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:17:56.109959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:56.148603 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:56.171152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 18/33] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:17:56.172321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580846d-61ae-46d1-a921-2387ef10c109 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:56.215521 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1683c79-979d-47ae-ad72-752f7355c59c None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:56.252844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08157e4-2a64-4195-8649-3e931d660421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:56.253569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08157e4-2a64-4195-8649-3e931d660421 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:56.253912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08157e4-2a64-4195-8649-3e931d660421 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:56.254095 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08157e4-2a64-4195-8649-3e931d660421 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:56.255023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08157e4-2a64-4195-8649-3e931d660421 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:56.256469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08157e4-2a64-4195-8649-3e931d660421 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:56.297757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580846d-61ae-46d1-a921-2387ef10c109 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:56.335453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c80c25-6150-40d5-9c27-a89d27632ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:56.336190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c80c25-6150-40d5-9c27-a89d27632ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:56.336525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c80c25-6150-40d5-9c27-a89d27632ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:56.336809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c80c25-6150-40d5-9c27-a89d27632ff1 None admin] PATH_INFO: `/v3/users/41158534548d42db82795c2a83978403` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:56.337986 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c80c25-6150-40d5-9c27-a89d27632ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=41158534548d42db82795c2a83978403)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:56.339497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c80c25-6150-40d5-9c27-a89d27632ff1 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:56.345697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 19/34] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:17:56 2022] GET /identity/v3/users/41158534548d42db82795c2a83978403 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:17:56.345697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c80c25-6150-40d5-9c27-a89d27632ff1 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:56.418926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:56.470708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 16/35] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:17:55 2022] POST /identity/v3/projects => generated 301 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:17:56.471771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08157e4-2a64-4195-8649-3e931d660421 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:56.474584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c80c25-6150-40d5-9c27-a89d27632ff1 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:56.525639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3737828-bb64-4437-8b36-e90abae27e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:56.526723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3737828-bb64-4437-8b36-e90abae27e5c None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:56.527249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3737828-bb64-4437-8b36-e90abae27e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:56.528224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3737828-bb64-4437-8b36-e90abae27e5c None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:56.529684 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3737828-bb64-4437-8b36-e90abae27e5c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:56.532108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3737828-bb64-4437-8b36-e90abae27e5c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:56.583079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:56.607959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08157e4-2a64-4195-8649-3e931d660421 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:56.648866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccef5d4-2c6a-4138-be77-871df4771dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:56.649571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccef5d4-2c6a-4138-be77-871df4771dd6 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:56.649907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccef5d4-2c6a-4138-be77-871df4771dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:56.650191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccef5d4-2c6a-4138-be77-871df4771dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:56.651065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccef5d4-2c6a-4138-be77-871df4771dd6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:56.652675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccef5d4-2c6a-4138-be77-871df4771dd6 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:56.741523 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 17/36] 10.222.0.60 () {60 vars in 1131 bytes} [Thu Aug 4 02:17:56 2022] POST /identity/v3/roles => generated 225 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:17:56.748681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccef5d4-2c6a-4138-be77-871df4771dd6 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:56.783864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 20/37] 10.222.0.60 () {60 vars in 1131 bytes} [Thu Aug 4 02:17:56 2022] POST /identity/v3/roles => generated 219 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:17:56.785232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a609c-506a-4023-a06f-3382acc4029c None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:56.785535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a609c-506a-4023-a06f-3382acc4029c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:56.785824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a609c-506a-4023-a06f-3382acc4029c None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:56.787572 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 21/38] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:17:56.796455 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38179388-bf81-4e84-99bb-24b8524e91af None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:56.798977 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38179388-bf81-4e84-99bb-24b8524e91af None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:56.798977 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38179388-bf81-4e84-99bb-24b8524e91af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:56.838003 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-38179388-bf81-4e84-99bb-24b8524e91af None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:17:56.840420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-38179388-bf81-4e84-99bb-24b8524e91af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:17:56.891219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccef5d4-2c6a-4138-be77-871df4771dd6 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:56.928355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 22/39] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:17:56.929766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21da01f-3165-431a-b257-9726fa3f940f None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:56.930071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21da01f-3165-431a-b257-9726fa3f940f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:56.930359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21da01f-3165-431a-b257-9726fa3f940f None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:56.931796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 23/40] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:17:56.932458 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca11ae-bf81-44a0-800d-7273cd145f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:56.933342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca11ae-bf81-44a0-800d-7273cd145f65 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:56.933839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca11ae-bf81-44a0-800d-7273cd145f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:56.934317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca11ae-bf81-44a0-800d-7273cd145f65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:56.936561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca11ae-bf81-44a0-800d-7273cd145f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:56.938211 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94013140-7b30-4d6d-8369-44555b52fd75 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:56.938527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94013140-7b30-4d6d-8369-44555b52fd75 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:56.938822 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94013140-7b30-4d6d-8369-44555b52fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:56.939139 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca11ae-bf81-44a0-800d-7273cd145f65 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:56.941474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 18/41] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:17:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:17:56.952677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca11ae-bf81-44a0-800d-7273cd145f65 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:56.970061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-94013140-7b30-4d6d-8369-44555b52fd75 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:17:56.970748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:56.971706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-94013140-7b30-4d6d-8369-44555b52fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:17:57.026313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:57.067283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 24/42] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:17:57.068479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94013140-7b30-4d6d-8369-44555b52fd75 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:57.085437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca11ae-bf81-44a0-800d-7273cd145f65 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:57.121918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3f78e-f1fa-43bf-b0a0-6952e8b317ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:57.123258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3f78e-f1fa-43bf-b0a0-6952e8b317ad None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:57.123543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3f78e-f1fa-43bf-b0a0-6952e8b317ad None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:57.123826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3f78e-f1fa-43bf-b0a0-6952e8b317ad None admin] PATH_INFO: `/v3/domains/default/users/41158534548d42db82795c2a83978403/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:57.126056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3f78e-f1fa-43bf-b0a0-6952e8b317ad None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=41158534548d42db82795c2a83978403, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:57.127576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3f78e-f1fa-43bf-b0a0-6952e8b317ad None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:57.168667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94013140-7b30-4d6d-8369-44555b52fd75 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:57.200018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 19/43] 10.222.0.60 () {58 vars in 1361 bytes} [Thu Aug 4 02:17:56 2022] PUT /identity/v3/domains/default/users/41158534548d42db82795c2a83978403/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:17:57.200848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3f78e-f1fa-43bf-b0a0-6952e8b317ad None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:57.213247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00703719-04aa-4923-9b5c-e0b0ecdbad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:57.214195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00703719-04aa-4923-9b5c-e0b0ecdbad10 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:57.214500 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00703719-04aa-4923-9b5c-e0b0ecdbad10 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:57.214796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00703719-04aa-4923-9b5c-e0b0ecdbad10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:57.216622 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00703719-04aa-4923-9b5c-e0b0ecdbad10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:57.218294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00703719-04aa-4923-9b5c-e0b0ecdbad10 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:57.220256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 25/44] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:17:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:17:57.226048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00703719-04aa-4923-9b5c-e0b0ecdbad10 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:57.281838 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:57.287832 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:57.319996 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3f78e-f1fa-43bf-b0a0-6952e8b317ad None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:57.340891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00703719-04aa-4923-9b5c-e0b0ecdbad10 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:57.361011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe96c6-4866-46f1-9c44-77a522516820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:57.361652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe96c6-4866-46f1-9c44-77a522516820 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:57.361960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe96c6-4866-46f1-9c44-77a522516820 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:57.362226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe96c6-4866-46f1-9c44-77a522516820 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:57.363093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe96c6-4866-46f1-9c44-77a522516820 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:57.364581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe96c6-4866-46f1-9c44-77a522516820 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:57.379840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7161f-5346-493c-aa3f-06911416bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:57.380475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7161f-5346-493c-aa3f-06911416bf43 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:57.380763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7161f-5346-493c-aa3f-06911416bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:57.381044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7161f-5346-493c-aa3f-06911416bf43 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:57.381732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7161f-5346-493c-aa3f-06911416bf43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:57.383246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7161f-5346-493c-aa3f-06911416bf43 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:57.432303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 20/45] 10.222.0.60 () {60 vars in 1131 bytes} [Thu Aug 4 02:17:57 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:17:57.502943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 26/46] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:17:57 2022] POST /identity/v3/projects => generated 312 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:17:59.216492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4f92c-e0fe-40d7-8a49-b4005b5169bd None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:59.216998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4f92c-e0fe-40d7-8a49-b4005b5169bd None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:59.217079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4f92c-e0fe-40d7-8a49-b4005b5169bd None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:59.218442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 21/47] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:17:59.223779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eaa41-8d5a-4766-9bd2-b5264dae7b0a None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:59.224173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eaa41-8d5a-4766-9bd2-b5264dae7b0a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:59.224352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eaa41-8d5a-4766-9bd2-b5264dae7b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:59.242660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-008eaa41-8d5a-4766-9bd2-b5264dae7b0a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:17:59.243868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-008eaa41-8d5a-4766-9bd2-b5264dae7b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:17:59.309572 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 27/48] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:17:59.332891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4f92c-e0fe-40d7-8a49-b4005b5169bd None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:59.433059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4f92c-e0fe-40d7-8a49-b4005b5169bd None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:59.459152 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:59.467388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f6031-5c89-4fef-8fc5-d05f98839508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:59.468034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f6031-5c89-4fef-8fc5-d05f98839508 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:59.468325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f6031-5c89-4fef-8fc5-d05f98839508 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:59.468607 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f6031-5c89-4fef-8fc5-d05f98839508 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:59.480217 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f6031-5c89-4fef-8fc5-d05f98839508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-087f6031-5c89-4fef-8fc5-d05f98839508 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:17:59.486916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:17:59.487926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:17:59.488701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 22/49] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:17:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:17:59.493961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eaa41-8d5a-4766-9bd2-b5264dae7b0a None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:59.518151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:59.525626 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcb726-bb22-4bc7-b259-8f1050938e59 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:59.525916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcb726-bb22-4bc7-b259-8f1050938e59 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:59.526196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcb726-bb22-4bc7-b259-8f1050938e59 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:59.527612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 23/50] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:17:59.533056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f7918-5ca4-486c-ab50-a93b230504a3 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:59.533348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f7918-5ca4-486c-ab50-a93b230504a3 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:59.533631 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f7918-5ca4-486c-ab50-a93b230504a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:59.553274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b76f7918-5ca4-486c-ab50-a93b230504a3 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:17:59.554845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b76f7918-5ca4-486c-ab50-a93b230504a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:17:59.593184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eaa41-8d5a-4766-9bd2-b5264dae7b0a None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:59.623850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 24/51] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:17:59.627481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1724b51-cab1-4b1a-9a40-c098741e3f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:59.628118 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1724b51-cab1-4b1a-9a40-c098741e3f3a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:59.628641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1724b51-cab1-4b1a-9a40-c098741e3f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:59.629166 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1724b51-cab1-4b1a-9a40-c098741e3f3a None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:59.630575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1724b51-cab1-4b1a-9a40-c098741e3f3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:17:59.630891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1724b51-cab1-4b1a-9a40-c098741e3f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:59.632298 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1724b51-cab1-4b1a-9a40-c098741e3f3a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:59.641135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 28/52] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:17:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:17:59.646887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f7918-5ca4-486c-ab50-a93b230504a3 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:59.647160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1724b51-cab1-4b1a-9a40-c098741e3f3a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:59.733408 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:59.746887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f7918-5ca4-486c-ab50-a93b230504a3 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:59.748220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1724b51-cab1-4b1a-9a40-c098741e3f3a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:59.764708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:17:59.782626 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace8a3e-9e92-4929-b04f-3c3929e4a051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:59.782948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24327be4-94ad-4b09-bacd-0ccc0a831b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:59.783309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace8a3e-9e92-4929-b04f-3c3929e4a051 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:59.783589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327be4-94ad-4b09-bacd-0ccc0a831b14 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:59.783678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace8a3e-9e92-4929-b04f-3c3929e4a051 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:59.783867 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace8a3e-9e92-4929-b04f-3c3929e4a051 None admin] PATH_INFO: `/v3/users/41158534548d42db82795c2a83978403` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:59.783951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327be4-94ad-4b09-bacd-0ccc0a831b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:59.784140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24327be4-94ad-4b09-bacd-0ccc0a831b14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:59.785083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace8a3e-9e92-4929-b04f-3c3929e4a051 None admin] RBAC: Authorizing `identity:get_user(user_id=41158534548d42db82795c2a83978403)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:59.785330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24327be4-94ad-4b09-bacd-0ccc0a831b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:59.786586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace8a3e-9e92-4929-b04f-3c3929e4a051 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:59.786797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24327be4-94ad-4b09-bacd-0ccc0a831b14 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:59.788235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 25/53] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:17:59 2022] GET /identity/v3/users/41158534548d42db82795c2a83978403 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:17:59.788607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 29/54] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:17:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:17:59.793715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace8a3e-9e92-4929-b04f-3c3929e4a051 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:59.793831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24327be4-94ad-4b09-bacd-0ccc0a831b14 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:59.894331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24327be4-94ad-4b09-bacd-0ccc0a831b14 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:59.897363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace8a3e-9e92-4929-b04f-3c3929e4a051 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:17:59.929189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4434f-7743-4082-92a2-ee75268979b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:59.929781 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4434f-7743-4082-92a2-ee75268979b9 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:59.930068 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4434f-7743-4082-92a2-ee75268979b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:59.930346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4434f-7743-4082-92a2-ee75268979b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:59.931061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ada41-bde9-45c1-8a6a-75c0d84a883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:17:59.931174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4434f-7743-4082-92a2-ee75268979b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:59.931699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ada41-bde9-45c1-8a6a-75c0d84a883b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:17:59.931982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ada41-bde9-45c1-8a6a-75c0d84a883b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:17:59.932259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ada41-bde9-45c1-8a6a-75c0d84a883b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:17:59.932526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4434f-7743-4082-92a2-ee75268979b9 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:59.933417 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ada41-bde9-45c1-8a6a-75c0d84a883b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:17:59.934946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ada41-bde9-45c1-8a6a-75c0d84a883b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:17:59.936527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 26/55] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:17:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:17:59.942403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ada41-bde9-45c1-8a6a-75c0d84a883b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:17:59.996434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:00.039655 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ada41-bde9-45c1-8a6a-75c0d84a883b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:00.072262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad33777-8efa-4028-a0e0-85b5455d9def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:00.072885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33777-8efa-4028-a0e0-85b5455d9def None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:00.073178 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33777-8efa-4028-a0e0-85b5455d9def None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:00.073462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33777-8efa-4028-a0e0-85b5455d9def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:00.074261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad33777-8efa-4028-a0e0-85b5455d9def None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.domain.id=default, user.id=41158534548d42db82795c2a83978403) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:00.074609 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad33777-8efa-4028-a0e0-85b5455d9def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:00.076545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad33777-8efa-4028-a0e0-85b5455d9def None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:00.084333 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 27/56] 10.222.0.60 () {56 vars in 1322 bytes} [Thu Aug 4 02:17:59 2022] GET /identity/v3/role_assignments?user.id=41158534548d42db82795c2a83978403&scope.domain.id=default&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:00.202753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 30/57] 10.222.0.60 () {60 vars in 1140 bytes} [Thu Aug 4 02:17:59 2022] POST /identity/v3/projects => generated 298 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:18:02.231039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fc13c-4cde-4cd0-be83-b9655ed73bc2 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:02.231539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fc13c-4cde-4cd0-be83-b9655ed73bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:02.231649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fc13c-4cde-4cd0-be83-b9655ed73bc2 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:02.233039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 28/58] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:02.238063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee191-dabf-4074-b6e5-613f552e0dd3 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:02.238495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee191-dabf-4074-b6e5-613f552e0dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:02.238665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee191-dabf-4074-b6e5-613f552e0dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:02.251547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:02.256669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-37bee191-dabf-4074-b6e5-613f552e0dd3 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:02.257880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-37bee191-dabf-4074-b6e5-613f552e0dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:02.325503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 31/59] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:02.349562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fc13c-4cde-4cd0-be83-b9655ed73bc2 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:02.448857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fc13c-4cde-4cd0-be83-b9655ed73bc2 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:02.466275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:02.483167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622f5a3-3d91-4195-9a6f-6269ba081670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:02.483803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622f5a3-3d91-4195-9a6f-6269ba081670 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:02.484090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622f5a3-3d91-4195-9a6f-6269ba081670 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:02.484375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622f5a3-3d91-4195-9a6f-6269ba081670 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:02.485544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622f5a3-3d91-4195-9a6f-6269ba081670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:02.487048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622f5a3-3d91-4195-9a6f-6269ba081670 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:02.488625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 29/60] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:02.494499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee191-dabf-4074-b6e5-613f552e0dd3 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:02.591830 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee191-dabf-4074-b6e5-613f552e0dd3 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:02.624616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43e75a-25be-4c4e-8759-34918b6ec29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:02.625230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43e75a-25be-4c4e-8759-34918b6ec29d None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:02.625517 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43e75a-25be-4c4e-8759-34918b6ec29d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:02.625796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43e75a-25be-4c4e-8759-34918b6ec29d None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:02.626510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43e75a-25be-4c4e-8759-34918b6ec29d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:02.627954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43e75a-25be-4c4e-8759-34918b6ec29d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:02.639959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:02.737019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 32/61] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:18:02 2022] POST /identity/v3/users => generated 275 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:18:05.981703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caf098-13b1-47f3-90cf-9c920a7a25d6 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:05.982325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caf098-13b1-47f3-90cf-9c920a7a25d6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:05.982325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caf098-13b1-47f3-90cf-9c920a7a25d6 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:05.983871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 30/62] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:05.989393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43741dc7-849f-4898-bf4c-7238443adf56 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:05.990225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43741dc7-849f-4898-bf4c-7238443adf56 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:05.990743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43741dc7-849f-4898-bf4c-7238443adf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.019528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-43741dc7-849f-4898-bf4c-7238443adf56 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:06.021029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-43741dc7-849f-4898-bf4c-7238443adf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:06.036561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976a7f2-755a-40f4-86cf-5414d1a998bb None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.037144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976a7f2-755a-40f4-86cf-5414d1a998bb None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.037604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976a7f2-755a-40f4-86cf-5414d1a998bb None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.049843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:06 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:06.055150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a8da2-f09a-4e75-b39d-50130366f07a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.055638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a8da2-f09a-4e75-b39d-50130366f07a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.056115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a8da2-f09a-4e75-b39d-50130366f07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.083063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8a3a8da2-f09a-4e75-b39d-50130366f07a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:06.084740 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8a3a8da2-f09a-4e75-b39d-50130366f07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:06.126472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 33/64] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:06.128002 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412d3ae-ef6d-439d-a50f-9a04d9c6593e None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.128461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412d3ae-ef6d-439d-a50f-9a04d9c6593e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.128881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412d3ae-ef6d-439d-a50f-9a04d9c6593e None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.130291 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 34/65] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:06.132140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aa19d-c8dc-4144-b9c1-d2d5ecadbdcd None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.132633 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aa19d-c8dc-4144-b9c1-d2d5ecadbdcd None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.133129 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aa19d-c8dc-4144-b9c1-d2d5ecadbdcd None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.135643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 35/66] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:06.140458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab582-7194-4d58-bdd2-1ce5847597f8 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.140751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab582-7194-4d58-bdd2-1ce5847597f8 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.141033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab582-7194-4d58-bdd2-1ce5847597f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.164579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-5eaab582-7194-4d58-bdd2-1ce5847597f8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:06.165779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5eaab582-7194-4d58-bdd2-1ce5847597f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:06.173330 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 32/67] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:06.174886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecda170-8cda-4b17-9b65-e099e6580b9f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.175184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecda170-8cda-4b17-9b65-e099e6580b9f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.175471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecda170-8cda-4b17-9b65-e099e6580b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.205953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8ecda170-8cda-4b17-9b65-e099e6580b9f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:06.207598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8ecda170-8cda-4b17-9b65-e099e6580b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:06.241694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 36/68] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:06.242871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab582-7194-4d58-bdd2-1ce5847597f8 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:06.282776 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 33/69] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:06.290660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecda170-8cda-4b17-9b65-e099e6580b9f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:06.319558 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:06.335442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:06.373009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab582-7194-4d58-bdd2-1ce5847597f8 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:06.389961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecda170-8cda-4b17-9b65-e099e6580b9f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:06.410834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc10fb-25f5-4bb0-80f0-4930b1b811f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:06.411494 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc10fb-25f5-4bb0-80f0-4930b1b811f2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.411797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc10fb-25f5-4bb0-80f0-4930b1b811f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.412065 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc10fb-25f5-4bb0-80f0-4930b1b811f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.423736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc10fb-25f5-4bb0-80f0-4930b1b811f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:06.426687 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716a9d8-3b55-46d9-a19c-0604151ede89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:06.427537 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716a9d8-3b55-46d9-a19c-0604151ede89 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.427994 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716a9d8-3b55-46d9-a19c-0604151ede89 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.428439 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716a9d8-3b55-46d9-a19c-0604151ede89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-bafc10fb-25f5-4bb0-80f0-4930b1b811f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:06.428787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:06.429595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:06.430366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 37/70] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:06.431029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc10fb-25f5-4bb0-80f0-4930b1b811f2 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:06.446803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716a9d8-3b55-46d9-a19c-0604151ede89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-d716a9d8-3b55-46d9-a19c-0604151ede89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:06.452486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:06.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 34/71] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:06.454512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716a9d8-3b55-46d9-a19c-0604151ede89 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:06.544872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc10fb-25f5-4bb0-80f0-4930b1b811f2 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:06.557990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:06.566692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716a9d8-3b55-46d9-a19c-0604151ede89 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:06.575361 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:06.580591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a510dd-3155-4cb5-897f-283ee117c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:06.581241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a510dd-3155-4cb5-897f-283ee117c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.581564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a510dd-3155-4cb5-897f-283ee117c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.581878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a510dd-3155-4cb5-897f-283ee117c7d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.594818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a510dd-3155-4cb5-897f-283ee117c7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-58a510dd-3155-4cb5-897f-283ee117c7d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:06.599928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:06.600784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:06.601606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 38/72] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:06.604457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a510dd-3155-4cb5-897f-283ee117c7d7 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:06.608355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e478e9-a15e-4864-886e-dc093d8dfaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:06.609015 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e478e9-a15e-4864-886e-dc093d8dfaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.609304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e478e9-a15e-4864-886e-dc093d8dfaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.609583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e478e9-a15e-4864-886e-dc093d8dfaf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.620317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e478e9-a15e-4864-886e-dc093d8dfaf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-a1e478e9-a15e-4864-886e-dc093d8dfaf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:06.625902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:06.626812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:06.627777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 35/73] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:18:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:06.629263 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e478e9-a15e-4864-886e-dc093d8dfaf8 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:06.712503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a510dd-3155-4cb5-897f-283ee117c7d7 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:06.730325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e478e9-a15e-4864-886e-dc093d8dfaf8 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:06.745624 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780e2bb-6f99-493b-8f34-7c5baa60299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:06.746242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780e2bb-6f99-493b-8f34-7c5baa60299d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.746582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780e2bb-6f99-493b-8f34-7c5baa60299d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.746954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780e2bb-6f99-493b-8f34-7c5baa60299d None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.747760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780e2bb-6f99-493b-8f34-7c5baa60299d None admin] RBAC: Adding query filter params (name=member) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:06.748070 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780e2bb-6f99-493b-8f34-7c5baa60299d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:06.749486 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780e2bb-6f99-493b-8f34-7c5baa60299d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:06.757420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 39/74] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:06.758206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780e2bb-6f99-493b-8f34-7c5baa60299d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:06.768488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc36e6-f317-473f-b3dd-fe70f979ec8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:06.769113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc36e6-f317-473f-b3dd-fe70f979ec8a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.769404 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc36e6-f317-473f-b3dd-fe70f979ec8a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.769689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc36e6-f317-473f-b3dd-fe70f979ec8a None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.770414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc36e6-f317-473f-b3dd-fe70f979ec8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:06.770759 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc36e6-f317-473f-b3dd-fe70f979ec8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:06.772157 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc36e6-f317-473f-b3dd-fe70f979ec8a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:06.784427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 36/75] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:18:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:06.785223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc36e6-f317-473f-b3dd-fe70f979ec8a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:06.798032 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:06.812998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:06.863211 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780e2bb-6f99-493b-8f34-7c5baa60299d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:06.885047 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc36e6-f317-473f-b3dd-fe70f979ec8a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:06.896954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128552-895e-41b6-b125-d0e9a57565ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:06.897576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128552-895e-41b6-b125-d0e9a57565ac None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.897865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128552-895e-41b6-b125-d0e9a57565ac None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.898145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128552-895e-41b6-b125-d0e9a57565ac None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.898889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb128552-895e-41b6-b125-d0e9a57565ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:06.899205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb128552-895e-41b6-b125-d0e9a57565ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:06.900604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb128552-895e-41b6-b125-d0e9a57565ac None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:06.909437 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 40/76] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:06.910749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0aed1-d82a-45ec-9cdf-c64a81d035e9 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.911048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0aed1-d82a-45ec-9cdf-c64a81d035e9 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.911334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0aed1-d82a-45ec-9cdf-c64a81d035e9 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.914547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 41/77] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:06.914547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0aed1-d82a-45ec-9cdf-c64a81d035e9 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:06.921780 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5604d-1894-4579-8da9-5baf0fe8e822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:06.922407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5604d-1894-4579-8da9-5baf0fe8e822 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:06.922737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5604d-1894-4579-8da9-5baf0fe8e822 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:06.923376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5604d-1894-4579-8da9-5baf0fe8e822 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:06.923756 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5604d-1894-4579-8da9-5baf0fe8e822 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:06.924070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5604d-1894-4579-8da9-5baf0fe8e822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:06.925515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5604d-1894-4579-8da9-5baf0fe8e822 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:06.935062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 37/78] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:06.935850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5604d-1894-4579-8da9-5baf0fe8e822 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:07.009395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:07.016570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0aed1-d82a-45ec-9cdf-c64a81d035e9 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:07.026406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:07.035952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5604d-1894-4579-8da9-5baf0fe8e822 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:07.055608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddba8f0-e6c0-42b5-ab23-14fe036298ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:07.056310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddba8f0-e6c0-42b5-ab23-14fe036298ea None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:07.056692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddba8f0-e6c0-42b5-ab23-14fe036298ea None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:07.057061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddba8f0-e6c0-42b5-ab23-14fe036298ea None admin] PATH_INFO: `/v3/users/d9d1524bdf514276aeb2826c6b3bb363` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:07.071874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddba8f0-e6c0-42b5-ab23-14fe036298ea None admin] RBAC: Authorizing `identity:get_user(user_id=d9d1524bdf514276aeb2826c6b3bb363)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:07.072390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27c291-d812-4a11-a16d-37b449beea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:07.073039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27c291-d812-4a11-a16d-37b449beea05 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:07.073329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27c291-d812-4a11-a16d-37b449beea05 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:07.073413 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddba8f0-e6c0-42b5-ab23-14fe036298ea None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:07.073613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27c291-d812-4a11-a16d-37b449beea05 None admin] PATH_INFO: `/v3/users/d9d1524bdf514276aeb2826c6b3bb363` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:07.075448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27c291-d812-4a11-a16d-37b449beea05 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d1524bdf514276aeb2826c6b3bb363)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:07.075598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 42/79] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:06 2022] GET /identity/v3/users/d9d1524bdf514276aeb2826c6b3bb363 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:07.076467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddba8f0-e6c0-42b5-ab23-14fe036298ea None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:07.079990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27c291-d812-4a11-a16d-37b449beea05 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:07.086331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 38/80] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:06 2022] GET /identity/v3/users/d9d1524bdf514276aeb2826c6b3bb363 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:07.086331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d15bb-804b-4bae-bfdf-946e2bdf145f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:07.086331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d15bb-804b-4bae-bfdf-946e2bdf145f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:07.086331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d15bb-804b-4bae-bfdf-946e2bdf145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:07.101581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-3d9d15bb-804b-4bae-bfdf-946e2bdf145f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:07.102801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-3d9d15bb-804b-4bae-bfdf-946e2bdf145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:07.170930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 39/81] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:07.172000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d15bb-804b-4bae-bfdf-946e2bdf145f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:07.187142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddba8f0-e6c0-42b5-ab23-14fe036298ea None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:07.222178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6142b4-7aa8-4ed1-bf9d-5c104fbabb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:07.222854 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6142b4-7aa8-4ed1-bf9d-5c104fbabb28 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:07.223145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6142b4-7aa8-4ed1-bf9d-5c104fbabb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:07.223420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6142b4-7aa8-4ed1-bf9d-5c104fbabb28 None admin] PATH_INFO: `/v3/users/d9d1524bdf514276aeb2826c6b3bb363` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:07.224603 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6142b4-7aa8-4ed1-bf9d-5c104fbabb28 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d1524bdf514276aeb2826c6b3bb363)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:07.226062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6142b4-7aa8-4ed1-bf9d-5c104fbabb28 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:07.227702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 43/82] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:07 2022] GET /identity/v3/users/d9d1524bdf514276aeb2826c6b3bb363 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:07.228471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6142b4-7aa8-4ed1-bf9d-5c104fbabb28 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:07.254305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:07.258907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:07.271331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d15bb-804b-4bae-bfdf-946e2bdf145f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:07.304044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a17af-110a-4bd1-bd46-8ba83a506dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:07.304715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a17af-110a-4bd1-bd46-8ba83a506dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:07.305005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a17af-110a-4bd1-bd46-8ba83a506dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:07.305288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a17af-110a-4bd1-bd46-8ba83a506dc3 None admin] PATH_INFO: `/v3/users/41158534548d42db82795c2a83978403` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:07.306549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a17af-110a-4bd1-bd46-8ba83a506dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=41158534548d42db82795c2a83978403)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:07.307989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a17af-110a-4bd1-bd46-8ba83a506dc3 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:07.310567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 40/83] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:07 2022] GET /identity/v3/users/41158534548d42db82795c2a83978403 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:07.311340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a17af-110a-4bd1-bd46-8ba83a506dc3 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:07.332031 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6142b4-7aa8-4ed1-bf9d-5c104fbabb28 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:07.366311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcfc25-06a7-448b-892f-c328bce49584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:07.366962 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcfc25-06a7-448b-892f-c328bce49584 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:07.367248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcfc25-06a7-448b-892f-c328bce49584 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:07.367531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcfc25-06a7-448b-892f-c328bce49584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:07.411430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a17af-110a-4bd1-bd46-8ba83a506dc3 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:07.436024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcfc25-06a7-448b-892f-c328bce49584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:07.437508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcfc25-06a7-448b-892f-c328bce49584 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:07.446159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c85ab-cd53-4396-97de-179d6431caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:07.446816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c85ab-cd53-4396-97de-179d6431caaf None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:07.447111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c85ab-cd53-4396-97de-179d6431caaf None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:07.447385 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c85ab-cd53-4396-97de-179d6431caaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:07.460758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:07.471855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:07.515769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c85ab-cd53-4396-97de-179d6431caaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:07.517258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c85ab-cd53-4396-97de-179d6431caaf None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:07.538508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 44/84] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:07.539633 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcfc25-06a7-448b-892f-c328bce49584 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:07.614843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 41/85] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:07.615684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c85ab-cd53-4396-97de-179d6431caaf None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:07.638599 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcfc25-06a7-448b-892f-c328bce49584 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:07.660763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:07.669595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:07.672708 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9100d97-abca-46b5-b821-743bd1abfc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:07.673355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9100d97-abca-46b5-b821-743bd1abfc0b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:07.673646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9100d97-abca-46b5-b821-743bd1abfc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:07.673926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9100d97-abca-46b5-b821-743bd1abfc0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:07.678548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9100d97-abca-46b5-b821-743bd1abfc0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:07.678548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9100d97-abca-46b5-b821-743bd1abfc0b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:07.678548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 45/86] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:07.678941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9100d97-abca-46b5-b821-743bd1abfc0b None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:07.713410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c85ab-cd53-4396-97de-179d6431caaf None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:07.748196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed110a-f625-4710-a232-82634ce1fc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:07.748823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed110a-f625-4710-a232-82634ce1fc3f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:07.749110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed110a-f625-4710-a232-82634ce1fc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:07.749389 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed110a-f625-4710-a232-82634ce1fc3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:07.780452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9100d97-abca-46b5-b821-743bd1abfc0b None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:07.813195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3361443-dd0a-404e-a3ce-e04f911fb898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:07.813807 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3361443-dd0a-404e-a3ce-e04f911fb898 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:07.814347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3361443-dd0a-404e-a3ce-e04f911fb898 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:07.814658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3361443-dd0a-404e-a3ce-e04f911fb898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:07.818104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed110a-f625-4710-a232-82634ce1fc3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:07.819637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed110a-f625-4710-a232-82634ce1fc3f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:07.871368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:07.872935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:07.881969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3361443-dd0a-404e-a3ce-e04f911fb898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:07.883491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3361443-dd0a-404e-a3ce-e04f911fb898 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:07.918192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 42/87] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:07.919127 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed110a-f625-4710-a232-82634ce1fc3f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:07.983017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 46/88] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:07.983863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3361443-dd0a-404e-a3ce-e04f911fb898 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:08.020131 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed110a-f625-4710-a232-82634ce1fc3f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:08.054162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b9110-3a2a-4f5a-9344-086dba2645c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:08.054844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b9110-3a2a-4f5a-9344-086dba2645c8 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:08.055134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b9110-3a2a-4f5a-9344-086dba2645c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:08.055419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b9110-3a2a-4f5a-9344-086dba2645c8 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:08.056597 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b9110-3a2a-4f5a-9344-086dba2645c8 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:08.058054 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b9110-3a2a-4f5a-9344-086dba2645c8 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:08.065693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 43/89] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:07 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:08.065693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b9110-3a2a-4f5a-9344-086dba2645c8 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:08.076232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:08.085596 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3361443-dd0a-404e-a3ce-e04f911fb898 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:08.092693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:08.120337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3c6b7-4cb8-4a3e-b592-5bdae80aa186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:08.120984 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3c6b7-4cb8-4a3e-b592-5bdae80aa186 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:08.121275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3c6b7-4cb8-4a3e-b592-5bdae80aa186 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:08.122139 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3c6b7-4cb8-4a3e-b592-5bdae80aa186 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:08.123303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3c6b7-4cb8-4a3e-b592-5bdae80aa186 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:08.124827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3c6b7-4cb8-4a3e-b592-5bdae80aa186 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:08.126542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 47/90] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:07 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:08.127313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3c6b7-4cb8-4a3e-b592-5bdae80aa186 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:08.172325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b9110-3a2a-4f5a-9344-086dba2645c8 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:08.206109 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbf19a-ed8c-48b6-bf99-36d01a013d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:08.206759 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbf19a-ed8c-48b6-bf99-36d01a013d3a None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:08.207054 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbf19a-ed8c-48b6-bf99-36d01a013d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:08.207334 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbf19a-ed8c-48b6-bf99-36d01a013d3a None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:08.208026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbf19a-ed8c-48b6-bf99-36d01a013d3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:08.209478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbf19a-ed8c-48b6-bf99-36d01a013d3a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:08.225479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3c6b7-4cb8-4a3e-b592-5bdae80aa186 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:08.259584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b4703-a4e1-49b1-976c-134f19cf0263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:08.260231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b4703-a4e1-49b1-976c-134f19cf0263 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:08.260534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b4703-a4e1-49b1-976c-134f19cf0263 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:08.260808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b4703-a4e1-49b1-976c-134f19cf0263 None admin] PATH_INFO: `/v3/projects/cdf1fe3dc88a498fbc578833c517f266` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:08.261989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b4703-a4e1-49b1-976c-134f19cf0263 None admin] RBAC: Authorizing `identity:get_project(project_id=cdf1fe3dc88a498fbc578833c517f266)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:08.263756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b4703-a4e1-49b1-976c-134f19cf0263 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:08.265421 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 48/91] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:08 2022] GET /identity/v3/projects/cdf1fe3dc88a498fbc578833c517f266 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:08.266822 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b4703-a4e1-49b1-976c-134f19cf0263 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:08.291349 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 44/92] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:18:08 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:18:08.292185 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbf19a-ed8c-48b6-bf99-36d01a013d3a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:08.304743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:08.391958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b4703-a4e1-49b1-976c-134f19cf0263 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:08.392133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:08.412934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbf19a-ed8c-48b6-bf99-36d01a013d3a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:08.430444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250030ec-1a30-4f99-9955-7c4cbe80f374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:08.431289 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250030ec-1a30-4f99-9955-7c4cbe80f374 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:08.431410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250030ec-1a30-4f99-9955-7c4cbe80f374 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:08.431711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250030ec-1a30-4f99-9955-7c4cbe80f374 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:08.432916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250030ec-1a30-4f99-9955-7c4cbe80f374 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:08.435362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250030ec-1a30-4f99-9955-7c4cbe80f374 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:08.442291 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 49/93] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:08 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:08.442291 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250030ec-1a30-4f99-9955-7c4cbe80f374 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:08.458670 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d1859-575e-48af-9617-621f7914d6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:08.459630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d1859-575e-48af-9617-621f7914d6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:08.459734 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d1859-575e-48af-9617-621f7914d6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:08.460718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d1859-575e-48af-9617-621f7914d6e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:08.460838 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d1859-575e-48af-9617-621f7914d6e4 None admin] RBAC: Adding query filter params (role.id=b83f9277d44246c5983fe3b6d7d5af96, scope.project.id=b312e6a347184d229a1a2c04149bbe2e, user.id=d9d1524bdf514276aeb2826c6b3bb363) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:08.461093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d1859-575e-48af-9617-621f7914d6e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:08.466143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d1859-575e-48af-9617-621f7914d6e4 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:08.474637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 45/94] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:08 2022] GET /identity/v3/role_assignments?user.id=d9d1524bdf514276aeb2826c6b3bb363&scope.project.id=b312e6a347184d229a1a2c04149bbe2e&role.id=b83f9277d44246c5983fe3b6d7d5af96 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:08.475893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d1859-575e-48af-9617-621f7914d6e4 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:08.564771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:08.573825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250030ec-1a30-4f99-9955-7c4cbe80f374 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:08.609022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d1859-575e-48af-9617-621f7914d6e4 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:08.622894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eade4dd-fb0c-47c9-b0af-140ae272368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:08.623680 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eade4dd-fb0c-47c9-b0af-140ae272368c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:08.623980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eade4dd-fb0c-47c9-b0af-140ae272368c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:08.624261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eade4dd-fb0c-47c9-b0af-140ae272368c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:08.625151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eade4dd-fb0c-47c9-b0af-140ae272368c None admin] RBAC: Adding query filter params (role.id=d2d09ac7138145968d31dde4d5b9ee5a, scope.project.id=b312e6a347184d229a1a2c04149bbe2e, user.id=d9d1524bdf514276aeb2826c6b3bb363) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:08.625396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eade4dd-fb0c-47c9-b0af-140ae272368c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:08.628573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eade4dd-fb0c-47c9-b0af-140ae272368c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:08.634566 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 50/95] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:08 2022] GET /identity/v3/role_assignments?user.id=d9d1524bdf514276aeb2826c6b3bb363&scope.project.id=b312e6a347184d229a1a2c04149bbe2e&role.id=d2d09ac7138145968d31dde4d5b9ee5a => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:08.639431 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eade4dd-fb0c-47c9-b0af-140ae272368c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:08.664883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a4439-49b1-4d4b-8af7-657ed7e27503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:08.665890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a4439-49b1-4d4b-8af7-657ed7e27503 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:08.666381 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a4439-49b1-4d4b-8af7-657ed7e27503 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:08.667024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a4439-49b1-4d4b-8af7-657ed7e27503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:08.668057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a4439-49b1-4d4b-8af7-657ed7e27503 None admin] RBAC: Adding query filter params (role.id=b83f9277d44246c5983fe3b6d7d5af96, scope.project.id=cdf1fe3dc88a498fbc578833c517f266, user.id=d9d1524bdf514276aeb2826c6b3bb363) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:08.671500 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a4439-49b1-4d4b-8af7-657ed7e27503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:08.673422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a4439-49b1-4d4b-8af7-657ed7e27503 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:08.680675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 46/96] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:08 2022] GET /identity/v3/role_assignments?user.id=d9d1524bdf514276aeb2826c6b3bb363&scope.project.id=cdf1fe3dc88a498fbc578833c517f266&role.id=b83f9277d44246c5983fe3b6d7d5af96 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:08.789927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eade4dd-fb0c-47c9-b0af-140ae272368c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:08.833333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803321e-f461-4c31-bac3-c53e4a46e401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:08.834370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803321e-f461-4c31-bac3-c53e4a46e401 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:08.834881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803321e-f461-4c31-bac3-c53e4a46e401 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:08.835395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803321e-f461-4c31-bac3-c53e4a46e401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:08.836462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803321e-f461-4c31-bac3-c53e4a46e401 None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=b312e6a347184d229a1a2c04149bbe2e, user.id=41158534548d42db82795c2a83978403) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:08.836995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803321e-f461-4c31-bac3-c53e4a46e401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:08.838747 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803321e-f461-4c31-bac3-c53e4a46e401 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:08.846838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 51/97] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:08 2022] GET /identity/v3/role_assignments?user.id=41158534548d42db82795c2a83978403&scope.project.id=b312e6a347184d229a1a2c04149bbe2e&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:10.893464 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac4fca-88a0-44ae-a895-bb1b1a0f9ee7 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:10.893971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac4fca-88a0-44ae-a895-bb1b1a0f9ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:10.894045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac4fca-88a0-44ae-a895-bb1b1a0f9ee7 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:10.895589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 47/98] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:10.900901 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84d17-3e40-40a0-9118-45102608d688 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:10.901304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84d17-3e40-40a0-9118-45102608d688 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:10.901630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84d17-3e40-40a0-9118-45102608d688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:10.921403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f7e84d17-3e40-40a0-9118-45102608d688 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:10.922722 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f7e84d17-3e40-40a0-9118-45102608d688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:10.940593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:11.003270 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 52/99] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:11.038458 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac4fca-88a0-44ae-a895-bb1b1a0f9ee7 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:11.055262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:11.151482 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac4fca-88a0-44ae-a895-bb1b1a0f9ee7 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:11.187281 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347e096-d19d-48a5-b572-71795b4a615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:11.187932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347e096-d19d-48a5-b572-71795b4a615a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:11.188222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347e096-d19d-48a5-b572-71795b4a615a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:11.188502 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347e096-d19d-48a5-b572-71795b4a615a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:11.199422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347e096-d19d-48a5-b572-71795b4a615a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-d347e096-d19d-48a5-b572-71795b4a615a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:11.204969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:11.207338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:11.209224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 48/100] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:11.212207 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e84d17-3e40-40a0-9118-45102608d688 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:11.335729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e84d17-3e40-40a0-9118-45102608d688 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:11.386290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535a0dc-3ed5-401d-844f-b00923d839ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:11.387674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535a0dc-3ed5-401d-844f-b00923d839ab None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:11.388022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535a0dc-3ed5-401d-844f-b00923d839ab None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:11.388257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535a0dc-3ed5-401d-844f-b00923d839ab None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:11.389001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535a0dc-3ed5-401d-844f-b00923d839ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:11.389319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535a0dc-3ed5-401d-844f-b00923d839ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:11.390756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535a0dc-3ed5-401d-844f-b00923d839ab None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:11.400117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 53/101] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:11.406762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347e096-d19d-48a5-b572-71795b4a615a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:11.423273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a8263-ae55-40a6-acfd-7dfb74d99c94 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:11.423582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a8263-ae55-40a6-acfd-7dfb74d99c94 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:11.423837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a8263-ae55-40a6-acfd-7dfb74d99c94 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:11.425760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 54/102] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:11.431194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c41c-45c4-4d8a-aff0-13167343296e None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:11.431487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c41c-45c4-4d8a-aff0-13167343296e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:11.431775 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471c41c-45c4-4d8a-aff0-13167343296e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:11.458362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-c471c41c-45c4-4d8a-aff0-13167343296e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:11.459769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c471c41c-45c4-4d8a-aff0-13167343296e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:11.470865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:11.538847 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:11.584252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 55/103] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:11.587238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727432c4-b9d8-4ac2-a49d-73487cb3d700 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:11.587531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727432c4-b9d8-4ac2-a49d-73487cb3d700 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:11.587814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727432c4-b9d8-4ac2-a49d-73487cb3d700 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:11.589330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 56/104] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:11.596303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904950fb-20b2-49a0-a7f7-792a87593413 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:11.596596 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904950fb-20b2-49a0-a7f7-792a87593413 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:11.596879 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904950fb-20b2-49a0-a7f7-792a87593413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:11.603251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347e096-d19d-48a5-b572-71795b4a615a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:11.631756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-904950fb-20b2-49a0-a7f7-792a87593413 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:11.633872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-904950fb-20b2-49a0-a7f7-792a87593413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:11.675590 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad3624-a1fc-4374-a24e-5e56cceb14d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:11.676217 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad3624-a1fc-4374-a24e-5e56cceb14d8 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:11.676511 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad3624-a1fc-4374-a24e-5e56cceb14d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:11.676792 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad3624-a1fc-4374-a24e-5e56cceb14d8 None admin] PATH_INFO: `/v3/users/d9d1524bdf514276aeb2826c6b3bb363` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:11.678825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad3624-a1fc-4374-a24e-5e56cceb14d8 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d1524bdf514276aeb2826c6b3bb363)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:11.680547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad3624-a1fc-4374-a24e-5e56cceb14d8 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:11.682479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 49/105] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:11 2022] GET /identity/v3/users/d9d1524bdf514276aeb2826c6b3bb363 => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:11.687032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad3624-a1fc-4374-a24e-5e56cceb14d8 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:11.763812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 57/106] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:11.764697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904950fb-20b2-49a0-a7f7-792a87593413 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:11.854151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad3624-a1fc-4374-a24e-5e56cceb14d8 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:11.888851 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:11.915547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904950fb-20b2-49a0-a7f7-792a87593413 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:11.916144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a75e96-13f7-4923-a83f-8c31f9aed802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:11.916789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a75e96-13f7-4923-a83f-8c31f9aed802 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:11.917366 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a75e96-13f7-4923-a83f-8c31f9aed802 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:11.917671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a75e96-13f7-4923-a83f-8c31f9aed802 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:11.922160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:11.932744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a75e96-13f7-4923-a83f-8c31f9aed802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-75a75e96-13f7-4923-a83f-8c31f9aed802 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:11.941165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:11.942214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:11.943064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 50/107] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:11.943700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a75e96-13f7-4923-a83f-8c31f9aed802 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:11.958587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b56159-6449-4d13-8661-742966b829f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:11.959562 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b56159-6449-4d13-8661-742966b829f9 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:11.960050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b56159-6449-4d13-8661-742966b829f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:11.960550 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b56159-6449-4d13-8661-742966b829f9 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:11.961925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b56159-6449-4d13-8661-742966b829f9 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:11.963623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b56159-6449-4d13-8661-742966b829f9 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:11.967319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 58/108] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:11 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:11.968845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0537a1-a840-4f69-b389-1e9d63175151 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:11.969378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0537a1-a840-4f69-b389-1e9d63175151 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:11.969854 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0537a1-a840-4f69-b389-1e9d63175151 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:11.971315 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 59/109] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:11.972295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0537a1-a840-4f69-b389-1e9d63175151 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:12.079424 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a75e96-13f7-4923-a83f-8c31f9aed802 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:12.088213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0537a1-a840-4f69-b389-1e9d63175151 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:12.116783 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa1251-2aae-4c34-8af9-dbcdb1c2f766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:12.117974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa1251-2aae-4c34-8af9-dbcdb1c2f766 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.118550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa1251-2aae-4c34-8af9-dbcdb1c2f766 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.119050 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa1251-2aae-4c34-8af9-dbcdb1c2f766 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.126515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd4e4e-df18-4b7e-96f8-fcc954c5f4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:12.127187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd4e4e-df18-4b7e-96f8-fcc954c5f4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.127477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd4e4e-df18-4b7e-96f8-fcc954c5f4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.127758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd4e4e-df18-4b7e-96f8-fcc954c5f4a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.128481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd4e4e-df18-4b7e-96f8-fcc954c5f4a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:12.128793 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd4e4e-df18-4b7e-96f8-fcc954c5f4a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:12.130190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd4e4e-df18-4b7e-96f8-fcc954c5f4a4 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:12.133399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa1251-2aae-4c34-8af9-dbcdb1c2f766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:12.139274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 60/110] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:18:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-b7aa1251-2aae-4c34-8af9-dbcdb1c2f766 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:12.140067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:12.140951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:12.141709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:12.141709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:12.141709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:12.141709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:12.141709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:12.141709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:12.141709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:12.141709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:12.141709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:12.141709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:12.141709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:12.141709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:12.142285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd4e4e-df18-4b7e-96f8-fcc954c5f4a4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:12.144123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 51/111] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:18:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:12.144374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:12.145760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed0f76-d971-49d2-a39d-d3eebfc6fac6 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.146084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed0f76-d971-49d2-a39d-d3eebfc6fac6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.146328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed0f76-d971-49d2-a39d-d3eebfc6fac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.164199 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-11ed0f76-d971-49d2-a39d-d3eebfc6fac6 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:12.165417 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-11ed0f76-d971-49d2-a39d-d3eebfc6fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:12.219231 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:12.236323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 52/112] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:12.237532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504d658-9aec-4d57-80cd-4f8b6f68d4d1 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.237829 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504d658-9aec-4d57-80cd-4f8b6f68d4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.238110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504d658-9aec-4d57-80cd-4f8b6f68d4d1 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.239519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 53/113] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:12.240075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504d658-9aec-4d57-80cd-4f8b6f68d4d1 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:12.242681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd4e4e-df18-4b7e-96f8-fcc954c5f4a4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:12.277988 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42075c44-9c8f-429e-9769-794fc0392fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:12.278970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42075c44-9c8f-429e-9769-794fc0392fd7 None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.279254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42075c44-9c8f-429e-9769-794fc0392fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.279536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42075c44-9c8f-429e-9769-794fc0392fd7 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e/users/d9d1524bdf514276aeb2826c6b3bb363/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.281488 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42075c44-9c8f-429e-9769-794fc0392fd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b312e6a347184d229a1a2c04149bbe2e, user_id=d9d1524bdf514276aeb2826c6b3bb363, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:12.282990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42075c44-9c8f-429e-9769-794fc0392fd7 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:12.338433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504d658-9aec-4d57-80cd-4f8b6f68d4d1 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:12.353574 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 61/114] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:18:12 2022] PUT /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e/users/d9d1524bdf514276aeb2826c6b3bb363/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:18:12.368054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691798-b9e0-42e9-a5a9-0daae0ddc4bf None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.368351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691798-b9e0-42e9-a5a9-0daae0ddc4bf None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.368640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691798-b9e0-42e9-a5a9-0daae0ddc4bf None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.370038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 62/115] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:12 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:12.374533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34070a4d-dfe7-4d7e-b084-da81d1261bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:12.375075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070a4d-dfe7-4d7e-b084-da81d1261bdd None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.375344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070a4d-dfe7-4d7e-b084-da81d1261bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.375608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070a4d-dfe7-4d7e-b084-da81d1261bdd None admin] PATH_INFO: `/v3/users/d9d1524bdf514276aeb2826c6b3bb363` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.376881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34070a4d-dfe7-4d7e-b084-da81d1261bdd None admin] RBAC: Authorizing `identity:get_user(user_id=d9d1524bdf514276aeb2826c6b3bb363)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:12.378410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34070a4d-dfe7-4d7e-b084-da81d1261bdd None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:12.384925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 54/116] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:12 2022] GET /identity/v3/users/d9d1524bdf514276aeb2826c6b3bb363 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:12.384925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa662b-f48a-4b96-9aa5-5aa21a2687d6 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.384925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa662b-f48a-4b96-9aa5-5aa21a2687d6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.385181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9691798-b9e0-42e9-a5a9-0daae0ddc4bf None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:12.385252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa662b-f48a-4b96-9aa5-5aa21a2687d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.400967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-3baa662b-f48a-4b96-9aa5-5aa21a2687d6 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:12.402217 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-3baa662b-f48a-4b96-9aa5-5aa21a2687d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:12.459600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:12.472757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:12.481944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 55/117] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:12.487758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa662b-f48a-4b96-9aa5-5aa21a2687d6 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:12.518059 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9691798-b9e0-42e9-a5a9-0daae0ddc4bf None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:12.559129 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04101530-e57a-49ab-b689-7e22cb5366a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:12.559872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101530-e57a-49ab-b689-7e22cb5366a6 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.560197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101530-e57a-49ab-b689-7e22cb5366a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.560511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04101530-e57a-49ab-b689-7e22cb5366a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.561204 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04101530-e57a-49ab-b689-7e22cb5366a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:12.561514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04101530-e57a-49ab-b689-7e22cb5366a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:12.562986 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04101530-e57a-49ab-b689-7e22cb5366a6 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:12.571634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 63/118] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:12.572839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05715bc7-f8b6-4323-be00-86f314bfafcb None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.573130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05715bc7-f8b6-4323-be00-86f314bfafcb None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.573412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05715bc7-f8b6-4323-be00-86f314bfafcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.592910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-05715bc7-f8b6-4323-be00-86f314bfafcb None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:12.594106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-05715bc7-f8b6-4323-be00-86f314bfafcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:12.607219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa662b-f48a-4b96-9aa5-5aa21a2687d6 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:12.646137 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f91e-b4cc-4a0b-9ac7-3f29f47ea8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:12.647477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f91e-b4cc-4a0b-9ac7-3f29f47ea8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.647948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f91e-b4cc-4a0b-9ac7-3f29f47ea8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.648424 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f91e-b4cc-4a0b-9ac7-3f29f47ea8f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.661273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9f91e-b4cc-4a0b-9ac7-3f29f47ea8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:12.666065 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 64/119] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:12.666945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05715bc7-f8b6-4323-be00-86f314bfafcb None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-5dc9f91e-b4cc-4a0b-9ac7-3f29f47ea8f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:12.670828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:12.671710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 56/120] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:12.672907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f91e-b4cc-4a0b-9ac7-3f29f47ea8f2 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:12.729715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:12.734670 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:12.774774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05715bc7-f8b6-4323-be00-86f314bfafcb None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:12.803054 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f91e-b4cc-4a0b-9ac7-3f29f47ea8f2 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:12.811377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea48b7a-ed86-4c1c-ae0c-3e37ea9c2eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:12.812106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea48b7a-ed86-4c1c-ae0c-3e37ea9c2eeb None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.812515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea48b7a-ed86-4c1c-ae0c-3e37ea9c2eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.812746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea48b7a-ed86-4c1c-ae0c-3e37ea9c2eeb None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.815135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea48b7a-ed86-4c1c-ae0c-3e37ea9c2eeb None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:12.816598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea48b7a-ed86-4c1c-ae0c-3e37ea9c2eeb None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:12.823821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 65/121] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:12 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:12.825344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea48b7a-ed86-4c1c-ae0c-3e37ea9c2eeb None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:12.842850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e8062-aab1-48fd-8afb-36dab4b040c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:12.843506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e8062-aab1-48fd-8afb-36dab4b040c9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.843793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e8062-aab1-48fd-8afb-36dab4b040c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.844073 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e8062-aab1-48fd-8afb-36dab4b040c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.854939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e8062-aab1-48fd-8afb-36dab4b040c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-495e8062-aab1-48fd-8afb-36dab4b040c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:12.860147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:12.861039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 57/122] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:12.862249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e8062-aab1-48fd-8afb-36dab4b040c9 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:12.946184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea48b7a-ed86-4c1c-ae0c-3e37ea9c2eeb None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:12.970569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e8062-aab1-48fd-8afb-36dab4b040c9 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:12.971890 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:12.973402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:12.985528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14700e-7b8c-4db0-8b52-8dd70212ccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:12.985528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14700e-7b8c-4db0-8b52-8dd70212ccd2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:12.985528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14700e-7b8c-4db0-8b52-8dd70212ccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:12.985528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14700e-7b8c-4db0-8b52-8dd70212ccd2 None admin] PATH_INFO: `/v3/users/41158534548d42db82795c2a83978403` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:12.985870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14700e-7b8c-4db0-8b52-8dd70212ccd2 None admin] RBAC: Authorizing `identity:get_user(user_id=41158534548d42db82795c2a83978403)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:12.986430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14700e-7b8c-4db0-8b52-8dd70212ccd2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:12.992502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 66/123] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:12 2022] GET /identity/v3/users/41158534548d42db82795c2a83978403 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:12.992502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14700e-7b8c-4db0-8b52-8dd70212ccd2 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:13.011454 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4779e4-bd1b-4dd9-a326-836eab018539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:13.013668 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4779e4-bd1b-4dd9-a326-836eab018539 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:13.013971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4779e4-bd1b-4dd9-a326-836eab018539 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:13.014258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4779e4-bd1b-4dd9-a326-836eab018539 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:13.015062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4779e4-bd1b-4dd9-a326-836eab018539 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:13.015378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4779e4-bd1b-4dd9-a326-836eab018539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:13.016805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4779e4-bd1b-4dd9-a326-836eab018539 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:13.025296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 58/124] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:13.026092 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4779e4-bd1b-4dd9-a326-836eab018539 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:13.103772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14700e-7b8c-4db0-8b52-8dd70212ccd2 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:13.135357 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4779e4-bd1b-4dd9-a326-836eab018539 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:13.138280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7ca7e-3191-4687-b73e-196822539b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:13.138961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7ca7e-3191-4687-b73e-196822539b91 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:13.139253 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7ca7e-3191-4687-b73e-196822539b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:13.139535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7ca7e-3191-4687-b73e-196822539b91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:13.140702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7ca7e-3191-4687-b73e-196822539b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:13.142160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7ca7e-3191-4687-b73e-196822539b91 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:13.143809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 67/125] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:13.144659 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7ca7e-3191-4687-b73e-196822539b91 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:13.178572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e595344-acce-4362-b559-d2d08b70cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:13.179362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e595344-acce-4362-b559-d2d08b70cdef None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:13.179647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e595344-acce-4362-b559-d2d08b70cdef None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:13.180645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e595344-acce-4362-b559-d2d08b70cdef None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e/users/d9d1524bdf514276aeb2826c6b3bb363/roles/d2d09ac7138145968d31dde4d5b9ee5a` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:13.182282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e595344-acce-4362-b559-d2d08b70cdef None admin] RBAC: Authorizing `identity:create_grant(project_id=b312e6a347184d229a1a2c04149bbe2e, user_id=d9d1524bdf514276aeb2826c6b3bb363, role_id=d2d09ac7138145968d31dde4d5b9ee5a)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:13.184308 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e595344-acce-4362-b559-d2d08b70cdef None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:13.204956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:13.244790 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7ca7e-3191-4687-b73e-196822539b91 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:13.277037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b012-6898-47cd-b297-7a3a9ee5472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:13.278251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b012-6898-47cd-b297-7a3a9ee5472f None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:13.278563 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b012-6898-47cd-b297-7a3a9ee5472f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:13.278844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b012-6898-47cd-b297-7a3a9ee5472f None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:13.279553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5b012-6898-47cd-b297-7a3a9ee5472f None admin] RBAC: Adding query filter params (name=member) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:13.279866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5b012-6898-47cd-b297-7a3a9ee5472f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:13.281248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5b012-6898-47cd-b297-7a3a9ee5472f None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:13.291125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 59/126] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:18:13 2022] PUT /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e/users/d9d1524bdf514276aeb2826c6b3bb363/roles/d2d09ac7138145968d31dde4d5b9ee5a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:18:13.292024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e595344-acce-4362-b559-d2d08b70cdef None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:13.297953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 68/127] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:13.297953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b012-6898-47cd-b297-7a3a9ee5472f None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:13.332643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:13.428587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e595344-acce-4362-b559-d2d08b70cdef None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:13.444207 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b012-6898-47cd-b297-7a3a9ee5472f None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:13.472164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250088c9-8a30-436a-9d13-d2c37ad94239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:13.472826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250088c9-8a30-436a-9d13-d2c37ad94239 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:13.473115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250088c9-8a30-436a-9d13-d2c37ad94239 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:13.473398 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250088c9-8a30-436a-9d13-d2c37ad94239 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:13.475903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250088c9-8a30-436a-9d13-d2c37ad94239 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:13.477378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250088c9-8a30-436a-9d13-d2c37ad94239 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:13.478074 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:13.479595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 60/128] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:13 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:13.479911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250088c9-8a30-436a-9d13-d2c37ad94239 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:13.495402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582aa60-97c3-428a-bbc8-3ff58594f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:13.495895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582aa60-97c3-428a-bbc8-3ff58594f176 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:13.496268 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582aa60-97c3-428a-bbc8-3ff58594f176 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:13.496566 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582aa60-97c3-428a-bbc8-3ff58594f176 None admin] PATH_INFO: `/v3/users/4e957bbfd5e14c7fb0a5521600a203d0` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:13.517077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582aa60-97c3-428a-bbc8-3ff58594f176 None admin] RBAC: Authorizing `identity:get_user(user_id=4e957bbfd5e14c7fb0a5521600a203d0)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:13.519126 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582aa60-97c3-428a-bbc8-3ff58594f176 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:13.521782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 69/129] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:13 2022] GET /identity/v3/users/4e957bbfd5e14c7fb0a5521600a203d0 => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:13.522626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582aa60-97c3-428a-bbc8-3ff58594f176 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:13.594820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:13.602642 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250088c9-8a30-436a-9d13-d2c37ad94239 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:13.638989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608e3f-e547-4678-aa6f-1622c412885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:13.639618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608e3f-e547-4678-aa6f-1622c412885d None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:13.639907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608e3f-e547-4678-aa6f-1622c412885d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:13.640188 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608e3f-e547-4678-aa6f-1622c412885d None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:13.640883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608e3f-e547-4678-aa6f-1622c412885d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:13.642474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608e3f-e547-4678-aa6f-1622c412885d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:13.652205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582aa60-97c3-428a-bbc8-3ff58594f176 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:13.689600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5bc9d-5113-479f-ab63-9c3bc0d802d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:13.690257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5bc9d-5113-479f-ab63-9c3bc0d802d5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:13.690576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5bc9d-5113-479f-ab63-9c3bc0d802d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:13.690861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5bc9d-5113-479f-ab63-9c3bc0d802d5 None admin] PATH_INFO: `/v3/users/d9d1524bdf514276aeb2826c6b3bb363` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:13.692042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5bc9d-5113-479f-ab63-9c3bc0d802d5 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d1524bdf514276aeb2826c6b3bb363)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:13.693551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5bc9d-5113-479f-ab63-9c3bc0d802d5 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:13.695337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 70/130] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:13 2022] GET /identity/v3/users/d9d1524bdf514276aeb2826c6b3bb363 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:13.700462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5bc9d-5113-479f-ab63-9c3bc0d802d5 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:13.728385 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 61/131] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:18:13 2022] POST /identity/v3/projects => generated 302 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:18:13.729565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608e3f-e547-4678-aa6f-1622c412885d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:13.795739 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:13.914343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5bc9d-5113-479f-ab63-9c3bc0d802d5 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:13.939586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608e3f-e547-4678-aa6f-1622c412885d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:13.954751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc853e8-cd81-41dd-8678-b0e51329f375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:13.956069 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc853e8-cd81-41dd-8678-b0e51329f375 None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:13.956551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc853e8-cd81-41dd-8678-b0e51329f375 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:13.957144 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc853e8-cd81-41dd-8678-b0e51329f375 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e/users/41158534548d42db82795c2a83978403/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:13.959532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc853e8-cd81-41dd-8678-b0e51329f375 None admin] RBAC: Authorizing `identity:create_grant(project_id=b312e6a347184d229a1a2c04149bbe2e, user_id=41158534548d42db82795c2a83978403, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:13.961349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc853e8-cd81-41dd-8678-b0e51329f375 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:13.981095 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c8d2-f4ee-4e15-b5c3-a18436a597e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:13.981935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c8d2-f4ee-4e15-b5c3-a18436a597e2 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:13.982226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c8d2-f4ee-4e15-b5c3-a18436a597e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:13.982542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c8d2-f4ee-4e15-b5c3-a18436a597e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:13.999741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:14.021848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 71/132] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:18:13 2022] PUT /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e/users/41158534548d42db82795c2a83978403/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:18:14.029050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc853e8-cd81-41dd-8678-b0e51329f375 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:14.092559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853c8d2-f4ee-4e15-b5c3-a18436a597e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:14.094113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853c8d2-f4ee-4e15-b5c3-a18436a597e2 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:14.254925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc853e8-cd81-41dd-8678-b0e51329f375 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:14.267431 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:14.298219 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4f148-aee5-4ca7-a1cd-78532f5f54b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:14.299213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4f148-aee5-4ca7-a1cd-78532f5f54b0 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:14.299688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4f148-aee5-4ca7-a1cd-78532f5f54b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:14.300140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4f148-aee5-4ca7-a1cd-78532f5f54b0 None admin] PATH_INFO: `/v3/projects/cdf1fe3dc88a498fbc578833c517f266` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:14.301483 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4f148-aee5-4ca7-a1cd-78532f5f54b0 None admin] RBAC: Authorizing `identity:get_project(project_id=cdf1fe3dc88a498fbc578833c517f266)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:14.303159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4f148-aee5-4ca7-a1cd-78532f5f54b0 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:14.305827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 72/133] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:14 2022] GET /identity/v3/projects/cdf1fe3dc88a498fbc578833c517f266 => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:14.315319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4f148-aee5-4ca7-a1cd-78532f5f54b0 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:14.320553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 62/134] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:14.348252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c8d2-f4ee-4e15-b5c3-a18436a597e2 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:14.440399 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4f148-aee5-4ca7-a1cd-78532f5f54b0 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:14.456039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:14.481616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74ecf9-eb46-4a4e-ac3d-2765bfc843e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:14.482797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74ecf9-eb46-4a4e-ac3d-2765bfc843e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:14.483254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74ecf9-eb46-4a4e-ac3d-2765bfc843e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:14.483696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74ecf9-eb46-4a4e-ac3d-2765bfc843e8 None admin] PATH_INFO: `/v3/projects/cdf1fe3dc88a498fbc578833c517f266/users/d9d1524bdf514276aeb2826c6b3bb363/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:14.486026 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74ecf9-eb46-4a4e-ac3d-2765bfc843e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=cdf1fe3dc88a498fbc578833c517f266, user_id=d9d1524bdf514276aeb2826c6b3bb363, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:14.487716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74ecf9-eb46-4a4e-ac3d-2765bfc843e8 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:14.529699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c8d2-f4ee-4e15-b5c3-a18436a597e2 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:14.567187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf888b7a-a5dd-4726-a321-078829f434a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:14.568028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf888b7a-a5dd-4726-a321-078829f434a2 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:14.568303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf888b7a-a5dd-4726-a321-078829f434a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:14.568634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf888b7a-a5dd-4726-a321-078829f434a2 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:14.570133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf888b7a-a5dd-4726-a321-078829f434a2 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:14.572027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf888b7a-a5dd-4726-a321-078829f434a2 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:14.574026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 63/135] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:14 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:14.576615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763224f5-cc6a-4fa9-8693-ab3853a4ca33 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:14.576615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763224f5-cc6a-4fa9-8693-ab3853a4ca33 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:14.576615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763224f5-cc6a-4fa9-8693-ab3853a4ca33 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:14.580549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 73/136] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:18:14 2022] PUT /identity/v3/projects/cdf1fe3dc88a498fbc578833c517f266/users/d9d1524bdf514276aeb2826c6b3bb363/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:18:14.580627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 64/137] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:14.583075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74ecf9-eb46-4a4e-ac3d-2765bfc843e8 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:14.583646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f052f5-a63b-44b4-a756-267306cf2784 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:14.584895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f052f5-a63b-44b4-a756-267306cf2784 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:14.584895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f052f5-a63b-44b4-a756-267306cf2784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:14.608769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-20f052f5-a63b-44b4-a756-267306cf2784 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:14.609954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-20f052f5-a63b-44b4-a756-267306cf2784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:14.690608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:14.696824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 65/138] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:14.723094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f052f5-a63b-44b4-a756-267306cf2784 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:14.781311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:14.847183 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f052f5-a63b-44b4-a756-267306cf2784 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:14.884541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74ecf9-eb46-4a4e-ac3d-2765bfc843e8 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:14.888410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb2322-d638-4a85-ad22-e7e99b75d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:14.889076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb2322-d638-4a85-ad22-e7e99b75d7eb None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:14.889358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb2322-d638-4a85-ad22-e7e99b75d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:14.889637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb2322-d638-4a85-ad22-e7e99b75d7eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:14.901443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb2322-d638-4a85-ad22-e7e99b75d7eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-9ecb2322-d638-4a85-ad22-e7e99b75d7eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:14.906828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:14.907679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:14.908436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 66/139] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:18:14.915928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb2322-d638-4a85-ad22-e7e99b75d7eb None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:14.929968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e4a8a-3366-4a31-bc57-94301a17d3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:14.930628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e4a8a-3366-4a31-bc57-94301a17d3ba None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:14.930914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e4a8a-3366-4a31-bc57-94301a17d3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:14.931192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e4a8a-3366-4a31-bc57-94301a17d3ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:14.931994 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e4a8a-3366-4a31-bc57-94301a17d3ba None admin] RBAC: Adding query filter params (role.id=da2284a36aac460aa87d838a8734cab3, scope.project.id=b312e6a347184d229a1a2c04149bbe2e, user.id=4e957bbfd5e14c7fb0a5521600a203d0) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:14.932311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e4a8a-3366-4a31-bc57-94301a17d3ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:14.934433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e4a8a-3366-4a31-bc57-94301a17d3ba None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:14.941543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 74/140] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:14 2022] GET /identity/v3/role_assignments?user.id=4e957bbfd5e14c7fb0a5521600a203d0&scope.project.id=b312e6a347184d229a1a2c04149bbe2e&role.id=da2284a36aac460aa87d838a8734cab3 => generated 259 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:15.036697 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb2322-d638-4a85-ad22-e7e99b75d7eb None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:15.039440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:15.076624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08533d82-69e7-4892-a38c-16333789b0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:15.077281 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08533d82-69e7-4892-a38c-16333789b0fc None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:15.077569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08533d82-69e7-4892-a38c-16333789b0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:15.077908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08533d82-69e7-4892-a38c-16333789b0fc None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:15.078682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08533d82-69e7-4892-a38c-16333789b0fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:15.078998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08533d82-69e7-4892-a38c-16333789b0fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:15.080443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08533d82-69e7-4892-a38c-16333789b0fc None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:15.091196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 67/141] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:15.096944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e4a8a-3366-4a31-bc57-94301a17d3ba None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:15.200376 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:15.210792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e4a8a-3366-4a31-bc57-94301a17d3ba None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:15.254678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adff169-d78f-49cd-b673-86252355f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:15.255334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adff169-d78f-49cd-b673-86252355f02c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:15.255622 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adff169-d78f-49cd-b673-86252355f02c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:15.255902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adff169-d78f-49cd-b673-86252355f02c None admin] PATH_INFO: `/v3/users/d9d1524bdf514276aeb2826c6b3bb363` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:15.257159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adff169-d78f-49cd-b673-86252355f02c None admin] RBAC: Authorizing `identity:get_user(user_id=d9d1524bdf514276aeb2826c6b3bb363)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:15.258761 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adff169-d78f-49cd-b673-86252355f02c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:15.260619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 75/142] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:15 2022] GET /identity/v3/users/d9d1524bdf514276aeb2826c6b3bb363 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:15.266521 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08533d82-69e7-4892-a38c-16333789b0fc None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:15.380313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08533d82-69e7-4892-a38c-16333789b0fc None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:15.415519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0dc93d-c1ef-434c-ae5b-636d7628e52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:15.416555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dc93d-c1ef-434c-ae5b-636d7628e52d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:15.417033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dc93d-c1ef-434c-ae5b-636d7628e52d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:15.417511 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dc93d-c1ef-434c-ae5b-636d7628e52d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:15.465093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:15.490085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0dc93d-c1ef-434c-ae5b-636d7628e52d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:15.491615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0dc93d-c1ef-434c-ae5b-636d7628e52d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:15.594962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 68/143] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:15.600525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adff169-d78f-49cd-b673-86252355f02c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:15.729981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adff169-d78f-49cd-b673-86252355f02c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:15.769990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23079c-b62b-4183-86f4-f6f09acce284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:15.770677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23079c-b62b-4183-86f4-f6f09acce284 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:15.770967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23079c-b62b-4183-86f4-f6f09acce284 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:15.771247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23079c-b62b-4183-86f4-f6f09acce284 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:15.772465 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23079c-b62b-4183-86f4-f6f09acce284 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:15.773913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23079c-b62b-4183-86f4-f6f09acce284 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:15.775647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 76/144] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:15 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:15.782013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0dc93d-c1ef-434c-ae5b-636d7628e52d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:15.866936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:15.913212 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0dc93d-c1ef-434c-ae5b-636d7628e52d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:15.957979 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e9906-6d03-4137-99cd-537cda714dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:15.959056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e9906-6d03-4137-99cd-537cda714dfc None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:15.959587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e9906-6d03-4137-99cd-537cda714dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:15.960067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e9906-6d03-4137-99cd-537cda714dfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:15.961069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e9906-6d03-4137-99cd-537cda714dfc None admin] RBAC: Adding query filter params (role.id=b83f9277d44246c5983fe3b6d7d5af96, scope.project.id=b312e6a347184d229a1a2c04149bbe2e, user.id=d9d1524bdf514276aeb2826c6b3bb363) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:15.961582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e9906-6d03-4137-99cd-537cda714dfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:15.963245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e9906-6d03-4137-99cd-537cda714dfc None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:15.975174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 69/145] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:15 2022] GET /identity/v3/role_assignments?user.id=d9d1524bdf514276aeb2826c6b3bb363&scope.project.id=b312e6a347184d229a1a2c04149bbe2e&role.id=b83f9277d44246c5983fe3b6d7d5af96 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:16.114407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198aabc-5b92-415b-a1cd-d44e7b0e3461 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:16.114956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198aabc-5b92-415b-a1cd-d44e7b0e3461 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:16.115036 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198aabc-5b92-415b-a1cd-d44e7b0e3461 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:16.116685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 77/146] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:16.122932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926112e2-da8b-441b-b959-6bd0bc9a6be6 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:16.123814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926112e2-da8b-441b-b959-6bd0bc9a6be6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:16.124297 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926112e2-da8b-441b-b959-6bd0bc9a6be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:16.155559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-926112e2-da8b-441b-b959-6bd0bc9a6be6 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:16.157144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-926112e2-da8b-441b-b959-6bd0bc9a6be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:16.248176 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 70/147] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:16.283114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198aabc-5b92-415b-a1cd-d44e7b0e3461 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:16.331515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:16.412954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198aabc-5b92-415b-a1cd-d44e7b0e3461 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:16.460429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba65195-e052-4f69-a0e2-9e2b84d300c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:16.461452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba65195-e052-4f69-a0e2-9e2b84d300c9 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:16.461937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba65195-e052-4f69-a0e2-9e2b84d300c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:16.462412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba65195-e052-4f69-a0e2-9e2b84d300c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:16.478309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba65195-e052-4f69-a0e2-9e2b84d300c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-4ba65195-e052-4f69-a0e2-9e2b84d300c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:16.483704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:16.484591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:16.485392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:16.485392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:16.485392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:16.485392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:16.485392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:16.485392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:16.485392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:16.485392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:16.485392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:16.485392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:16.485392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:16.485392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:16.487691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 78/148] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:16.493852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926112e2-da8b-441b-b959-6bd0bc9a6be6 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:16.562873 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:16.605557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926112e2-da8b-441b-b959-6bd0bc9a6be6 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:16.649818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1c7c9-e550-45c1-8599-6f8dc1238ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:16.650449 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1c7c9-e550-45c1-8599-6f8dc1238ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:16.650756 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1c7c9-e550-45c1-8599-6f8dc1238ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:16.651033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1c7c9-e550-45c1-8599-6f8dc1238ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:16.651760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1c7c9-e550-45c1-8599-6f8dc1238ad6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:16.652101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1c7c9-e550-45c1-8599-6f8dc1238ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:16.654064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1c7c9-e550-45c1-8599-6f8dc1238ad6 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:16.662647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 71/149] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:18:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:16.668417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba65195-e052-4f69-a0e2-9e2b84d300c9 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:16.785192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:16.795049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba65195-e052-4f69-a0e2-9e2b84d300c9 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:16.837316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b44bf-d318-49b0-81a5-6b9fcf1081b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:16.837966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b44bf-d318-49b0-81a5-6b9fcf1081b2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:16.838249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b44bf-d318-49b0-81a5-6b9fcf1081b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:16.838558 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b44bf-d318-49b0-81a5-6b9fcf1081b2 None admin] PATH_INFO: `/v3/users/d9d1524bdf514276aeb2826c6b3bb363` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:16.843190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b44bf-d318-49b0-81a5-6b9fcf1081b2 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d1524bdf514276aeb2826c6b3bb363)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:16.844670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b44bf-d318-49b0-81a5-6b9fcf1081b2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:16.846471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 79/150] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:16 2022] GET /identity/v3/users/d9d1524bdf514276aeb2826c6b3bb363 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:16.851879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1c7c9-e550-45c1-8599-6f8dc1238ad6 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:16.971148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1c7c9-e550-45c1-8599-6f8dc1238ad6 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:17.005485 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:17.022035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648bada-789a-4433-b6e9-98694c2533c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:17.022719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648bada-789a-4433-b6e9-98694c2533c6 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.023008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648bada-789a-4433-b6e9-98694c2533c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.023291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648bada-789a-4433-b6e9-98694c2533c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.091711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf69ed-52cf-477d-9573-0b72d8b4c351 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.092057 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf69ed-52cf-477d-9573-0b72d8b4c351 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.092268 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf69ed-52cf-477d-9573-0b72d8b4c351 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.093620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 80/151] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:17.106145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c4f81-f962-4734-a1c1-2b07cd59b5be None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.106435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c4f81-f962-4734-a1c1-2b07cd59b5be None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.106749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c4f81-f962-4734-a1c1-2b07cd59b5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.132034 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f65c4f81-f962-4734-a1c1-2b07cd59b5be None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:17.133218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f65c4f81-f962-4734-a1c1-2b07cd59b5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:17.146513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648bada-789a-4433-b6e9-98694c2533c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:17.148570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648bada-789a-4433-b6e9-98694c2533c6 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:17.253046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 72/152] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:17.257211 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 81/153] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:17.263506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648bada-789a-4433-b6e9-98694c2533c6 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:17.286652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c4f81-f962-4734-a1c1-2b07cd59b5be None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:17.302347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:17.397460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648bada-789a-4433-b6e9-98694c2533c6 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:17.430687 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:17.435759 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04436f-88d2-475b-824e-a97b40583539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:17.436696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04436f-88d2-475b-824e-a97b40583539 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.436998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04436f-88d2-475b-824e-a97b40583539 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.437335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04436f-88d2-475b-824e-a97b40583539 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.438892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04436f-88d2-475b-824e-a97b40583539 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:17.449847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c4f81-f962-4734-a1c1-2b07cd59b5be None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:17.449998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04436f-88d2-475b-824e-a97b40583539 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:17.449998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 73/154] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:17 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:17.449998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73850a6b-b0c5-4396-aaea-5ccef26e9c0e None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.449998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73850a6b-b0c5-4396-aaea-5ccef26e9c0e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.449998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73850a6b-b0c5-4396-aaea-5ccef26e9c0e None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.449998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 74/155] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:17.450854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73850a6b-b0c5-4396-aaea-5ccef26e9c0e None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:17.482176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d64c4f-01e9-4ef8-8649-cf9190a32ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:17.483127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d64c4f-01e9-4ef8-8649-cf9190a32ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.483417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d64c4f-01e9-4ef8-8649-cf9190a32ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.483781 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d64c4f-01e9-4ef8-8649-cf9190a32ef9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.484850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d64c4f-01e9-4ef8-8649-cf9190a32ef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:17.486329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d64c4f-01e9-4ef8-8649-cf9190a32ef9 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:17.487970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 82/156] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:17.489246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd41bd-5397-4c8a-a8fc-6fb96ca45a53 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.489541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd41bd-5397-4c8a-a8fc-6fb96ca45a53 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.489814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd41bd-5397-4c8a-a8fc-6fb96ca45a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.508831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-dafd41bd-5397-4c8a-a8fc-6fb96ca45a53 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:17.509955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-dafd41bd-5397-4c8a-a8fc-6fb96ca45a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:17.564426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:17.576184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73850a6b-b0c5-4396-aaea-5ccef26e9c0e None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:17.584198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 83/157] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:17.585252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d034-d71b-4c4a-a46b-31a8bd713aa9 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.585542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d034-d71b-4c4a-a46b-31a8bd713aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.585817 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d034-d71b-4c4a-a46b-31a8bd713aa9 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.587140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 84/158] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:17.587791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d034-d71b-4c4a-a46b-31a8bd713aa9 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:17.618704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c6cf5-13a4-407c-8868-be55454e27f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:17.619331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c6cf5-13a4-407c-8868-be55454e27f6 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.619613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c6cf5-13a4-407c-8868-be55454e27f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.619885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c6cf5-13a4-407c-8868-be55454e27f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.620681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c6cf5-13a4-407c-8868-be55454e27f6 None admin] RBAC: Adding query filter params (role.id=d2d09ac7138145968d31dde4d5b9ee5a, scope.project.id=b312e6a347184d229a1a2c04149bbe2e, user.id=d9d1524bdf514276aeb2826c6b3bb363) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:17.621628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c6cf5-13a4-407c-8868-be55454e27f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:17.623128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c6cf5-13a4-407c-8868-be55454e27f6 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:17.629310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 75/159] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:17 2022] GET /identity/v3/role_assignments?user.id=d9d1524bdf514276aeb2826c6b3bb363&scope.project.id=b312e6a347184d229a1a2c04149bbe2e&role.id=d2d09ac7138145968d31dde4d5b9ee5a => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:17.637109 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776770e-d776-4604-aaf1-aa9033b35a78 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.637848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776770e-d776-4604-aaf1-aa9033b35a78 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.638399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776770e-d776-4604-aaf1-aa9033b35a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.664585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e776770e-d776-4604-aaf1-aa9033b35a78 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:17.666460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e776770e-d776-4604-aaf1-aa9033b35a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:17.718208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:17.732561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d034-d71b-4c4a-a46b-31a8bd713aa9 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:17.754788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 76/160] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:17.755763 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776770e-d776-4604-aaf1-aa9033b35a78 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:17.783313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c938de-add5-43bb-a2f2-cefbc215acba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:17.784480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c938de-add5-43bb-a2f2-cefbc215acba None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.785382 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c938de-add5-43bb-a2f2-cefbc215acba None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.786133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c938de-add5-43bb-a2f2-cefbc215acba None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.787084 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c938de-add5-43bb-a2f2-cefbc215acba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:17.789772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c938de-add5-43bb-a2f2-cefbc215acba None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:17.857346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:17.874914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776770e-d776-4604-aaf1-aa9033b35a78 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:17.897506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 85/161] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:18:17 2022] POST /identity/v3/users => generated 283 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:18:17.899239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c938de-add5-43bb-a2f2-cefbc215acba None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:17.916341 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0fe75-cce7-431c-a894-f8d608e08051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:17.917422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0fe75-cce7-431c-a894-f8d608e08051 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.918324 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0fe75-cce7-431c-a894-f8d608e08051 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.918739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0fe75-cce7-431c-a894-f8d608e08051 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.931757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0fe75-cce7-431c-a894-f8d608e08051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-b1b0fe75-cce7-431c-a894-f8d608e08051 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:17.937876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:17.939211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:17.940044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 77/162] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:18:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:17.942936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870292-f06f-4736-a14b-b0a5e94bbb37 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:17.943341 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870292-f06f-4736-a14b-b0a5e94bbb37 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:17.943632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870292-f06f-4736-a14b-b0a5e94bbb37 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:17.945132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 78/163] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:18:17.946329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c870292-f06f-4736-a14b-b0a5e94bbb37 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:18.030264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c938de-add5-43bb-a2f2-cefbc215acba None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:18.075269 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c870292-f06f-4736-a14b-b0a5e94bbb37 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:18.077141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b458c-16e6-4c2f-8444-2eeeafa6689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:18.077798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b458c-16e6-4c2f-8444-2eeeafa6689f None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:18.078087 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b458c-16e6-4c2f-8444-2eeeafa6689f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:18.078363 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b458c-16e6-4c2f-8444-2eeeafa6689f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:18.089680 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b458c-16e6-4c2f-8444-2eeeafa6689f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-c62b458c-16e6-4c2f-8444-2eeeafa6689f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:18.095196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:18.096054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:18.096856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 86/164] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:18.097517 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d4607-427e-4d9d-b922-8c951edbf9b3 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:18.098463 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d4607-427e-4d9d-b922-8c951edbf9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:18.098463 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d4607-427e-4d9d-b922-8c951edbf9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:18.114273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ebb60-4ad7-49d3-8397-6bf3d6787e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:18.114922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ebb60-4ad7-49d3-8397-6bf3d6787e41 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:18.115203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ebb60-4ad7-49d3-8397-6bf3d6787e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:18.115518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ebb60-4ad7-49d3-8397-6bf3d6787e41 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:18.116214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ebb60-4ad7-49d3-8397-6bf3d6787e41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:18.116501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ebb60-4ad7-49d3-8397-6bf3d6787e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:18.117874 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ebb60-4ad7-49d3-8397-6bf3d6787e41 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:18.119914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b85d4607-427e-4d9d-b922-8c951edbf9b3 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:18.121718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b85d4607-427e-4d9d-b922-8c951edbf9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:18.124010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:18.128931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 79/165] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:18.129620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ebb60-4ad7-49d3-8397-6bf3d6787e41 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:18.139528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:18.209963 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 87/166] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:18.212135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d4607-427e-4d9d-b922-8c951edbf9b3 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:18.258337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ebb60-4ad7-49d3-8397-6bf3d6787e41 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:18.303992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649ff71-9546-4a19-9f5a-862d5c99b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:18.304550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649ff71-9546-4a19-9f5a-862d5c99b31e None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:18.304844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649ff71-9546-4a19-9f5a-862d5c99b31e None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:18.305115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649ff71-9546-4a19-9f5a-862d5c99b31e None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:18.305850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649ff71-9546-4a19-9f5a-862d5c99b31e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:18.306160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649ff71-9546-4a19-9f5a-862d5c99b31e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:18.307636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649ff71-9546-4a19-9f5a-862d5c99b31e None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:18.317447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 80/167] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:18.322577 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649ff71-9546-4a19-9f5a-862d5c99b31e None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:18.345287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d4607-427e-4d9d-b922-8c951edbf9b3 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:18.399407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc12f31-018a-447d-b182-4d88903120bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:18.400066 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc12f31-018a-447d-b182-4d88903120bd None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:18.400348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc12f31-018a-447d-b182-4d88903120bd None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:18.400623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc12f31-018a-447d-b182-4d88903120bd None admin] PATH_INFO: `/v3/users/41158534548d42db82795c2a83978403` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:18.401829 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc12f31-018a-447d-b182-4d88903120bd None admin] RBAC: Authorizing `identity:get_user(user_id=41158534548d42db82795c2a83978403)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:18.403383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc12f31-018a-447d-b182-4d88903120bd None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:18.405095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 88/168] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:18 2022] GET /identity/v3/users/41158534548d42db82795c2a83978403 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:18.405869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc12f31-018a-447d-b182-4d88903120bd None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:18.414340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:18.424576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:18.468104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649ff71-9546-4a19-9f5a-862d5c99b31e None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:18.516930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b3cb2-f5d3-4924-9ddb-f5ab29e683b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:18.517586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b3cb2-f5d3-4924-9ddb-f5ab29e683b8 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:18.518111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b3cb2-f5d3-4924-9ddb-f5ab29e683b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:18.518393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b3cb2-f5d3-4924-9ddb-f5ab29e683b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:18.535523 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b3cb2-f5d3-4924-9ddb-f5ab29e683b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-9f6b3cb2-f5d3-4924-9ddb-f5ab29e683b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:18.541036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:18.541912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:18.542939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 81/169] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:18.543762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b3cb2-f5d3-4924-9ddb-f5ab29e683b8 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:18.546882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc12f31-018a-447d-b182-4d88903120bd None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:18.616604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb03dfc-5ef1-458a-a7a9-994bab72c801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:18.617265 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb03dfc-5ef1-458a-a7a9-994bab72c801 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:18.617552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb03dfc-5ef1-458a-a7a9-994bab72c801 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:18.617832 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb03dfc-5ef1-458a-a7a9-994bab72c801 None admin] PATH_INFO: `/v3/users/4e957bbfd5e14c7fb0a5521600a203d0` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:18.624184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb03dfc-5ef1-458a-a7a9-994bab72c801 None admin] RBAC: Authorizing `identity:get_user(user_id=4e957bbfd5e14c7fb0a5521600a203d0)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:18.625684 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb03dfc-5ef1-458a-a7a9-994bab72c801 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:18.627582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 89/170] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:18 2022] GET /identity/v3/users/4e957bbfd5e14c7fb0a5521600a203d0 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:18.631964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb03dfc-5ef1-458a-a7a9-994bab72c801 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:18.718069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b3cb2-f5d3-4924-9ddb-f5ab29e683b8 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:18.745447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:18.753950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c6df5-8a65-479a-a5b9-3a7ef7b37f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:18.756149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6df5-8a65-479a-a5b9-3a7ef7b37f82 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:18.756149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6df5-8a65-479a-a5b9-3a7ef7b37f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:18.756149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6df5-8a65-479a-a5b9-3a7ef7b37f82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:18.793202 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:18.828759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb03dfc-5ef1-458a-a7a9-994bab72c801 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:18.830688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c6df5-8a65-479a-a5b9-3a7ef7b37f82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:18.832427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c6df5-8a65-479a-a5b9-3a7ef7b37f82 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:18.874540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8937c4-b7cc-4259-a64d-5df9553da07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:18.875287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8937c4-b7cc-4259-a64d-5df9553da07a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:18.875582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8937c4-b7cc-4259-a64d-5df9553da07a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:18.875862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8937c4-b7cc-4259-a64d-5df9553da07a None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:18.876596 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8937c4-b7cc-4259-a64d-5df9553da07a None admin] RBAC: Adding query filter params (name=member) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:18.876905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8937c4-b7cc-4259-a64d-5df9553da07a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:18.878462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8937c4-b7cc-4259-a64d-5df9553da07a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:18.891732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 90/171] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:18.892881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8937c4-b7cc-4259-a64d-5df9553da07a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:19.002471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 82/172] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:19.007431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c6df5-8a65-479a-a5b9-3a7ef7b37f82 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:19.046868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:19.115832 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c6df5-8a65-479a-a5b9-3a7ef7b37f82 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:19.119889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8937c4-b7cc-4259-a64d-5df9553da07a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:19.154479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6108536-14fb-4b90-b51d-b61186d70453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:19.155076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6108536-14fb-4b90-b51d-b61186d70453 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:19.155360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6108536-14fb-4b90-b51d-b61186d70453 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:19.155632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6108536-14fb-4b90-b51d-b61186d70453 None admin] PATH_INFO: `/v3/users/d9d1524bdf514276aeb2826c6b3bb363` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:19.157058 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6108536-14fb-4b90-b51d-b61186d70453 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d1524bdf514276aeb2826c6b3bb363)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:19.158989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6108536-14fb-4b90-b51d-b61186d70453 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:19.160599 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 83/173] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:19 2022] GET /identity/v3/users/d9d1524bdf514276aeb2826c6b3bb363 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:19.165546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6108536-14fb-4b90-b51d-b61186d70453 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:19.203775 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aecd5a-fd91-4759-8185-c2c0751726ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:19.204811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aecd5a-fd91-4759-8185-c2c0751726ad None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:19.205337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aecd5a-fd91-4759-8185-c2c0751726ad None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:19.205828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aecd5a-fd91-4759-8185-c2c0751726ad None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:19.211190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aecd5a-fd91-4759-8185-c2c0751726ad None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:19.213338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aecd5a-fd91-4759-8185-c2c0751726ad None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:19.215706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 91/174] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:18 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:19.216760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aecd5a-fd91-4759-8185-c2c0751726ad None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:19.230580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:19.282952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:19.287429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6108536-14fb-4b90-b51d-b61186d70453 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:19.328990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9802f15-a255-4d46-b036-c35633177919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:19.329649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9802f15-a255-4d46-b036-c35633177919 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:19.329935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9802f15-a255-4d46-b036-c35633177919 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:19.330213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9802f15-a255-4d46-b036-c35633177919 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:19.336510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9802f15-a255-4d46-b036-c35633177919 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:19.338952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9802f15-a255-4d46-b036-c35633177919 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:19.346632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 84/175] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:19 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:19.347542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9802f15-a255-4d46-b036-c35633177919 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:19.467130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9802f15-a255-4d46-b036-c35633177919 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:19.500606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aecd5a-fd91-4759-8185-c2c0751726ad None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:19.508422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba116229-7fc6-4fd3-9f16-176b32b43796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:19.509152 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba116229-7fc6-4fd3-9f16-176b32b43796 None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:19.509440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba116229-7fc6-4fd3-9f16-176b32b43796 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:19.509715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba116229-7fc6-4fd3-9f16-176b32b43796 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e/users/4e957bbfd5e14c7fb0a5521600a203d0/roles/da2284a36aac460aa87d838a8734cab3` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:19.519327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba116229-7fc6-4fd3-9f16-176b32b43796 None admin] RBAC: Authorizing `identity:create_grant(project_id=b312e6a347184d229a1a2c04149bbe2e, user_id=4e957bbfd5e14c7fb0a5521600a203d0, role_id=da2284a36aac460aa87d838a8734cab3)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:19.520952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba116229-7fc6-4fd3-9f16-176b32b43796 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:19.540771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ecf62-8475-408b-815e-0c24bb12d748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:19.541419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ecf62-8475-408b-815e-0c24bb12d748 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:19.541701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ecf62-8475-408b-815e-0c24bb12d748 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:19.541975 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ecf62-8475-408b-815e-0c24bb12d748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:19.611714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 85/176] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:18:19 2022] PUT /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e/users/4e957bbfd5e14c7fb0a5521600a203d0/roles/da2284a36aac460aa87d838a8734cab3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:18:19.612591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba116229-7fc6-4fd3-9f16-176b32b43796 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:19.614894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ecf62-8475-408b-815e-0c24bb12d748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:19.616410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ecf62-8475-408b-815e-0c24bb12d748 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:19.619513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:19.668775 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:19.730076 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 92/177] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:19.735610 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ecf62-8475-408b-815e-0c24bb12d748 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:19.837795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba116229-7fc6-4fd3-9f16-176b32b43796 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:19.850523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ecf62-8475-408b-815e-0c24bb12d748 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:19.853275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:19.889473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bb913-ba83-4937-829b-e8f43810a238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:19.891139 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bb913-ba83-4937-829b-e8f43810a238 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:19.891440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bb913-ba83-4937-829b-e8f43810a238 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:19.891718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bb913-ba83-4937-829b-e8f43810a238 None admin] PATH_INFO: `/v3/projects/cdf1fe3dc88a498fbc578833c517f266` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:19.892925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bb913-ba83-4937-829b-e8f43810a238 None admin] RBAC: Authorizing `identity:get_project(project_id=cdf1fe3dc88a498fbc578833c517f266)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:19.894402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bb913-ba83-4937-829b-e8f43810a238 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:19.896619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 93/178] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:19 2022] GET /identity/v3/projects/cdf1fe3dc88a498fbc578833c517f266 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:19.902659 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bb913-ba83-4937-829b-e8f43810a238 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:19.902931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cfcdb-2833-4872-bd67-c4937308340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:19.903527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cfcdb-2833-4872-bd67-c4937308340d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:19.903814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cfcdb-2833-4872-bd67-c4937308340d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:19.904097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cfcdb-2833-4872-bd67-c4937308340d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:19.904982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cfcdb-2833-4872-bd67-c4937308340d None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=b312e6a347184d229a1a2c04149bbe2e, user.id=41158534548d42db82795c2a83978403) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:19.905302 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cfcdb-2833-4872-bd67-c4937308340d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:19.911115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cfcdb-2833-4872-bd67-c4937308340d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:19.918244 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 86/179] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:19 2022] GET /identity/v3/role_assignments?user.id=41158534548d42db82795c2a83978403&scope.project.id=b312e6a347184d229a1a2c04149bbe2e&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:20.018693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bb913-ba83-4937-829b-e8f43810a238 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:20.055879 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c11af-924f-4a6e-9119-19220e8ffca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:20.056526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c11af-924f-4a6e-9119-19220e8ffca8 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:20.056804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c11af-924f-4a6e-9119-19220e8ffca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:20.057080 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c11af-924f-4a6e-9119-19220e8ffca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:20.057880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c11af-924f-4a6e-9119-19220e8ffca8 None admin] RBAC: Adding query filter params (role.id=b83f9277d44246c5983fe3b6d7d5af96, scope.project.id=cdf1fe3dc88a498fbc578833c517f266, user.id=d9d1524bdf514276aeb2826c6b3bb363) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:20.058789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c11af-924f-4a6e-9119-19220e8ffca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:20.060244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c11af-924f-4a6e-9119-19220e8ffca8 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:20.067502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 94/180] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:19 2022] GET /identity/v3/role_assignments?user.id=d9d1524bdf514276aeb2826c6b3bb363&scope.project.id=cdf1fe3dc88a498fbc578833c517f266&role.id=b83f9277d44246c5983fe3b6d7d5af96 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:20.420965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e26a4b-000f-4600-a5a1-4455566d1df7 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:20.421496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e26a4b-000f-4600-a5a1-4455566d1df7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:20.421496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e26a4b-000f-4600-a5a1-4455566d1df7 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:20.422932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 87/181] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:20.428492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c144f-2665-4b26-88be-75b44ba303ea None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:20.429267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c144f-2665-4b26-88be-75b44ba303ea None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:20.429764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c144f-2665-4b26-88be-75b44ba303ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:20.453100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-099c144f-2665-4b26-88be-75b44ba303ea None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:20.454703 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-099c144f-2665-4b26-88be-75b44ba303ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:20.493931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:20.539529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 95/182] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:20.564153 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e26a4b-000f-4600-a5a1-4455566d1df7 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:20.665771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:20.687411 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e26a4b-000f-4600-a5a1-4455566d1df7 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:20.716083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00627544-63a1-406e-a708-c145dbba5d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:20.716795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627544-63a1-406e-a708-c145dbba5d48 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:20.717084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627544-63a1-406e-a708-c145dbba5d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:20.717360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627544-63a1-406e-a708-c145dbba5d48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:20.727993 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00627544-63a1-406e-a708-c145dbba5d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-00627544-63a1-406e-a708-c145dbba5d48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:20.734040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:20.735118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:20.736010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 88/183] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:18:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:20.741387 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c144f-2665-4b26-88be-75b44ba303ea None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:20.854202 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c144f-2665-4b26-88be-75b44ba303ea None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:20.857342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fe05a-4502-4170-808a-a39bcbc8836e None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:20.857976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fe05a-4502-4170-808a-a39bcbc8836e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:20.858461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fe05a-4502-4170-808a-a39bcbc8836e None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:20.860068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 89/184] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:18:20.865451 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b3b0d-a831-4dad-ab8f-f73080d047a3 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:20.866107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b3b0d-a831-4dad-ab8f-f73080d047a3 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:20.866654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b3b0d-a831-4dad-ab8f-f73080d047a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:20.889399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f81b3b0d-a831-4dad-ab8f-f73080d047a3 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:20.890630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f81b3b0d-a831-4dad-ab8f-f73080d047a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:20.897649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dcc8d-10b0-4c04-92b2-15b745b03689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:20.898277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dcc8d-10b0-4c04-92b2-15b745b03689 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:20.898583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dcc8d-10b0-4c04-92b2-15b745b03689 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:20.899023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dcc8d-10b0-4c04-92b2-15b745b03689 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:20.899878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dcc8d-10b0-4c04-92b2-15b745b03689 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:20.900345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dcc8d-10b0-4c04-92b2-15b745b03689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:20.902645 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dcc8d-10b0-4c04-92b2-15b745b03689 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:20.911940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 96/185] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:20.917249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dcc8d-10b0-4c04-92b2-15b745b03689 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:20.952097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:20.974732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 90/186] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:20.975827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb5349-8270-41a7-84ca-8b131ebd88e2 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:20.976113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb5349-8270-41a7-84ca-8b131ebd88e2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:20.976386 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb5349-8270-41a7-84ca-8b131ebd88e2 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:20.977785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 91/187] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:20.983016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f0979-0a1b-449d-8bca-2b9eaae27bdb None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:20.984365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f0979-0a1b-449d-8bca-2b9eaae27bdb None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:20.985207 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f0979-0a1b-449d-8bca-2b9eaae27bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:21.004747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-0f8f0979-0a1b-449d-8bca-2b9eaae27bdb None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:21.005923 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0f8f0979-0a1b-449d-8bca-2b9eaae27bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:21.041262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dcc8d-10b0-4c04-92b2-15b745b03689 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:21.074946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 92/188] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:21.075798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f0979-0a1b-449d-8bca-2b9eaae27bdb None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:21.085677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:21.091493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22839a1d-c3e0-42f5-ba71-e95aa424b491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:21.092427 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22839a1d-c3e0-42f5-ba71-e95aa424b491 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:21.092948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22839a1d-c3e0-42f5-ba71-e95aa424b491 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:21.093423 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22839a1d-c3e0-42f5-ba71-e95aa424b491 None admin] PATH_INFO: `/v3/users/dd5b49ff5ff04d8bafd83df8d229906a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:21.109239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22839a1d-c3e0-42f5-ba71-e95aa424b491 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5b49ff5ff04d8bafd83df8d229906a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:21.110860 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22839a1d-c3e0-42f5-ba71-e95aa424b491 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:21.112548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 97/189] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:20 2022] GET /identity/v3/users/dd5b49ff5ff04d8bafd83df8d229906a => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:21.113480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22839a1d-c3e0-42f5-ba71-e95aa424b491 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:21.188772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f0979-0a1b-449d-8bca-2b9eaae27bdb None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:21.207827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:21.224679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22839a1d-c3e0-42f5-ba71-e95aa424b491 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:21.227011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcb540-3903-438c-a94b-fd81d8cdfccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:21.227664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb540-3903-438c-a94b-fd81d8cdfccc None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:21.227942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb540-3903-438c-a94b-fd81d8cdfccc None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:21.228225 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb540-3903-438c-a94b-fd81d8cdfccc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:21.229519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcb540-3903-438c-a94b-fd81d8cdfccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:21.231570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcb540-3903-438c-a94b-fd81d8cdfccc None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:21.233356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 93/190] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:21.238513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcb540-3903-438c-a94b-fd81d8cdfccc None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:21.267689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684545d-fa36-45b2-9ba3-6022aeed853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:21.268338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684545d-fa36-45b2-9ba3-6022aeed853f None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:21.268619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684545d-fa36-45b2-9ba3-6022aeed853f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:21.268893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684545d-fa36-45b2-9ba3-6022aeed853f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:21.280068 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684545d-fa36-45b2-9ba3-6022aeed853f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-f684545d-fa36-45b2-9ba3-6022aeed853f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:21.285001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:21.286078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:21.286937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 98/191] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:21.291511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684545d-fa36-45b2-9ba3-6022aeed853f None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:21.322574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:21.346373 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcb540-3903-438c-a94b-fd81d8cdfccc None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:21.383108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e30fe-206d-437a-bdb4-3e09cd39c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:21.383736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e30fe-206d-437a-bdb4-3e09cd39c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:21.384019 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e30fe-206d-437a-bdb4-3e09cd39c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:21.384294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e30fe-206d-437a-bdb4-3e09cd39c9a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:21.400593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684545d-fa36-45b2-9ba3-6022aeed853f None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:21.437719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707f277-95f3-40b9-ae1a-e1df6cc6de97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:21.439055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f277-95f3-40b9-ae1a-e1df6cc6de97 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:21.439325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f277-95f3-40b9-ae1a-e1df6cc6de97 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:21.439686 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707f277-95f3-40b9-ae1a-e1df6cc6de97 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:21.440297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707f277-95f3-40b9-ae1a-e1df6cc6de97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:21.441790 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707f277-95f3-40b9-ae1a-e1df6cc6de97 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:21.455057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e30fe-206d-437a-bdb4-3e09cd39c9a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:21.456522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e30fe-206d-437a-bdb4-3e09cd39c9a9 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:21.531170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:21.553905 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 94/192] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:21.564163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 99/193] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:18:21 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:18:21.564163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707f277-95f3-40b9-ae1a-e1df6cc6de97 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:21.564163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:21.564389 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e30fe-206d-437a-bdb4-3e09cd39c9a9 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:21.704545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e30fe-206d-437a-bdb4-3e09cd39c9a9 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:21.708197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707f277-95f3-40b9-ae1a-e1df6cc6de97 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:21.750364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e86c69-ea1e-4423-aedb-70eb7d26069f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:21.751042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e86c69-ea1e-4423-aedb-70eb7d26069f None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:21.751328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e86c69-ea1e-4423-aedb-70eb7d26069f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:21.751609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e86c69-ea1e-4423-aedb-70eb7d26069f None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:21.752339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e86c69-ea1e-4423-aedb-70eb7d26069f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:21.752652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e86c69-ea1e-4423-aedb-70eb7d26069f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:21.753417 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45988883-b3e9-45c9-87ac-4b306246bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:21.754050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e86c69-ea1e-4423-aedb-70eb7d26069f None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:21.754398 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45988883-b3e9-45c9-87ac-4b306246bf6c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:21.754842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45988883-b3e9-45c9-87ac-4b306246bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:21.755257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45988883-b3e9-45c9-87ac-4b306246bf6c None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:21.756588 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45988883-b3e9-45c9-87ac-4b306246bf6c None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:21.758042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45988883-b3e9-45c9-87ac-4b306246bf6c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:21.762569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 95/194] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:21 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:21.765732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45988883-b3e9-45c9-87ac-4b306246bf6c None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:21.766337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 100/195] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:18:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:21.772395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e86c69-ea1e-4423-aedb-70eb7d26069f None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:21.825419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:21.852088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:21.905157 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45988883-b3e9-45c9-87ac-4b306246bf6c None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:21.907660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e86c69-ea1e-4423-aedb-70eb7d26069f None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:21.953297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7e654-f102-49c8-a7c9-3a5335d7b11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:21.954023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7e654-f102-49c8-a7c9-3a5335d7b11a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:21.954269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7e654-f102-49c8-a7c9-3a5335d7b11a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:21.954590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7e654-f102-49c8-a7c9-3a5335d7b11a None admin] PATH_INFO: `/v3/users/dd5b49ff5ff04d8bafd83df8d229906a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:21.955318 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347503e1-78fe-4024-8eab-bd3556021ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:21.955793 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7e654-f102-49c8-a7c9-3a5335d7b11a None admin] RBAC: Authorizing `identity:get_user(user_id=dd5b49ff5ff04d8bafd83df8d229906a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:21.956372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347503e1-78fe-4024-8eab-bd3556021ebd None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:21.956872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347503e1-78fe-4024-8eab-bd3556021ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:21.957255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7e654-f102-49c8-a7c9-3a5335d7b11a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:21.957554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347503e1-78fe-4024-8eab-bd3556021ebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:21.958588 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347503e1-78fe-4024-8eab-bd3556021ebd None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=0d82d9815c484e6abe046fa9caa21713, user.id=dd5b49ff5ff04d8bafd83df8d229906a) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:21.959093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 101/196] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:21 2022] GET /identity/v3/users/dd5b49ff5ff04d8bafd83df8d229906a => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:21.959600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347503e1-78fe-4024-8eab-bd3556021ebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:21.961259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347503e1-78fe-4024-8eab-bd3556021ebd None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:21.965335 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7e654-f102-49c8-a7c9-3a5335d7b11a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:21.971407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 96/197] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:21 2022] GET /identity/v3/role_assignments?user.id=dd5b49ff5ff04d8bafd83df8d229906a&scope.project.id=0d82d9815c484e6abe046fa9caa21713&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:22.088568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7e654-f102-49c8-a7c9-3a5335d7b11a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:22.126263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:22.131952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3cb48-1d9d-475c-9eb9-e74c1f04c3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:22.132968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3cb48-1d9d-475c-9eb9-e74c1f04c3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:22.133469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3cb48-1d9d-475c-9eb9-e74c1f04c3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:22.133961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3cb48-1d9d-475c-9eb9-e74c1f04c3d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:22.210273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3cb48-1d9d-475c-9eb9-e74c1f04c3d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:22.212124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3cb48-1d9d-475c-9eb9-e74c1f04c3d7 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:22.220726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3743d29-1709-446b-8947-fa97e14affd6 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:22.221005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3743d29-1709-446b-8947-fa97e14affd6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:22.221289 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3743d29-1709-446b-8947-fa97e14affd6 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:22.222676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 97/198] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:18:22.227884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd883-feaa-42f5-a045-8e84c6b031bd None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:22.228170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd883-feaa-42f5-a045-8e84c6b031bd None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:22.228447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd883-feaa-42f5-a045-8e84c6b031bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:22.271510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-218dd883-feaa-42f5-a045-8e84c6b031bd None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:22.272713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-218dd883-feaa-42f5-a045-8e84c6b031bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:22.327859 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 102/199] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:22.333150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3cb48-1d9d-475c-9eb9-e74c1f04c3d7 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:22.365714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:22.441893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3cb48-1d9d-475c-9eb9-e74c1f04c3d7 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:22.448504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 98/200] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:22.477490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e46967-69ec-4c5c-9e24-2be2cd0af87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:22.478143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e46967-69ec-4c5c-9e24-2be2cd0af87c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:22.478427 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e46967-69ec-4c5c-9e24-2be2cd0af87c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:22.478733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e46967-69ec-4c5c-9e24-2be2cd0af87c None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:22.480429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e46967-69ec-4c5c-9e24-2be2cd0af87c None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:22.481883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e46967-69ec-4c5c-9e24-2be2cd0af87c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:22.483584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 103/201] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:22 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:22.485637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd883-feaa-42f5-a045-8e84c6b031bd None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:22.489714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e46967-69ec-4c5c-9e24-2be2cd0af87c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:22.548778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:22.611240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:22.614445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e46967-69ec-4c5c-9e24-2be2cd0af87c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:22.646398 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd883-feaa-42f5-a045-8e84c6b031bd None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:22.649958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e99bd-9dc6-4ba1-9a67-8678fa42a282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:22.650460 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e99bd-9dc6-4ba1-9a67-8678fa42a282 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:22.650959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e99bd-9dc6-4ba1-9a67-8678fa42a282 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:22.651531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e99bd-9dc6-4ba1-9a67-8678fa42a282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:22.653101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e99bd-9dc6-4ba1-9a67-8678fa42a282 None admin] RBAC: Adding query filter params (role.id=d2d09ac7138145968d31dde4d5b9ee5a, scope.project.id=0d82d9815c484e6abe046fa9caa21713, user.id=dd5b49ff5ff04d8bafd83df8d229906a) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:22.653419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e99bd-9dc6-4ba1-9a67-8678fa42a282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:22.654988 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e99bd-9dc6-4ba1-9a67-8678fa42a282 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:22.662764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 104/202] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:22 2022] GET /identity/v3/role_assignments?user.id=dd5b49ff5ff04d8bafd83df8d229906a&scope.project.id=0d82d9815c484e6abe046fa9caa21713&role.id=d2d09ac7138145968d31dde4d5b9ee5a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:22.690942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588eb29-34c3-4342-b027-eaf6fbe1657b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:22.691652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588eb29-34c3-4342-b027-eaf6fbe1657b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:22.691939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588eb29-34c3-4342-b027-eaf6fbe1657b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:22.692210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588eb29-34c3-4342-b027-eaf6fbe1657b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:22.704497 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588eb29-34c3-4342-b027-eaf6fbe1657b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-8588eb29-34c3-4342-b027-eaf6fbe1657b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:22.709533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:22.710470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:22.711311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 99/203] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:22.717800 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e99bd-9dc6-4ba1-9a67-8678fa42a282 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:22.832373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e99bd-9dc6-4ba1-9a67-8678fa42a282 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:22.875061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454aa94-7231-41d0-87d4-cc1da8868975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:22.875693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454aa94-7231-41d0-87d4-cc1da8868975 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:22.876031 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454aa94-7231-41d0-87d4-cc1da8868975 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:22.876310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454aa94-7231-41d0-87d4-cc1da8868975 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:22.877099 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454aa94-7231-41d0-87d4-cc1da8868975 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:22.877409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454aa94-7231-41d0-87d4-cc1da8868975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:22.878825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454aa94-7231-41d0-87d4-cc1da8868975 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:22.889121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 105/204] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:22.894829 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588eb29-34c3-4342-b027-eaf6fbe1657b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:23.008888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:23.016124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588eb29-34c3-4342-b027-eaf6fbe1657b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:23.067756 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fa88c-86dd-4de9-8e88-b462d18b35d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:23.068416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fa88c-86dd-4de9-8e88-b462d18b35d9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:23.068703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fa88c-86dd-4de9-8e88-b462d18b35d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:23.068978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fa88c-86dd-4de9-8e88-b462d18b35d9 None admin] PATH_INFO: `/v3/users/4e957bbfd5e14c7fb0a5521600a203d0` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:23.070189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fa88c-86dd-4de9-8e88-b462d18b35d9 None admin] RBAC: Authorizing `identity:get_user(user_id=4e957bbfd5e14c7fb0a5521600a203d0)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:23.071667 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fa88c-86dd-4de9-8e88-b462d18b35d9 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:23.074147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 100/205] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:22 2022] GET /identity/v3/users/4e957bbfd5e14c7fb0a5521600a203d0 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:23.079540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454aa94-7231-41d0-87d4-cc1da8868975 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:23.133028 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:23.250284 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454aa94-7231-41d0-87d4-cc1da8868975 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:23.334701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e19e26-27dd-472e-b95e-1710f2d3c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:23.335338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19e26-27dd-472e-b95e-1710f2d3c233 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:23.335622 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19e26-27dd-472e-b95e-1710f2d3c233 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:23.335901 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19e26-27dd-472e-b95e-1710f2d3c233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:23.434637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e19e26-27dd-472e-b95e-1710f2d3c233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:23.436132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e19e26-27dd-472e-b95e-1710f2d3c233 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:23.472879 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:23.557954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 106/206] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:23.564229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fa88c-86dd-4de9-8e88-b462d18b35d9 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:23.691974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fa88c-86dd-4de9-8e88-b462d18b35d9 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:23.735380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d64162-3045-4458-8573-f08350b4d2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:23.736029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d64162-3045-4458-8573-f08350b4d2fe None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:23.736314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d64162-3045-4458-8573-f08350b4d2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:23.736591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d64162-3045-4458-8573-f08350b4d2fe None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:23.743198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d64162-3045-4458-8573-f08350b4d2fe None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:23.744662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d64162-3045-4458-8573-f08350b4d2fe None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:23.747116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 101/207] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:23 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:23.752856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e19e26-27dd-472e-b95e-1710f2d3c233 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:23.883051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e19e26-27dd-472e-b95e-1710f2d3c233 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:23.917916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:23.933797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b898ef-5040-40da-8095-c5e75f599747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:23.934430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b898ef-5040-40da-8095-c5e75f599747 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:23.934751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b898ef-5040-40da-8095-c5e75f599747 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:23.935028 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b898ef-5040-40da-8095-c5e75f599747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:23.935882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b898ef-5040-40da-8095-c5e75f599747 None admin] RBAC: Adding query filter params (role.id=da2284a36aac460aa87d838a8734cab3, scope.project.id=b312e6a347184d229a1a2c04149bbe2e, user.id=4e957bbfd5e14c7fb0a5521600a203d0) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:23.936199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b898ef-5040-40da-8095-c5e75f599747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:23.937746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b898ef-5040-40da-8095-c5e75f599747 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:23.947112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 107/208] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:23 2022] GET /identity/v3/role_assignments?user.id=4e957bbfd5e14c7fb0a5521600a203d0&scope.project.id=b312e6a347184d229a1a2c04149bbe2e&role.id=da2284a36aac460aa87d838a8734cab3 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:24.384223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0990c-580e-43e2-84ec-772d4c64686b None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:24.384617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0990c-580e-43e2-84ec-772d4c64686b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:24.384789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0990c-580e-43e2-84ec-772d4c64686b None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:24.386499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 102/209] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:24.391979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9a8f5-e98f-4d60-9f30-d01cc63e0ca2 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:24.392468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9a8f5-e98f-4d60-9f30-d01cc63e0ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:24.392893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9a8f5-e98f-4d60-9f30-d01cc63e0ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:24.415120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-94e9a8f5-e98f-4d60-9f30-d01cc63e0ca2 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:24.416338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-94e9a8f5-e98f-4d60-9f30-d01cc63e0ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:24.490837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1978c7f-a7e0-4bfe-bda2-9674236cc388 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:24.491510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1978c7f-a7e0-4bfe-bda2-9674236cc388 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:24.491988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1978c7f-a7e0-4bfe-bda2-9674236cc388 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:24.493830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 103/210] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:24.498386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 108/211] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:24.500233 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15307118-6ee4-470f-b626-9eeff92e1bf0 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:24.500591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15307118-6ee4-470f-b626-9eeff92e1bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:24.500940 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15307118-6ee4-470f-b626-9eeff92e1bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:24.518023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6352f8-44a4-4347-bd65-4fb141b52ef7 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:24.518899 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6352f8-44a4-4347-bd65-4fb141b52ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:24.519184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6352f8-44a4-4347-bd65-4fb141b52ef7 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:24.520592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 109/212] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:18:24.525629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc7918-08a7-45e0-b7d9-3a02b61bd37d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:24.526124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-15307118-6ee4-470f-b626-9eeff92e1bf0 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:24.526255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc7918-08a7-45e0-b7d9-3a02b61bd37d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:24.526600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc7918-08a7-45e0-b7d9-3a02b61bd37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:24.527965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-15307118-6ee4-470f-b626-9eeff92e1bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:24.544688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-e7dc7918-08a7-45e0-b7d9-3a02b61bd37d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:24.545871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e7dc7918-08a7-45e0-b7d9-3a02b61bd37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:24.559805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:24.603216 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 104/213] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:24.611066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15307118-6ee4-470f-b626-9eeff92e1bf0 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:24.626840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 110/214] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:24.629344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc7918-08a7-45e0-b7d9-3a02b61bd37d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:24.682107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:24.728261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15307118-6ee4-470f-b626-9eeff92e1bf0 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:24.737149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc7918-08a7-45e0-b7d9-3a02b61bd37d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:24.766917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ceb14-698e-4464-a6e6-5318f7e23a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:24.767661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ceb14-698e-4464-a6e6-5318f7e23a41 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:24.767947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ceb14-698e-4464-a6e6-5318f7e23a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:24.768218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ceb14-698e-4464-a6e6-5318f7e23a41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:24.773145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e723-1e1e-4f44-81a8-5159b93220ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:24.774060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e723-1e1e-4f44-81a8-5159b93220ef None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:24.774577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e723-1e1e-4f44-81a8-5159b93220ef None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:24.775078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e723-1e1e-4f44-81a8-5159b93220ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:24.776433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858e723-1e1e-4f44-81a8-5159b93220ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:24.778130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858e723-1e1e-4f44-81a8-5159b93220ef None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:24.779416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ceb14-698e-4464-a6e6-5318f7e23a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:24.784391 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 111/215] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:24.784391 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e723-1e1e-4f44-81a8-5159b93220ef None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-1a2ceb14-698e-4464-a6e6-5318f7e23a41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:24.784602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:24.785416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:24.786202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 105/216] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:24.787377 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ceb14-698e-4464-a6e6-5318f7e23a41 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:24.817707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:24.892764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e723-1e1e-4f44-81a8-5159b93220ef None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:24.897586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ceb14-698e-4464-a6e6-5318f7e23a41 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:24.910418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:24.928972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3caeb-1946-470f-9440-7e64623a62a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:24.929621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3caeb-1946-470f-9440-7e64623a62a4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:24.929908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3caeb-1946-470f-9440-7e64623a62a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:24.930221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3caeb-1946-470f-9440-7e64623a62a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:24.936857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17e352-619b-4818-b235-4d8292418fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:24.937660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17e352-619b-4818-b235-4d8292418fa8 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:24.938350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17e352-619b-4818-b235-4d8292418fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:24.938796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17e352-619b-4818-b235-4d8292418fa8 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:24.939639 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17e352-619b-4818-b235-4d8292418fa8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:24.941106 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17e352-619b-4818-b235-4d8292418fa8 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:24.942361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3caeb-1946-470f-9440-7e64623a62a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-afe3caeb-1946-470f-9440-7e64623a62a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:24.947389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:24.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:24.949720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:24.949720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:24.949720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:24.949720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:24.949720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:24.949720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:24.949720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:24.949720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:24.949720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:24.949720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:24.949720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:24.949720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:24.951110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 112/217] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:18:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:24.951931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3caeb-1946-470f-9440-7e64623a62a4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:25.043267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 106/218] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:18:24 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:18:25.050832 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17e352-619b-4818-b235-4d8292418fa8 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:25.064280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3caeb-1946-470f-9440-7e64623a62a4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:25.107056 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37917c53-7955-4d37-a8c8-fb086be323bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:25.107925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37917c53-7955-4d37-a8c8-fb086be323bd None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:25.108071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37917c53-7955-4d37-a8c8-fb086be323bd None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:25.108350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37917c53-7955-4d37-a8c8-fb086be323bd None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:25.109087 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37917c53-7955-4d37-a8c8-fb086be323bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:25.109396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37917c53-7955-4d37-a8c8-fb086be323bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:25.110846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37917c53-7955-4d37-a8c8-fb086be323bd None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:25.119957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 113/219] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:25.127078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee534c-350e-4c34-9d72-63a8ff47907e None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:25.127363 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee534c-350e-4c34-9d72-63a8ff47907e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:25.127636 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee534c-350e-4c34-9d72-63a8ff47907e None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:25.129233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 114/220] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:25.129775 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee534c-350e-4c34-9d72-63a8ff47907e None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:25.164001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:25.184234 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:25.185148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17e352-619b-4818-b235-4d8292418fa8 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:25.236019 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f569145-215a-4986-8960-8821846c52f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:25.236568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f569145-215a-4986-8960-8821846c52f2 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:25.236849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f569145-215a-4986-8960-8821846c52f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:25.237123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f569145-215a-4986-8960-8821846c52f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:25.237855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f569145-215a-4986-8960-8821846c52f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:25.238160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f569145-215a-4986-8960-8821846c52f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:25.240162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f569145-215a-4986-8960-8821846c52f2 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:25.254868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 107/221] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:25.254868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883a0a-6a7c-49ca-86da-4db90ae897bb None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:25.255096 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883a0a-6a7c-49ca-86da-4db90ae897bb None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:25.255354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab883a0a-6a7c-49ca-86da-4db90ae897bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:25.270756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee534c-350e-4c34-9d72-63a8ff47907e None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:25.284769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-ab883a0a-6a7c-49ca-86da-4db90ae897bb None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:25.286519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ab883a0a-6a7c-49ca-86da-4db90ae897bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:25.348617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cce90-6e52-4915-82ab-1fbfea1d65ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:25.349286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cce90-6e52-4915-82ab-1fbfea1d65ac None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:25.349570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cce90-6e52-4915-82ab-1fbfea1d65ac None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:25.349857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cce90-6e52-4915-82ab-1fbfea1d65ac None admin] PATH_INFO: `/v3/users/46c872e328434282b3701809ac124192` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:25.371264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cce90-6e52-4915-82ab-1fbfea1d65ac None admin] RBAC: Authorizing `identity:get_user(user_id=46c872e328434282b3701809ac124192)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:25.373376 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cce90-6e52-4915-82ab-1fbfea1d65ac None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:25.375179 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 115/222] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:25 2022] GET /identity/v3/users/46c872e328434282b3701809ac124192 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:25.376240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cce90-6e52-4915-82ab-1fbfea1d65ac None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:25.407578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 108/223] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:25.413974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883a0a-6a7c-49ca-86da-4db90ae897bb None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:25.510157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:25.520322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:25.521404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cce90-6e52-4915-82ab-1fbfea1d65ac None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:25.566910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab883a0a-6a7c-49ca-86da-4db90ae897bb None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:25.596799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe86076-5cb5-4fc7-a394-b76b4101d758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:25.597474 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe86076-5cb5-4fc7-a394-b76b4101d758 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:25.598288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe86076-5cb5-4fc7-a394-b76b4101d758 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:25.598288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe86076-5cb5-4fc7-a394-b76b4101d758 None admin] PATH_INFO: `/v3/users/dd5b49ff5ff04d8bafd83df8d229906a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:25.606527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe86076-5cb5-4fc7-a394-b76b4101d758 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5b49ff5ff04d8bafd83df8d229906a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:25.608047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe86076-5cb5-4fc7-a394-b76b4101d758 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:25.611234 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb1508-3fb6-4746-a142-627e4741c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:25.612281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 116/224] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:25 2022] GET /identity/v3/users/dd5b49ff5ff04d8bafd83df8d229906a => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:25.613001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb1508-3fb6-4746-a142-627e4741c86e None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:25.613127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe86076-5cb5-4fc7-a394-b76b4101d758 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:25.613882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb1508-3fb6-4746-a142-627e4741c86e None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:25.614360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb1508-3fb6-4746-a142-627e4741c86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:25.716241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb1508-3fb6-4746-a142-627e4741c86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:25.718865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb1508-3fb6-4746-a142-627e4741c86e None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:25.762150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe86076-5cb5-4fc7-a394-b76b4101d758 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:25.806387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:25.818283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1270a-99ea-4eb5-b31d-2d77a60df724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:25.818991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1270a-99ea-4eb5-b31d-2d77a60df724 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:25.819437 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1270a-99ea-4eb5-b31d-2d77a60df724 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:25.819725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1270a-99ea-4eb5-b31d-2d77a60df724 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:25.834014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1270a-99ea-4eb5-b31d-2d77a60df724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:25.841042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 109/225] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-b5a1270a-99ea-4eb5-b31d-2d77a60df724 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:25.841346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:25.842411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:25.843424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:25.843424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:25.843424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:25.843424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:25.843424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:25.843424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:25.843424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:25.843424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:25.843424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:25.843424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:25.843424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:25.843424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:25.847814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb1508-3fb6-4746-a142-627e4741c86e None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:25.848007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 117/226] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:25.850340 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1270a-99ea-4eb5-b31d-2d77a60df724 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:25.887930 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:25.965312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb1508-3fb6-4746-a142-627e4741c86e None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:25.992499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1270a-99ea-4eb5-b31d-2d77a60df724 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:26.004624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305cfdc-2e0f-43e1-84e0-9bc5c8c03c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:26.005421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305cfdc-2e0f-43e1-84e0-9bc5c8c03c80 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:26.005859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305cfdc-2e0f-43e1-84e0-9bc5c8c03c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:26.006235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305cfdc-2e0f-43e1-84e0-9bc5c8c03c80 None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:26.007807 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305cfdc-2e0f-43e1-84e0-9bc5c8c03c80 None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:26.009429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305cfdc-2e0f-43e1-84e0-9bc5c8c03c80 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:26.011572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 110/227] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:25 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:26.012574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305cfdc-2e0f-43e1-84e0-9bc5c8c03c80 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:26.037623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e3957-3691-43ab-8bf8-e15810979ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:26.040848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e3957-3691-43ab-8bf8-e15810979ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:26.040848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e3957-3691-43ab-8bf8-e15810979ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:26.040848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e3957-3691-43ab-8bf8-e15810979ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:26.040848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e3957-3691-43ab-8bf8-e15810979ef3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:26.040848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e3957-3691-43ab-8bf8-e15810979ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:26.041872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e3957-3691-43ab-8bf8-e15810979ef3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:26.053256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 118/228] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:18:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:26.054403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e3957-3691-43ab-8bf8-e15810979ef3 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:26.072912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:26.136943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305cfdc-2e0f-43e1-84e0-9bc5c8c03c80 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:26.174455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97e8e0-949b-4736-8b09-4533c5a41852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:26.175393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:26.176181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97e8e0-949b-4736-8b09-4533c5a41852 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:26.176774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97e8e0-949b-4736-8b09-4533c5a41852 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:26.177192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97e8e0-949b-4736-8b09-4533c5a41852 None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:26.178629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97e8e0-949b-4736-8b09-4533c5a41852 None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:26.185801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97e8e0-949b-4736-8b09-4533c5a41852 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:26.185801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 111/229] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:26 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:26.185801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97e8e0-949b-4736-8b09-4533c5a41852 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:26.190263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e3957-3691-43ab-8bf8-e15810979ef3 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:26.238732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13218db-87b2-4e11-a133-ac5807619f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:26.239419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13218db-87b2-4e11-a133-ac5807619f61 None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:26.239710 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13218db-87b2-4e11-a133-ac5807619f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:26.239994 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13218db-87b2-4e11-a133-ac5807619f61 None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713/users/dd5b49ff5ff04d8bafd83df8d229906a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:26.242700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13218db-87b2-4e11-a133-ac5807619f61 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d82d9815c484e6abe046fa9caa21713, user_id=dd5b49ff5ff04d8bafd83df8d229906a, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:26.244164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13218db-87b2-4e11-a133-ac5807619f61 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:26.295363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97e8e0-949b-4736-8b09-4533c5a41852 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:26.306171 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:26.334532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf566d61-1467-4ee5-99c1-deb559d27127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:26.334532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf566d61-1467-4ee5-99c1-deb559d27127 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:26.334532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf566d61-1467-4ee5-99c1-deb559d27127 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:26.334532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf566d61-1467-4ee5-99c1-deb559d27127 None admin] PATH_INFO: `/v3/users/dd5b49ff5ff04d8bafd83df8d229906a` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:26.334943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf566d61-1467-4ee5-99c1-deb559d27127 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5b49ff5ff04d8bafd83df8d229906a)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:26.336321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf566d61-1467-4ee5-99c1-deb559d27127 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:26.337949 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 112/230] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:26 2022] GET /identity/v3/users/dd5b49ff5ff04d8bafd83df8d229906a => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:26.338814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf566d61-1467-4ee5-99c1-deb559d27127 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:26.344312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 119/231] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:18:26 2022] PUT /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713/users/dd5b49ff5ff04d8bafd83df8d229906a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:18:26.345539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13218db-87b2-4e11-a133-ac5807619f61 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:26.519604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf566d61-1467-4ee5-99c1-deb559d27127 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:26.521777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13218db-87b2-4e11-a133-ac5807619f61 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:26.571078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37aa6c-eeba-478e-8e17-7aec59e65afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:26.572312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37aa6c-eeba-478e-8e17-7aec59e65afc None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:26.572823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37aa6c-eeba-478e-8e17-7aec59e65afc None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:26.573947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37aa6c-eeba-478e-8e17-7aec59e65afc None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:26.575906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37aa6c-eeba-478e-8e17-7aec59e65afc None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:26.577564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37aa6c-eeba-478e-8e17-7aec59e65afc None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:26.581518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 120/232] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:26 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:26.587336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37aa6c-eeba-478e-8e17-7aec59e65afc None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:26.592354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cbb96-3b7c-45a1-aadd-7659357f0c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:26.594150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cbb96-3b7c-45a1-aadd-7659357f0c08 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:26.594686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cbb96-3b7c-45a1-aadd-7659357f0c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:26.595181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cbb96-3b7c-45a1-aadd-7659357f0c08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:26.596188 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cbb96-3b7c-45a1-aadd-7659357f0c08 None admin] RBAC: Adding query filter params (role.id=b83f9277d44246c5983fe3b6d7d5af96, scope.project.id=0d82d9815c484e6abe046fa9caa21713, user.id=46c872e328434282b3701809ac124192) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:26.596699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cbb96-3b7c-45a1-aadd-7659357f0c08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:26.598982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cbb96-3b7c-45a1-aadd-7659357f0c08 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:26.606685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 113/233] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:26 2022] GET /identity/v3/role_assignments?user.id=46c872e328434282b3701809ac124192&scope.project.id=0d82d9815c484e6abe046fa9caa21713&role.id=b83f9277d44246c5983fe3b6d7d5af96 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:26.610936 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:26.709825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37aa6c-eeba-478e-8e17-7aec59e65afc None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:26.750264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591d438-cd49-49a2-a89d-d170273513a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:26.750978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591d438-cd49-49a2-a89d-d170273513a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:26.751263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591d438-cd49-49a2-a89d-d170273513a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:26.751544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591d438-cd49-49a2-a89d-d170273513a8 None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713/users/dd5b49ff5ff04d8bafd83df8d229906a/roles/d2d09ac7138145968d31dde4d5b9ee5a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:26.753955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591d438-cd49-49a2-a89d-d170273513a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d82d9815c484e6abe046fa9caa21713, user_id=dd5b49ff5ff04d8bafd83df8d229906a, role_id=d2d09ac7138145968d31dde4d5b9ee5a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:26.755526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591d438-cd49-49a2-a89d-d170273513a8 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:26.850966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 121/234] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:18:26 2022] PUT /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713/users/dd5b49ff5ff04d8bafd83df8d229906a/roles/d2d09ac7138145968d31dde4d5b9ee5a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:18:27.341879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c44498-75d1-41bd-990b-abc5f97f527f None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:27.342394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c44498-75d1-41bd-990b-abc5f97f527f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:27.342470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c44498-75d1-41bd-990b-abc5f97f527f None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:27.344097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 114/235] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:27.360467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f90865-a5fb-4dd0-be34-61a48dcc4406 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:27.360783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f90865-a5fb-4dd0-be34-61a48dcc4406 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:27.361028 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f90865-a5fb-4dd0-be34-61a48dcc4406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:27.387606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-34f90865-a5fb-4dd0-be34-61a48dcc4406 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:27.388824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-34f90865-a5fb-4dd0-be34-61a48dcc4406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:27.482221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 122/236] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:27.528116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c44498-75d1-41bd-990b-abc5f97f527f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:27.586514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:27.662871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e428a-5064-4475-8039-69d61725c193 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:27.663348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e428a-5064-4475-8039-69d61725c193 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:27.663348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e428a-5064-4475-8039-69d61725c193 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:27.663689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c44498-75d1-41bd-990b-abc5f97f527f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:27.664995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 123/237] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:27.670721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6da674-9ff6-4d45-a7e0-fa816cd696b7 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:27.671014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6da674-9ff6-4d45-a7e0-fa816cd696b7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:27.671299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6da674-9ff6-4d45-a7e0-fa816cd696b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:27.684785 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:27.690546 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-7d6da674-9ff6-4d45-a7e0-fa816cd696b7 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:27.691865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7d6da674-9ff6-4d45-a7e0-fa816cd696b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:27.714526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2c3cc-ede4-4467-a0b7-10d50d359bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:27.715578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2c3cc-ede4-4467-a0b7-10d50d359bfe None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:27.715871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2c3cc-ede4-4467-a0b7-10d50d359bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:27.716146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2c3cc-ede4-4467-a0b7-10d50d359bfe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:27.730900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2c3cc-ede4-4467-a0b7-10d50d359bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-e5a2c3cc-ede4-4467-a0b7-10d50d359bfe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:27.736830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:27.737918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:27.738914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 115/238] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:27.746921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2c3cc-ede4-4467-a0b7-10d50d359bfe None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:27.784442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 124/239] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:27.858351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6da674-9ff6-4d45-a7e0-fa816cd696b7 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:27.919571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2c3cc-ede4-4467-a0b7-10d50d359bfe None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:27.926890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:27.958512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cae046-961d-4ac0-a5f6-39aa30b7f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:27.958512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cae046-961d-4ac0-a5f6-39aa30b7f486 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:27.958512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cae046-961d-4ac0-a5f6-39aa30b7f486 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:27.958512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cae046-961d-4ac0-a5f6-39aa30b7f486 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:27.958915 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cae046-961d-4ac0-a5f6-39aa30b7f486 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:27.958915 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cae046-961d-4ac0-a5f6-39aa30b7f486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:27.959781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cae046-961d-4ac0-a5f6-39aa30b7f486 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:27.973805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 116/240] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:27.978531 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cae046-961d-4ac0-a5f6-39aa30b7f486 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:28.066687 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6da674-9ff6-4d45-a7e0-fa816cd696b7 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:28.106611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cae046-961d-4ac0-a5f6-39aa30b7f486 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:28.127898 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb306a67-f8fc-4568-b873-4f47de69dd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:28.128750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb306a67-f8fc-4568-b873-4f47de69dd07 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:28.129177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb306a67-f8fc-4568-b873-4f47de69dd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:28.129605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb306a67-f8fc-4568-b873-4f47de69dd07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:28.135165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb306a67-f8fc-4568-b873-4f47de69dd07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:28.137607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb306a67-f8fc-4568-b873-4f47de69dd07 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:28.139749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 125/241] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:28.139990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cba49-1cb7-44c7-9a5c-012f94eca914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:28.140754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cba49-1cb7-44c7-9a5c-012f94eca914 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:28.145491 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cba49-1cb7-44c7-9a5c-012f94eca914 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:28.145886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cba49-1cb7-44c7-9a5c-012f94eca914 None admin] PATH_INFO: `/v3/users/50fa1522decd4886909622474ffc9686` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:28.146502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb306a67-f8fc-4568-b873-4f47de69dd07 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:28.154974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:28.169367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cba49-1cb7-44c7-9a5c-012f94eca914 None admin] RBAC: Authorizing `identity:get_user(user_id=50fa1522decd4886909622474ffc9686)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:28.169367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cba49-1cb7-44c7-9a5c-012f94eca914 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:28.169367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 117/242] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:27 2022] GET /identity/v3/users/50fa1522decd4886909622474ffc9686 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:28.174672 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cba49-1cb7-44c7-9a5c-012f94eca914 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:28.197857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:28.314958 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cba49-1cb7-44c7-9a5c-012f94eca914 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:28.346450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb306a67-f8fc-4568-b873-4f47de69dd07 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:28.390072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798bbaf-d4ba-4646-919e-49669212f6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:28.391374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798bbaf-d4ba-4646-919e-49669212f6e6 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:28.392136 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798bbaf-d4ba-4646-919e-49669212f6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:28.393058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798bbaf-d4ba-4646-919e-49669212f6e6 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:28.393819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe70c0e-0b54-4fd5-b373-9791bab8a37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:28.395069 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798bbaf-d4ba-4646-919e-49669212f6e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:28.395848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe70c0e-0b54-4fd5-b373-9791bab8a37c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:28.397521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798bbaf-d4ba-4646-919e-49669212f6e6 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:28.398076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe70c0e-0b54-4fd5-b373-9791bab8a37c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:28.398548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe70c0e-0b54-4fd5-b373-9791bab8a37c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:28.486898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe70c0e-0b54-4fd5-b373-9791bab8a37c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:28.488642 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe70c0e-0b54-4fd5-b373-9791bab8a37c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:28.516102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 126/243] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:18:28 2022] POST /identity/v3/users => generated 293 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:18:28.518313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:28.618064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 118/244] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:28.624910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798bbaf-d4ba-4646-919e-49669212f6e6 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:28.719286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:28.770287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798bbaf-d4ba-4646-919e-49669212f6e6 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:28.776999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e9bd-990b-4fd4-8d22-784d46b7e9c2 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:28.777286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e9bd-990b-4fd4-8d22-784d46b7e9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:28.777571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e9bd-990b-4fd4-8d22-784d46b7e9c2 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:28.787467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 119/245] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:18:28.787467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c9582-e039-434b-aa72-08ead1b4ebee None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:28.787467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c9582-e039-434b-aa72-08ead1b4ebee None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:28.787467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c9582-e039-434b-aa72-08ead1b4ebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:28.805090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9d0c9582-e039-434b-aa72-08ead1b4ebee None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:28.806526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9d0c9582-e039-434b-aa72-08ead1b4ebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:28.811254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2afeb-aea1-4b95-ad89-516a13421afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:28.813050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2afeb-aea1-4b95-ad89-516a13421afd None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:28.813050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2afeb-aea1-4b95-ad89-516a13421afd None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:28.813050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2afeb-aea1-4b95-ad89-516a13421afd None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:28.814850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2afeb-aea1-4b95-ad89-516a13421afd None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:28.816094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2afeb-aea1-4b95-ad89-516a13421afd None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:28.822879 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 127/246] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:28 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:28.826221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2afeb-aea1-4b95-ad89-516a13421afd None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:28.910870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 120/247] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:28.934774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c9582-e039-434b-aa72-08ead1b4ebee None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:28.973592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2afeb-aea1-4b95-ad89-516a13421afd None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:29.015157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:29.017236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:29.029537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56c903-9e45-463c-aa82-a14f0b72bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:29.029537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56c903-9e45-463c-aa82-a14f0b72bb1f None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:29.029537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56c903-9e45-463c-aa82-a14f0b72bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:29.029537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56c903-9e45-463c-aa82-a14f0b72bb1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:29.029897 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56c903-9e45-463c-aa82-a14f0b72bb1f None admin] RBAC: Adding query filter params (role.id=da2284a36aac460aa87d838a8734cab3, scope.project.id=0d82d9815c484e6abe046fa9caa21713, user.id=50fa1522decd4886909622474ffc9686) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:29.029897 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56c903-9e45-463c-aa82-a14f0b72bb1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:29.030381 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56c903-9e45-463c-aa82-a14f0b72bb1f None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:29.042525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 128/248] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:28 2022] GET /identity/v3/role_assignments?user.id=50fa1522decd4886909622474ffc9686&scope.project.id=0d82d9815c484e6abe046fa9caa21713&role.id=da2284a36aac460aa87d838a8734cab3 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:29.093799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c9582-e039-434b-aa72-08ead1b4ebee None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:29.134414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de9f25-04fa-4785-902f-3f093cdf2372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:29.135470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de9f25-04fa-4785-902f-3f093cdf2372 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:29.136242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de9f25-04fa-4785-902f-3f093cdf2372 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:29.136695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de9f25-04fa-4785-902f-3f093cdf2372 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:29.149132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de9f25-04fa-4785-902f-3f093cdf2372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-24de9f25-04fa-4785-902f-3f093cdf2372 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:29.154701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:29.155699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:29.156506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:29.156506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:29.156506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:29.156506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:29.156506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:29.156506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:29.156506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:29.156506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:29.156506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:29.156506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:29.156506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:29.156506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:29.159223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 121/249] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:18:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:18:29.165363 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56c903-9e45-463c-aa82-a14f0b72bb1f None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:29.280207 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56c903-9e45-463c-aa82-a14f0b72bb1f None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:29.294353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f992c-2a9b-4ce8-8a8e-64f69825fc23 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:29.294759 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f992c-2a9b-4ce8-8a8e-64f69825fc23 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:29.295115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f992c-2a9b-4ce8-8a8e-64f69825fc23 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:29.297799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 122/250] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:18:29.301571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae189-8cc8-41eb-bb6f-af4785bab703 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:29.301976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae189-8cc8-41eb-bb6f-af4785bab703 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:29.302360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae189-8cc8-41eb-bb6f-af4785bab703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:29.319584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cc3e9-d5be-4a70-acf2-9355295c56a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:29.320482 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cc3e9-d5be-4a70-acf2-9355295c56a5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:29.321826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cc3e9-d5be-4a70-acf2-9355295c56a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:29.322254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cc3e9-d5be-4a70-acf2-9355295c56a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:29.323777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cc3e9-d5be-4a70-acf2-9355295c56a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:29.324254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cc3e9-d5be-4a70-acf2-9355295c56a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:29.325903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cc3e9-d5be-4a70-acf2-9355295c56a5 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:29.336106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 129/251] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:29.343100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cc3e9-d5be-4a70-acf2-9355295c56a5 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:29.347749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-3d5ae189-8cc8-41eb-bb6f-af4785bab703 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:29.348907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-3d5ae189-8cc8-41eb-bb6f-af4785bab703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:29.407143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:29.464201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cc3e9-d5be-4a70-acf2-9355295c56a5 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:29.488823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 123/252] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:29.522825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca215a24-9563-4a03-9097-28efcd1d19f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:29.523800 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca215a24-9563-4a03-9097-28efcd1d19f1 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:29.523914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ae189-8cc8-41eb-bb6f-af4785bab703 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:29.524314 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca215a24-9563-4a03-9097-28efcd1d19f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:29.524725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca215a24-9563-4a03-9097-28efcd1d19f1 None admin] PATH_INFO: `/v3/users/dd5b49ff5ff04d8bafd83df8d229906a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:29.526191 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca215a24-9563-4a03-9097-28efcd1d19f1 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5b49ff5ff04d8bafd83df8d229906a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:29.527856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca215a24-9563-4a03-9097-28efcd1d19f1 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:29.529974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 130/253] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:29 2022] GET /identity/v3/users/dd5b49ff5ff04d8bafd83df8d229906a => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:29.535639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca215a24-9563-4a03-9097-28efcd1d19f1 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:29.605397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:29.707298 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca215a24-9563-4a03-9097-28efcd1d19f1 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:29.718919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ae189-8cc8-41eb-bb6f-af4785bab703 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:29.759882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829509f-26c8-469f-841e-7788b3571a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:29.761324 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829509f-26c8-469f-841e-7788b3571a4d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:29.761613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829509f-26c8-469f-841e-7788b3571a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:29.762374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829509f-26c8-469f-841e-7788b3571a4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:29.773490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:29.775034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829509f-26c8-469f-841e-7788b3571a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-3829509f-26c8-469f-841e-7788b3571a4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:29.782818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:29.783737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:29.784529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:29.784529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:29.784529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:29.784529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:29.784529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:29.784529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:29.784529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:29.784529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:29.784529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:29.784529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:29.784529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:29.784529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:29.787695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 124/254] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:18:29.789183 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f60c0-85da-40c8-95fb-2b70bce845f3 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:29.789684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f60c0-85da-40c8-95fb-2b70bce845f3 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:29.790161 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f60c0-85da-40c8-95fb-2b70bce845f3 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:29.796437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 125/255] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:29.796654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f60c0-85da-40c8-95fb-2b70bce845f3 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:29.806760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c2277-ffe3-478d-af21-8d26552dca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:29.807980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c2277-ffe3-478d-af21-8d26552dca86 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:29.808314 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c2277-ffe3-478d-af21-8d26552dca86 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:29.808592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c2277-ffe3-478d-af21-8d26552dca86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:29.900941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c2277-ffe3-478d-af21-8d26552dca86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:29.902879 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c2277-ffe3-478d-af21-8d26552dca86 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:30.006428 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:30.016151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f60c0-85da-40c8-95fb-2b70bce845f3 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:30.079681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 131/256] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:30.080736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69b1b-e122-45ad-aea0-53deac1571ef None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:30.081020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69b1b-e122-45ad-aea0-53deac1571ef None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:30.081292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69b1b-e122-45ad-aea0-53deac1571ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:30.088120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb49a51-a538-4e97-91ee-a91e2a85a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:30.088804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb49a51-a538-4e97-91ee-a91e2a85a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:30.089086 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb49a51-a538-4e97-91ee-a91e2a85a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:30.089362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb49a51-a538-4e97-91ee-a91e2a85a2f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:30.090083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb49a51-a538-4e97-91ee-a91e2a85a2f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:30.090384 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb49a51-a538-4e97-91ee-a91e2a85a2f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:30.091806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb49a51-a538-4e97-91ee-a91e2a85a2f0 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:30.104767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 126/257] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:30.105715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb49a51-a538-4e97-91ee-a91e2a85a2f0 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:30.125330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-baf69b1b-e122-45ad-aea0-53deac1571ef None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:30.126608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-baf69b1b-e122-45ad-aea0-53deac1571ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:30.172135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:30.221995 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb49a51-a538-4e97-91ee-a91e2a85a2f0 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:30.263285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728cbf-8fc5-482a-ad2a-99d1f0e7fc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:30.263943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728cbf-8fc5-482a-ad2a-99d1f0e7fc87 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:30.264231 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728cbf-8fc5-482a-ad2a-99d1f0e7fc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:30.264509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728cbf-8fc5-482a-ad2a-99d1f0e7fc87 None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:30.265683 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a728cbf-8fc5-482a-ad2a-99d1f0e7fc87 None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:30.267236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a728cbf-8fc5-482a-ad2a-99d1f0e7fc87 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:30.269183 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 127/258] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:30 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:30.269721 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728cbf-8fc5-482a-ad2a-99d1f0e7fc87 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:30.302294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:30.328053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 132/259] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:30.328695 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf69b1b-e122-45ad-aea0-53deac1571ef None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:30.388656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728cbf-8fc5-482a-ad2a-99d1f0e7fc87 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:30.428899 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ff508-08f4-4389-8cc5-39c262171abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:30.429913 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ff508-08f4-4389-8cc5-39c262171abc None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:30.430404 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ff508-08f4-4389-8cc5-39c262171abc None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:30.430954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ff508-08f4-4389-8cc5-39c262171abc None admin] PATH_INFO: `/v3/users/46c872e328434282b3701809ac124192` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:30.432925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ff508-08f4-4389-8cc5-39c262171abc None admin] RBAC: Authorizing `identity:get_user(user_id=46c872e328434282b3701809ac124192)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:30.434767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ff508-08f4-4389-8cc5-39c262171abc None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:30.436688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 128/260] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:30 2022] GET /identity/v3/users/46c872e328434282b3701809ac124192 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:30.438097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ff508-08f4-4389-8cc5-39c262171abc None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:30.545560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:30.550311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ff508-08f4-4389-8cc5-39c262171abc None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:30.587330 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd0f70-aaa6-4b36-9eba-cffc717443ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:30.590087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd0f70-aaa6-4b36-9eba-cffc717443ca None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:30.590865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd0f70-aaa6-4b36-9eba-cffc717443ca None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:30.591445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd0f70-aaa6-4b36-9eba-cffc717443ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:30.593457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf69b1b-e122-45ad-aea0-53deac1571ef None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:30.612353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd0f70-aaa6-4b36-9eba-cffc717443ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-b5fd0f70-aaa6-4b36-9eba-cffc717443ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:30.617992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:30.618876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:30.619696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:30.619696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:30.619696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:30.619696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:30.619696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:30.619696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:30.619696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:30.619696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:30.619696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:30.619696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:30.619696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:30.619696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:30.623436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 129/261] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:30.624760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd0f70-aaa6-4b36-9eba-cffc717443ca None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:30.648746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d59b7-8dda-4145-9602-f2e1dc5bf87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:30.649378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d59b7-8dda-4145-9602-f2e1dc5bf87f None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:30.649664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d59b7-8dda-4145-9602-f2e1dc5bf87f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:30.649945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d59b7-8dda-4145-9602-f2e1dc5bf87f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:30.650758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d59b7-8dda-4145-9602-f2e1dc5bf87f None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=0d82d9815c484e6abe046fa9caa21713, user.id=dd5b49ff5ff04d8bafd83df8d229906a) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:30.651097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d59b7-8dda-4145-9602-f2e1dc5bf87f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:30.652544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d59b7-8dda-4145-9602-f2e1dc5bf87f None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:30.665858 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 133/262] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:30 2022] GET /identity/v3/role_assignments?user.id=dd5b49ff5ff04d8bafd83df8d229906a&scope.project.id=0d82d9815c484e6abe046fa9caa21713&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:30.666470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d59b7-8dda-4145-9602-f2e1dc5bf87f None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:30.702731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:30.738731 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd0f70-aaa6-4b36-9eba-cffc717443ca None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:30.778812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c0b91-c630-4ffa-b4fb-9810fbf78cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:30.779841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c0b91-c630-4ffa-b4fb-9810fbf78cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:30.780335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c0b91-c630-4ffa-b4fb-9810fbf78cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:30.780828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c0b91-c630-4ffa-b4fb-9810fbf78cc4 None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:30.782442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c0b91-c630-4ffa-b4fb-9810fbf78cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:30.784221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c0b91-c630-4ffa-b4fb-9810fbf78cc4 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:30.786165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 130/263] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:30 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:30.792281 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c0b91-c630-4ffa-b4fb-9810fbf78cc4 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:30.850939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:30.876593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d59b7-8dda-4145-9602-f2e1dc5bf87f None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:30.946432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c0b91-c630-4ffa-b4fb-9810fbf78cc4 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:30.983942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432524a0-3f10-4d84-8c41-d86a7834cad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:30.995381 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432524a0-3f10-4d84-8c41-d86a7834cad5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:30.995381 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432524a0-3f10-4d84-8c41-d86a7834cad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:30.995381 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432524a0-3f10-4d84-8c41-d86a7834cad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:30.995636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2811b94-5cb8-4f0c-8db1-e67cc0ae3ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:30.995723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432524a0-3f10-4d84-8c41-d86a7834cad5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:30.995823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2811b94-5cb8-4f0c-8db1-e67cc0ae3ece None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:30.995900 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432524a0-3f10-4d84-8c41-d86a7834cad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:30.995978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2811b94-5cb8-4f0c-8db1-e67cc0ae3ece None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:30.995978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2811b94-5cb8-4f0c-8db1-e67cc0ae3ece None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713/users/46c872e328434282b3701809ac124192/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:30.996097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432524a0-3f10-4d84-8c41-d86a7834cad5 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:30.996238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2811b94-5cb8-4f0c-8db1-e67cc0ae3ece None admin] RBAC: Authorizing `identity:create_grant(project_id=0d82d9815c484e6abe046fa9caa21713, user_id=46c872e328434282b3701809ac124192, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:30.996238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2811b94-5cb8-4f0c-8db1-e67cc0ae3ece None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:31.003331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 134/264] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:18:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:31.012917 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432524a0-3f10-4d84-8c41-d86a7834cad5 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:31.065391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 131/265] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:18:30 2022] PUT /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713/users/46c872e328434282b3701809ac124192/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:18:31.118014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:31.143871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432524a0-3f10-4d84-8c41-d86a7834cad5 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:31.184310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e88b15-ba69-4f7a-98dd-db67c9b0378b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:31.184971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e88b15-ba69-4f7a-98dd-db67c9b0378b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:31.185259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e88b15-ba69-4f7a-98dd-db67c9b0378b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:31.185539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e88b15-ba69-4f7a-98dd-db67c9b0378b None admin] PATH_INFO: `/v3/users/dd5b49ff5ff04d8bafd83df8d229906a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:31.186776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e88b15-ba69-4f7a-98dd-db67c9b0378b None admin] RBAC: Authorizing `identity:get_user(user_id=dd5b49ff5ff04d8bafd83df8d229906a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:31.188506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e88b15-ba69-4f7a-98dd-db67c9b0378b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:31.190190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 135/266] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:31 2022] GET /identity/v3/users/dd5b49ff5ff04d8bafd83df8d229906a => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:31.195905 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2811b94-5cb8-4f0c-8db1-e67cc0ae3ece None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:31.301244 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:31.318259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2811b94-5cb8-4f0c-8db1-e67cc0ae3ece None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:31.364475 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac179f-edf5-4c05-b0c0-2a9f681f93c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:31.365111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac179f-edf5-4c05-b0c0-2a9f681f93c2 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:31.365395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac179f-edf5-4c05-b0c0-2a9f681f93c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:31.365673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac179f-edf5-4c05-b0c0-2a9f681f93c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:31.453812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac179f-edf5-4c05-b0c0-2a9f681f93c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:31.455255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac179f-edf5-4c05-b0c0-2a9f681f93c2 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:31.534672 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a22fe9-eb3f-4fb8-ac7a-5e6db90422cc None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:31.534991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a22fe9-eb3f-4fb8-ac7a-5e6db90422cc None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:31.535237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a22fe9-eb3f-4fb8-ac7a-5e6db90422cc None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:31.536894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 136/267] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:31.541985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9f07-30f4-4abd-a869-f28e5afe4408 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:31.542281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9f07-30f4-4abd-a869-f28e5afe4408 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:31.542651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9f07-30f4-4abd-a869-f28e5afe4408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:31.566305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-ddfc9f07-30f4-4abd-a869-f28e5afe4408 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:31.567565 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-ddfc9f07-30f4-4abd-a869-f28e5afe4408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:31.596952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:31.617283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 132/268] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 02:18:31.623612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac179f-edf5-4c05-b0c0-2a9f681f93c2 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:31.652116 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 137/269] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:31.659289 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36145b56-3cc6-42f9-b3f4-39a5f3cd2050 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:31.659289 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36145b56-3cc6-42f9-b3f4-39a5f3cd2050 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:31.659525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36145b56-3cc6-42f9-b3f4-39a5f3cd2050 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:31.665040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 138/270] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:18:31.667542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262204d9-8cae-46ba-85bb-0af9b7236130 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:31.667946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262204d9-8cae-46ba-85bb-0af9b7236130 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:31.668241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262204d9-8cae-46ba-85bb-0af9b7236130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:31.688048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-262204d9-8cae-46ba-85bb-0af9b7236130 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:31.689306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-262204d9-8cae-46ba-85bb-0af9b7236130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:31.745447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac179f-edf5-4c05-b0c0-2a9f681f93c2 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:31.769422 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 139/271] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:31.771999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262204d9-8cae-46ba-85bb-0af9b7236130 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:31.790847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:31.796566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3448d55-a30d-4143-8443-6e9bd209e72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:31.797229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3448d55-a30d-4143-8443-6e9bd209e72f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:31.797514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3448d55-a30d-4143-8443-6e9bd209e72f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:31.797797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3448d55-a30d-4143-8443-6e9bd209e72f None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:31.803642 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3448d55-a30d-4143-8443-6e9bd209e72f None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:31.803642 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3448d55-a30d-4143-8443-6e9bd209e72f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:31.803808 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 133/272] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:31 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:31.804547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3448d55-a30d-4143-8443-6e9bd209e72f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:31.874912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:31.904212 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262204d9-8cae-46ba-85bb-0af9b7236130 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:31.918336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3448d55-a30d-4143-8443-6e9bd209e72f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:31.940207 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0965c9e-ea04-49b7-ba50-ce9c369a00a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:31.940856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0965c9e-ea04-49b7-ba50-ce9c369a00a9 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:31.941140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0965c9e-ea04-49b7-ba50-ce9c369a00a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:31.941415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0965c9e-ea04-49b7-ba50-ce9c369a00a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:31.952013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0965c9e-ea04-49b7-ba50-ce9c369a00a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-a0965c9e-ea04-49b7-ba50-ce9c369a00a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:31.957019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:31.957902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 140/273] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:31.959133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0965c9e-ea04-49b7-ba50-ce9c369a00a9 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:31.964983 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37b3ab-5621-4bd1-9476-6c62d5abd0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:31.965649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37b3ab-5621-4bd1-9476-6c62d5abd0ea None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:31.965931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37b3ab-5621-4bd1-9476-6c62d5abd0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:31.966203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37b3ab-5621-4bd1-9476-6c62d5abd0ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:31.978593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37b3ab-5621-4bd1-9476-6c62d5abd0ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-1f37b3ab-5621-4bd1-9476-6c62d5abd0ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:31.984284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:31.985355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:31.986187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 134/274] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:31.986877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2056b9-eb00-406d-827e-c40579d5f5ef None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:31.986951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2056b9-eb00-406d-827e-c40579d5f5ef None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:31.987194 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2056b9-eb00-406d-827e-c40579d5f5ef None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:31.988609 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 135/275] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:31.993196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2056b9-eb00-406d-827e-c40579d5f5ef None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:32.036024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:32.083609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0965c9e-ea04-49b7-ba50-ce9c369a00a9 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:32.109841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2056b9-eb00-406d-827e-c40579d5f5ef None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:32.119611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd45bd-bc6a-403a-a4db-2ef40e1d592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:32.120471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd45bd-bc6a-403a-a4db-2ef40e1d592b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:32.120771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd45bd-bc6a-403a-a4db-2ef40e1d592b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:32.121054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd45bd-bc6a-403a-a4db-2ef40e1d592b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:32.121850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd45bd-bc6a-403a-a4db-2ef40e1d592b None admin] RBAC: Adding query filter params (role.id=d2d09ac7138145968d31dde4d5b9ee5a, scope.project.id=0d82d9815c484e6abe046fa9caa21713, user.id=dd5b49ff5ff04d8bafd83df8d229906a) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:32.122168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd45bd-bc6a-403a-a4db-2ef40e1d592b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:32.123674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd45bd-bc6a-403a-a4db-2ef40e1d592b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:32.127198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:32.138663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 141/276] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:31 2022] GET /identity/v3/role_assignments?user.id=dd5b49ff5ff04d8bafd83df8d229906a&scope.project.id=0d82d9815c484e6abe046fa9caa21713&role.id=d2d09ac7138145968d31dde4d5b9ee5a => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:32.138663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87098e3-58b5-486d-ab65-7d8700545fc5 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:32.138663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87098e3-58b5-486d-ab65-7d8700545fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:32.138663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87098e3-58b5-486d-ab65-7d8700545fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:32.156817 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b87098e3-58b5-486d-ab65-7d8700545fc5 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:32.158152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b87098e3-58b5-486d-ab65-7d8700545fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:32.163331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9eb98-d065-4381-a631-ad97fafdbd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:32.163971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9eb98-d065-4381-a631-ad97fafdbd5f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:32.164257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9eb98-d065-4381-a631-ad97fafdbd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:32.164533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9eb98-d065-4381-a631-ad97fafdbd5f None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:32.165354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9eb98-d065-4381-a631-ad97fafdbd5f None admin] RBAC: Adding query filter params (name=member) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:32.165666 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9eb98-d065-4381-a631-ad97fafdbd5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:32.167719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9eb98-d065-4381-a631-ad97fafdbd5f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:32.177300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 136/277] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:32.177984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9eb98-d065-4381-a631-ad97fafdbd5f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:32.247834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 142/278] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:32.249285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87098e3-58b5-486d-ab65-7d8700545fc5 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:32.300183 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9eb98-d065-4381-a631-ad97fafdbd5f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:32.317701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:32.340992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e76761-c800-4006-bdda-d71d8033ac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:32.341250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e76761-c800-4006-bdda-d71d8033ac2e None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:32.341536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e76761-c800-4006-bdda-d71d8033ac2e None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:32.341815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e76761-c800-4006-bdda-d71d8033ac2e None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:32.342567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e76761-c800-4006-bdda-d71d8033ac2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:32.342881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e76761-c800-4006-bdda-d71d8033ac2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:32.344307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e76761-c800-4006-bdda-d71d8033ac2e None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:32.353127 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 137/279] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:32.357758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e76761-c800-4006-bdda-d71d8033ac2e None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:32.371873 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87098e3-58b5-486d-ab65-7d8700545fc5 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:32.407204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:32.427963 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e87127-f314-4f2e-81d0-af79ac129a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:32.428623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e87127-f314-4f2e-81d0-af79ac129a0e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:32.428918 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e87127-f314-4f2e-81d0-af79ac129a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:32.429198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e87127-f314-4f2e-81d0-af79ac129a0e None admin] PATH_INFO: `/v3/users/b8d67e913cf14dd5b17994f6f70bcc19` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:32.449015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e87127-f314-4f2e-81d0-af79ac129a0e None admin] RBAC: Authorizing `identity:get_user(user_id=b8d67e913cf14dd5b17994f6f70bcc19)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:32.450543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e87127-f314-4f2e-81d0-af79ac129a0e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:32.452515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 143/280] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:32 2022] GET /identity/v3/users/b8d67e913cf14dd5b17994f6f70bcc19 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:32.453092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e87127-f314-4f2e-81d0-af79ac129a0e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:32.478978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e76761-c800-4006-bdda-d71d8033ac2e None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:32.513991 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede681d6-55ad-4186-8e7b-34b5b6ae8922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:32.514727 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede681d6-55ad-4186-8e7b-34b5b6ae8922 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:32.514982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede681d6-55ad-4186-8e7b-34b5b6ae8922 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:32.515262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede681d6-55ad-4186-8e7b-34b5b6ae8922 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:32.516431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede681d6-55ad-4186-8e7b-34b5b6ae8922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:32.517909 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede681d6-55ad-4186-8e7b-34b5b6ae8922 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:32.519554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 138/281] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:32.520313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede681d6-55ad-4186-8e7b-34b5b6ae8922 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:32.570463 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e87127-f314-4f2e-81d0-af79ac129a0e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:32.589402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:32.609554 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb74e7-c4e1-47d6-a1d1-9100b5986890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:32.610255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb74e7-c4e1-47d6-a1d1-9100b5986890 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:32.610537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb74e7-c4e1-47d6-a1d1-9100b5986890 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:32.610821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb74e7-c4e1-47d6-a1d1-9100b5986890 None admin] PATH_INFO: `/v3/users/50fa1522decd4886909622474ffc9686` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:32.612093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb74e7-c4e1-47d6-a1d1-9100b5986890 None admin] RBAC: Authorizing `identity:get_user(user_id=50fa1522decd4886909622474ffc9686)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:32.613603 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb74e7-c4e1-47d6-a1d1-9100b5986890 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:32.621504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 144/282] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:32 2022] GET /identity/v3/users/50fa1522decd4886909622474ffc9686 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:32.622355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb74e7-c4e1-47d6-a1d1-9100b5986890 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:32.626533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede681d6-55ad-4186-8e7b-34b5b6ae8922 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:32.633712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:32.662604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f9aa-2132-4ac4-9a5a-06b27e2b1b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:32.663227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f9aa-2132-4ac4-9a5a-06b27e2b1b03 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:32.663513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f9aa-2132-4ac4-9a5a-06b27e2b1b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:32.663793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f9aa-2132-4ac4-9a5a-06b27e2b1b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:32.664593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57f9aa-2132-4ac4-9a5a-06b27e2b1b03 None admin] RBAC: Adding query filter params (role.id=b83f9277d44246c5983fe3b6d7d5af96, user.id=b8d67e913cf14dd5b17994f6f70bcc19, scope.system=all) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:32.664906 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57f9aa-2132-4ac4-9a5a-06b27e2b1b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:32.666364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57f9aa-2132-4ac4-9a5a-06b27e2b1b03 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:32.672481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 139/283] 10.222.0.60 () {56 vars in 1308 bytes} [Thu Aug 4 02:18:32 2022] GET /identity/v3/role_assignments?user.id=b8d67e913cf14dd5b17994f6f70bcc19&scope.system=all&role.id=b83f9277d44246c5983fe3b6d7d5af96 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:32.673277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f9aa-2132-4ac4-9a5a-06b27e2b1b03 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:32.749941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb74e7-c4e1-47d6-a1d1-9100b5986890 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:32.799264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cc760-fd10-4a4c-ae6c-619f56431f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:32.800001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cc760-fd10-4a4c-ae6c-619f56431f35 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:32.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cc760-fd10-4a4c-ae6c-619f56431f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:32.800705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cc760-fd10-4a4c-ae6c-619f56431f35 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:32.801472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cc760-fd10-4a4c-ae6c-619f56431f35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:32.803565 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cc760-fd10-4a4c-ae6c-619f56431f35 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:32.812390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f9aa-2132-4ac4-9a5a-06b27e2b1b03 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:32.851677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cdba5-af40-4a13-816b-7fbc5ba2744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:32.852329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cdba5-af40-4a13-816b-7fbc5ba2744c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:32.852614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cdba5-af40-4a13-816b-7fbc5ba2744c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:32.852891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cdba5-af40-4a13-816b-7fbc5ba2744c None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:32.854723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cdba5-af40-4a13-816b-7fbc5ba2744c None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:32.856480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cdba5-af40-4a13-816b-7fbc5ba2744c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:32.858445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 140/284] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:32 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:32.864265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cdba5-af40-4a13-816b-7fbc5ba2744c None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:32.902055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 145/285] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:18:32 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:18:32.923037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:32.995894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cdba5-af40-4a13-816b-7fbc5ba2744c None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:33.037959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fde75a-e149-428a-8819-a40328cab367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:33.039038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fde75a-e149-428a-8819-a40328cab367 None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:33.039528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fde75a-e149-428a-8819-a40328cab367 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:33.040013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fde75a-e149-428a-8819-a40328cab367 None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713/users/50fa1522decd4886909622474ffc9686/roles/da2284a36aac460aa87d838a8734cab3` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:33.042968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fde75a-e149-428a-8819-a40328cab367 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d82d9815c484e6abe046fa9caa21713, user_id=50fa1522decd4886909622474ffc9686, role_id=da2284a36aac460aa87d838a8734cab3)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:33.047047 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fde75a-e149-428a-8819-a40328cab367 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:33.150744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 141/286] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:18:32 2022] PUT /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713/users/50fa1522decd4886909622474ffc9686/roles/da2284a36aac460aa87d838a8734cab3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:18:33.563176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece919f-84ab-4183-be54-fee898174c2f None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:33.564105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece919f-84ab-4183-be54-fee898174c2f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:33.564638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece919f-84ab-4183-be54-fee898174c2f None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:33.566810 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 146/287] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:33.571869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a43f-64d8-447c-bb97-c92cd983eeb6 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:33.572155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a43f-64d8-447c-bb97-c92cd983eeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:33.572432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a43f-64d8-447c-bb97-c92cd983eeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:33.597541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e8c7a43f-64d8-447c-bb97-c92cd983eeb6 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:33.598754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e8c7a43f-64d8-447c-bb97-c92cd983eeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:33.689341 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 142/288] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:33.725037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece919f-84ab-4183-be54-fee898174c2f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:33.780980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:33.840651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece919f-84ab-4183-be54-fee898174c2f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:33.876263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba4a3-a775-4597-b0a9-ba81b996ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:33.876970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba4a3-a775-4597-b0a9-ba81b996ee3d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:33.877256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba4a3-a775-4597-b0a9-ba81b996ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:33.877532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba4a3-a775-4597-b0a9-ba81b996ee3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:33.888748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffba4a3-a775-4597-b0a9-ba81b996ee3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-0ffba4a3-a775-4597-b0a9-ba81b996ee3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:33.893970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:33.894866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:33.895678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 147/289] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:33.903593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a43f-64d8-447c-bb97-c92cd983eeb6 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:33.964536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:34.082588 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a43f-64d8-447c-bb97-c92cd983eeb6 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:34.140638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713c144-9fb9-468c-90bc-18100910a735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:34.141184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c144-9fb9-468c-90bc-18100910a735 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:34.141468 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c144-9fb9-468c-90bc-18100910a735 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:34.141742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c144-9fb9-468c-90bc-18100910a735 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:34.142480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713c144-9fb9-468c-90bc-18100910a735 None admin] RBAC: Adding query filter params (name=member) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:34.142807 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713c144-9fb9-468c-90bc-18100910a735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:34.144198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713c144-9fb9-468c-90bc-18100910a735 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:34.158836 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 143/290] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:34.164048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba4a3-a775-4597-b0a9-ba81b996ee3d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:34.312970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba4a3-a775-4597-b0a9-ba81b996ee3d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:34.314565 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:34.359021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e6855-6cc3-4b33-bb03-4940c4ae699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:34.359674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e6855-6cc3-4b33-bb03-4940c4ae699c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:34.359960 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e6855-6cc3-4b33-bb03-4940c4ae699c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:34.360239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e6855-6cc3-4b33-bb03-4940c4ae699c None admin] PATH_INFO: `/v3/users/46c872e328434282b3701809ac124192` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:34.361444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e6855-6cc3-4b33-bb03-4940c4ae699c None admin] RBAC: Authorizing `identity:get_user(user_id=46c872e328434282b3701809ac124192)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:34.362936 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e6855-6cc3-4b33-bb03-4940c4ae699c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:34.364554 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 148/291] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:34 2022] GET /identity/v3/users/46c872e328434282b3701809ac124192 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:34.372072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713c144-9fb9-468c-90bc-18100910a735 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:34.517320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:34.526846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713c144-9fb9-468c-90bc-18100910a735 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:34.570052 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2da00-a2f8-46fc-aa28-787d7c9d4cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:34.570718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2da00-a2f8-46fc-aa28-787d7c9d4cfe None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:34.571034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2da00-a2f8-46fc-aa28-787d7c9d4cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:34.571310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2da00-a2f8-46fc-aa28-787d7c9d4cfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:34.654107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2da00-a2f8-46fc-aa28-787d7c9d4cfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:34.655624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2da00-a2f8-46fc-aa28-787d7c9d4cfe None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:34.778806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:34.783941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 144/292] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:34.789500 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e6855-6cc3-4b33-bb03-4940c4ae699c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:34.931010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e6855-6cc3-4b33-bb03-4940c4ae699c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:34.982296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b737b00-d5b6-47e9-a6e7-b67944ad04df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:34.983283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b737b00-d5b6-47e9-a6e7-b67944ad04df None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:34.983709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b737b00-d5b6-47e9-a6e7-b67944ad04df None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:34.984159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b737b00-d5b6-47e9-a6e7-b67944ad04df None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:34.991227 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b737b00-d5b6-47e9-a6e7-b67944ad04df None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:34.992867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b737b00-d5b6-47e9-a6e7-b67944ad04df None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:34.996055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 149/293] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:34 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:35.001569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2da00-a2f8-46fc-aa28-787d7c9d4cfe None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:35.130355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114738f-9abc-4dda-8e1a-2b489ca50574 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:35.131018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114738f-9abc-4dda-8e1a-2b489ca50574 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:35.131896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114738f-9abc-4dda-8e1a-2b489ca50574 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:35.135223 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 150/294] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:35.140333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd42a9-211c-40c7-9a37-bed223fb3a5c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:35.140978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd42a9-211c-40c7-9a37-bed223fb3a5c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:35.141453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd42a9-211c-40c7-9a37-bed223fb3a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:35.170922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2da00-a2f8-46fc-aa28-787d7c9d4cfe None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:35.173789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-cdbd42a9-211c-40c7-9a37-bed223fb3a5c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:35.175207 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cdbd42a9-211c-40c7-9a37-bed223fb3a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:35.237414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8204b-cf0d-4940-ae5e-8e84845f3084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:35.238701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:35.240215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8204b-cf0d-4940-ae5e-8e84845f3084 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:35.241235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8204b-cf0d-4940-ae5e-8e84845f3084 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:35.241860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8204b-cf0d-4940-ae5e-8e84845f3084 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:35.243431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8204b-cf0d-4940-ae5e-8e84845f3084 None admin] RBAC: Adding query filter params (role.id=b83f9277d44246c5983fe3b6d7d5af96, scope.project.id=0d82d9815c484e6abe046fa9caa21713, user.id=46c872e328434282b3701809ac124192) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:35.244432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8204b-cf0d-4940-ae5e-8e84845f3084 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:35.247591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8204b-cf0d-4940-ae5e-8e84845f3084 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:35.262353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 145/295] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:35 2022] GET /identity/v3/role_assignments?user.id=46c872e328434282b3701809ac124192&scope.project.id=0d82d9815c484e6abe046fa9caa21713&role.id=b83f9277d44246c5983fe3b6d7d5af96 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:35.299058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 151/296] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:35.315445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8204b-cf0d-4940-ae5e-8e84845f3084 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:35.379619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:35.426104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8204b-cf0d-4940-ae5e-8e84845f3084 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:35.463856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a231d09-feed-4ca2-9bb9-6be96b2d0c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:35.464522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a231d09-feed-4ca2-9bb9-6be96b2d0c81 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:35.464805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a231d09-feed-4ca2-9bb9-6be96b2d0c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:35.465085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a231d09-feed-4ca2-9bb9-6be96b2d0c81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:35.477005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a231d09-feed-4ca2-9bb9-6be96b2d0c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-6a231d09-feed-4ca2-9bb9-6be96b2d0c81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:35.482889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:35.483856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:35.484645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 146/297] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:35.491713 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd42a9-211c-40c7-9a37-bed223fb3a5c None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:35.598183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd42a9-211c-40c7-9a37-bed223fb3a5c None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:35.636252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d89f91-6bca-4e9f-8766-cdb7a19f214a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:35.636875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d89f91-6bca-4e9f-8766-cdb7a19f214a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:35.637154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d89f91-6bca-4e9f-8766-cdb7a19f214a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:35.637429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d89f91-6bca-4e9f-8766-cdb7a19f214a None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:35.638205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d89f91-6bca-4e9f-8766-cdb7a19f214a None admin] RBAC: Adding query filter params (name=member) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:35.638532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d89f91-6bca-4e9f-8766-cdb7a19f214a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:35.639990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d89f91-6bca-4e9f-8766-cdb7a19f214a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:35.653532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 152/298] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:35.659200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a231d09-feed-4ca2-9bb9-6be96b2d0c81 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:35.659943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596e214-869a-4fce-9026-9debf948c355 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:35.660244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596e214-869a-4fce-9026-9debf948c355 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:35.660531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596e214-869a-4fce-9026-9debf948c355 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:35.662167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 153/299] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:35.668075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcef6c-9a68-4584-87f7-7cef911f31a3 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:35.668382 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcef6c-9a68-4584-87f7-7cef911f31a3 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:35.668669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcef6c-9a68-4584-87f7-7cef911f31a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:35.689934 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f6bcef6c-9a68-4584-87f7-7cef911f31a3 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:35.691828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f6bcef6c-9a68-4584-87f7-7cef911f31a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:35.726841 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:35.778900 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 154/300] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:35.780197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fd5fe-edea-4e8d-9b9a-629ad4f5e29c None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:35.780478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fd5fe-edea-4e8d-9b9a-629ad4f5e29c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:35.780757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fd5fe-edea-4e8d-9b9a-629ad4f5e29c None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:35.782080 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 155/301] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:35.783214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edb12f-307f-4705-8743-4bbbd55e6faa None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:35.783643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edb12f-307f-4705-8743-4bbbd55e6faa None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:35.784064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edb12f-307f-4705-8743-4bbbd55e6faa None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:35.786794 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a231d09-feed-4ca2-9bb9-6be96b2d0c81 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:35.789537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 156/302] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:35.790606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b38958-7c8f-4158-8656-e98efb40bdf8 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:35.790896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b38958-7c8f-4158-8656-e98efb40bdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:35.791173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b38958-7c8f-4158-8656-e98efb40bdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:35.802418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:35.810441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-65b38958-7c8f-4158-8656-e98efb40bdf8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:35.811657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-65b38958-7c8f-4158-8656-e98efb40bdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:35.824312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec1da8-d2c5-4f41-8681-65af3c4e1167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:35.824957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1da8-d2c5-4f41-8681-65af3c4e1167 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:35.825243 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1da8-d2c5-4f41-8681-65af3c4e1167 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:35.825519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1da8-d2c5-4f41-8681-65af3c4e1167 None admin] PATH_INFO: `/v3/users/b8d67e913cf14dd5b17994f6f70bcc19` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:35.826743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec1da8-d2c5-4f41-8681-65af3c4e1167 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d67e913cf14dd5b17994f6f70bcc19)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:35.828181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec1da8-d2c5-4f41-8681-65af3c4e1167 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:35.829792 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 147/303] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:35 2022] GET /identity/v3/users/b8d67e913cf14dd5b17994f6f70bcc19 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:35.830935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c591b4-85ef-44bb-931b-e3c93c827951 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:35.831224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c591b4-85ef-44bb-931b-e3c93c827951 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:35.831840 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c591b4-85ef-44bb-931b-e3c93c827951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:35.849416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-78c591b4-85ef-44bb-931b-e3c93c827951 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:35.850558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-78c591b4-85ef-44bb-931b-e3c93c827951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:35.880880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 157/304] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:35.881635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b38958-7c8f-4158-8656-e98efb40bdf8 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:35.924123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 148/305] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:35.925146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c591b4-85ef-44bb-931b-e3c93c827951 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:35.980203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:35.990164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b38958-7c8f-4158-8656-e98efb40bdf8 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:36.025297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b3833-bd76-4f36-bbb8-a135ef870b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:36.025793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c591b4-85ef-44bb-931b-e3c93c827951 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:36.025939 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b3833-bd76-4f36-bbb8-a135ef870b62 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:36.026220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b3833-bd76-4f36-bbb8-a135ef870b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:36.026510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b3833-bd76-4f36-bbb8-a135ef870b62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:36.036501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b3833-bd76-4f36-bbb8-a135ef870b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-d59b3833-bd76-4f36-bbb8-a135ef870b62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:36.041995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:36.043062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:36.043861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 158/306] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:36.044509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b3833-bd76-4f36-bbb8-a135ef870b62 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:36.045316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:36.066238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04635fc7-ff15-45bb-88d1-9f4d653da1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:36.066958 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04635fc7-ff15-45bb-88d1-9f4d653da1c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:36.067244 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04635fc7-ff15-45bb-88d1-9f4d653da1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:36.067522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04635fc7-ff15-45bb-88d1-9f4d653da1c0 None admin] PATH_INFO: `/v3/system/users/b8d67e913cf14dd5b17994f6f70bcc19/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:36.068973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04635fc7-ff15-45bb-88d1-9f4d653da1c0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b8d67e913cf14dd5b17994f6f70bcc19, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:36.070357 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04635fc7-ff15-45bb-88d1-9f4d653da1c0 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:36.145424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b3833-bd76-4f36-bbb8-a135ef870b62 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:36.164706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 149/307] 10.222.0.60 () {58 vars in 1334 bytes} [Thu Aug 4 02:18:35 2022] PUT /identity/v3/system/users/b8d67e913cf14dd5b17994f6f70bcc19/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:18:36.165882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04635fc7-ff15-45bb-88d1-9f4d653da1c0 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:36.181316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d721de0-9e97-41ba-9866-796e03d4fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:36.183176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d721de0-9e97-41ba-9866-796e03d4fe9d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:36.186528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d721de0-9e97-41ba-9866-796e03d4fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:36.186528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d721de0-9e97-41ba-9866-796e03d4fe9d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:36.197646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d721de0-9e97-41ba-9866-796e03d4fe9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-3d721de0-9e97-41ba-9866-796e03d4fe9d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:36.203405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:36.204567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:36.205571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:36.205571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:36.205571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:36.205571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:36.205571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:36.205571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:36.205571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:36.205571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:36.205571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:36.205571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:36.205571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:36.205571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:36.207760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 159/308] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:36.208865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d721de0-9e97-41ba-9866-796e03d4fe9d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:36.225452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:36.296461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04635fc7-ff15-45bb-88d1-9f4d653da1c0 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:36.335492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d721de0-9e97-41ba-9866-796e03d4fe9d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:36.340652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13a97c-1506-48a3-97e8-c100e89ac3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:36.341309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13a97c-1506-48a3-97e8-c100e89ac3ab None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:36.341593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13a97c-1506-48a3-97e8-c100e89ac3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:36.341868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13a97c-1506-48a3-97e8-c100e89ac3ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:36.343076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13a97c-1506-48a3-97e8-c100e89ac3ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:36.344546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13a97c-1506-48a3-97e8-c100e89ac3ab None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:36.346362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 150/309] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:36.346918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13a97c-1506-48a3-97e8-c100e89ac3ab None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:36.375072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436a45d-35d6-40ba-b1f7-fdb99afedff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:36.375696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436a45d-35d6-40ba-b1f7-fdb99afedff9 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:36.375980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436a45d-35d6-40ba-b1f7-fdb99afedff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:36.376255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436a45d-35d6-40ba-b1f7-fdb99afedff9 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:36.376973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436a45d-35d6-40ba-b1f7-fdb99afedff9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:36.377278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436a45d-35d6-40ba-b1f7-fdb99afedff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:36.378692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436a45d-35d6-40ba-b1f7-fdb99afedff9 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:36.387192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 160/310] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:36.388016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436a45d-35d6-40ba-b1f7-fdb99afedff9 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:36.400525 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:36.460591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13a97c-1506-48a3-97e8-c100e89ac3ab None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:36.463620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:36.498768 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436a45d-35d6-40ba-b1f7-fdb99afedff9 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:36.499110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e159ed-d208-41a3-aa1b-77164616fb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:36.499717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e159ed-d208-41a3-aa1b-77164616fb9a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:36.500034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e159ed-d208-41a3-aa1b-77164616fb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:36.500477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e159ed-d208-41a3-aa1b-77164616fb9a None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:36.502005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e159ed-d208-41a3-aa1b-77164616fb9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:36.502335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e159ed-d208-41a3-aa1b-77164616fb9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:36.503760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e159ed-d208-41a3-aa1b-77164616fb9a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:36.518891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 151/311] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:36.518891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e159ed-d208-41a3-aa1b-77164616fb9a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:36.534188 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286421a9-f7fb-4a08-b34c-d2aac5f38a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:36.534874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286421a9-f7fb-4a08-b34c-d2aac5f38a0d None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:36.535157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286421a9-f7fb-4a08-b34c-d2aac5f38a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:36.535430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286421a9-f7fb-4a08-b34c-d2aac5f38a0d None admin] PATH_INFO: `/v3/groups` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:36.536095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286421a9-f7fb-4a08-b34c-d2aac5f38a0d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:36.537611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286421a9-f7fb-4a08-b34c-d2aac5f38a0d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:36.604593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 161/312] 10.222.0.60 () {60 vars in 1134 bytes} [Thu Aug 4 02:18:36 2022] POST /identity/v3/groups => generated 229 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:18:36.605559 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286421a9-f7fb-4a08-b34c-d2aac5f38a0d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:36.643257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e159ed-d208-41a3-aa1b-77164616fb9a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:36.652791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:36.687015 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a62a4-4337-422e-bafa-a7c855235c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:36.688022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a62a4-4337-422e-bafa-a7c855235c92 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:36.690899 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a62a4-4337-422e-bafa-a7c855235c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:36.691467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a62a4-4337-422e-bafa-a7c855235c92 None admin] PATH_INFO: `/v3/users/50fa1522decd4886909622474ffc9686` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:36.692908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a62a4-4337-422e-bafa-a7c855235c92 None admin] RBAC: Authorizing `identity:get_user(user_id=50fa1522decd4886909622474ffc9686)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:36.694557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a62a4-4337-422e-bafa-a7c855235c92 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:36.696778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 152/313] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:36 2022] GET /identity/v3/users/50fa1522decd4886909622474ffc9686 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:36.704683 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a62a4-4337-422e-bafa-a7c855235c92 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:36.756537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286421a9-f7fb-4a08-b34c-d2aac5f38a0d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:36.793136 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:36.798073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573f70-af20-4691-9c42-ee9f034bc11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:36.798944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573f70-af20-4691-9c42-ee9f034bc11a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:36.799361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573f70-af20-4691-9c42-ee9f034bc11a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:36.799641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573f70-af20-4691-9c42-ee9f034bc11a None admin] PATH_INFO: `/v3/users/d48f43a67b84470e9b5038f358455e22` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:36.817558 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6573f70-af20-4691-9c42-ee9f034bc11a None admin] RBAC: Authorizing `identity:get_user(user_id=d48f43a67b84470e9b5038f358455e22)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:36.819175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6573f70-af20-4691-9c42-ee9f034bc11a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:36.820999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 162/314] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:36 2022] GET /identity/v3/users/d48f43a67b84470e9b5038f358455e22 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:36.828112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573f70-af20-4691-9c42-ee9f034bc11a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:36.833255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a62a4-4337-422e-bafa-a7c855235c92 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:36.879314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971b660-d5ad-4317-9729-aca8a200864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:36.879314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971b660-d5ad-4317-9729-aca8a200864b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:36.879610 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971b660-d5ad-4317-9729-aca8a200864b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:36.879858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971b660-d5ad-4317-9729-aca8a200864b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:36.940219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:36.968055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971b660-d5ad-4317-9729-aca8a200864b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:36.968811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6573f70-af20-4691-9c42-ee9f034bc11a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:36.969575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971b660-d5ad-4317-9729-aca8a200864b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:37.015825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be913c2-9aa6-48e4-85c9-5864cbef59db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:37.017318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be913c2-9aa6-48e4-85c9-5864cbef59db None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:37.017833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be913c2-9aa6-48e4-85c9-5864cbef59db None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:37.018315 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be913c2-9aa6-48e4-85c9-5864cbef59db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:37.019849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be913c2-9aa6-48e4-85c9-5864cbef59db None admin] RBAC: Adding query filter params (role.id=da2284a36aac460aa87d838a8734cab3, user.id=d48f43a67b84470e9b5038f358455e22, scope.system=all) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:37.020782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be913c2-9aa6-48e4-85c9-5864cbef59db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:37.023020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be913c2-9aa6-48e4-85c9-5864cbef59db None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:37.030299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 163/315] 10.222.0.60 () {56 vars in 1308 bytes} [Thu Aug 4 02:18:36 2022] GET /identity/v3/role_assignments?user.id=d48f43a67b84470e9b5038f358455e22&scope.system=all&role.id=da2284a36aac460aa87d838a8734cab3 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:37.092477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 153/316] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:37.099593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be913c2-9aa6-48e4-85c9-5864cbef59db None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:37.163889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:37.220841 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be913c2-9aa6-48e4-85c9-5864cbef59db None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:37.260308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3884d6-dd3c-43d6-9b07-381961834062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:37.261032 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3884d6-dd3c-43d6-9b07-381961834062 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:37.261365 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3884d6-dd3c-43d6-9b07-381961834062 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:37.261651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3884d6-dd3c-43d6-9b07-381961834062 None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:37.262952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3884d6-dd3c-43d6-9b07-381961834062 None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:37.264427 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3884d6-dd3c-43d6-9b07-381961834062 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:37.266424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 164/317] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:37 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:37.272247 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971b660-d5ad-4317-9729-aca8a200864b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:37.365105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:37.393100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971b660-d5ad-4317-9729-aca8a200864b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:37.430263 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c966477-14ad-40ba-af9f-71224fa878f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:37.431318 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c966477-14ad-40ba-af9f-71224fa878f4 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:37.431852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c966477-14ad-40ba-af9f-71224fa878f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:37.433000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c966477-14ad-40ba-af9f-71224fa878f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:37.434261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c966477-14ad-40ba-af9f-71224fa878f4 None admin] RBAC: Adding query filter params (role.id=da2284a36aac460aa87d838a8734cab3, scope.project.id=0d82d9815c484e6abe046fa9caa21713, user.id=50fa1522decd4886909622474ffc9686) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:37.434795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c966477-14ad-40ba-af9f-71224fa878f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:37.436443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c966477-14ad-40ba-af9f-71224fa878f4 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:37.443506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 154/318] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:18:37 2022] GET /identity/v3/role_assignments?user.id=50fa1522decd4886909622474ffc9686&scope.project.id=0d82d9815c484e6abe046fa9caa21713&role.id=da2284a36aac460aa87d838a8734cab3 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:38.256821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6603de6-03e8-410d-b628-5ac693f2e55b None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:38.257341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6603de6-03e8-410d-b628-5ac693f2e55b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:38.257419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6603de6-03e8-410d-b628-5ac693f2e55b None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:38.258920 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 165/319] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:38.265554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e591d4f-69a3-4e2e-9a64-299898712dc8 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:38.265977 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e591d4f-69a3-4e2e-9a64-299898712dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:38.266118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e591d4f-69a3-4e2e-9a64-299898712dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:38.285614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-5e591d4f-69a3-4e2e-9a64-299898712dc8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:38.286850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5e591d4f-69a3-4e2e-9a64-299898712dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:38.360214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 155/320] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:38.383182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6603de6-03e8-410d-b628-5ac693f2e55b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:38.488983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6603de6-03e8-410d-b628-5ac693f2e55b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:38.510919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:38.522593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512afec-4db7-41c3-a38e-9f68895da5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:38.529650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512afec-4db7-41c3-a38e-9f68895da5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:38.529650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512afec-4db7-41c3-a38e-9f68895da5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:38.529650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512afec-4db7-41c3-a38e-9f68895da5d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:38.535107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512afec-4db7-41c3-a38e-9f68895da5d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-9512afec-4db7-41c3-a38e-9f68895da5d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:38.540092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:38.541121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:38.542881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:38.542881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:38.542881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:38.542881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:38.542881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:38.542881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:38.542881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:38.542881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:38.542881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:38.542881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:38.542881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:38.542881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:38.546875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 166/321] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:38.547917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e591d4f-69a3-4e2e-9a64-299898712dc8 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:38.613981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:38.649314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e591d4f-69a3-4e2e-9a64-299898712dc8 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:38.684153 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef36ed-0511-46f8-864c-5077b69b306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:38.684770 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef36ed-0511-46f8-864c-5077b69b306b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:38.685050 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef36ed-0511-46f8-864c-5077b69b306b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:38.685322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef36ed-0511-46f8-864c-5077b69b306b None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:38.686033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef36ed-0511-46f8-864c-5077b69b306b None admin] RBAC: Adding query filter params (name=member) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:38.686333 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef36ed-0511-46f8-864c-5077b69b306b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:38.688023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef36ed-0511-46f8-864c-5077b69b306b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:38.696292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 156/322] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:38.701649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512afec-4db7-41c3-a38e-9f68895da5d5 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:38.755419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af2c6e-960b-448c-b741-be864f1e91c8 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:38.755761 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af2c6e-960b-448c-b741-be864f1e91c8 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:38.755985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af2c6e-960b-448c-b741-be864f1e91c8 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:38.757483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 157/323] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:18:38.762740 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6f3f0-b698-491d-8ac6-5a74c882b8c3 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:38.763050 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6f3f0-b698-491d-8ac6-5a74c882b8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:38.763314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6f3f0-b698-491d-8ac6-5a74c882b8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:38.781098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b8a6f3f0-b698-491d-8ac6-5a74c882b8c3 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:38.782290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b8a6f3f0-b698-491d-8ac6-5a74c882b8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:38.806665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512afec-4db7-41c3-a38e-9f68895da5d5 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:38.846725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d6bc1-de3e-4ad1-9680-b50ece487fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:38.847373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d6bc1-de3e-4ad1-9680-b50ece487fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:38.847656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d6bc1-de3e-4ad1-9680-b50ece487fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:38.847957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d6bc1-de3e-4ad1-9680-b50ece487fd0 None admin] PATH_INFO: `/v3/users/b8d67e913cf14dd5b17994f6f70bcc19` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:38.849076 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d6bc1-de3e-4ad1-9680-b50ece487fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d67e913cf14dd5b17994f6f70bcc19)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:38.850527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d6bc1-de3e-4ad1-9680-b50ece487fd0 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:38.852416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 167/324] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:38 2022] GET /identity/v3/users/b8d67e913cf14dd5b17994f6f70bcc19 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:38.858527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 158/325] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:38.859805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d6bc1-de3e-4ad1-9680-b50ece487fd0 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:38.878172 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6f3f0-b698-491d-8ac6-5a74c882b8c3 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:38.912908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:38.940673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:38.968402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d6bc1-de3e-4ad1-9680-b50ece487fd0 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:38.984208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6f3f0-b698-491d-8ac6-5a74c882b8c3 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:39.003841 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dd4b5-30c5-42ef-99cd-27d4b3519581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:39.004462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dd4b5-30c5-42ef-99cd-27d4b3519581 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:39.004746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dd4b5-30c5-42ef-99cd-27d4b3519581 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:39.005024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dd4b5-30c5-42ef-99cd-27d4b3519581 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:39.005812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dd4b5-30c5-42ef-99cd-27d4b3519581 None admin] RBAC: Adding query filter params (role.id=b83f9277d44246c5983fe3b6d7d5af96, user.id=b8d67e913cf14dd5b17994f6f70bcc19, scope.system=all) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:39.006124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dd4b5-30c5-42ef-99cd-27d4b3519581 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:39.008114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dd4b5-30c5-42ef-99cd-27d4b3519581 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:39.020712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93583acc-6c27-4b1e-b72f-bab3d5ceb51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:39.020889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 168/326] 10.222.0.60 () {56 vars in 1308 bytes} [Thu Aug 4 02:18:38 2022] GET /identity/v3/role_assignments?user.id=b8d67e913cf14dd5b17994f6f70bcc19&scope.system=all&role.id=b83f9277d44246c5983fe3b6d7d5af96 => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:39.021125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583acc-6c27-4b1e-b72f-bab3d5ceb51e None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:39.021391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583acc-6c27-4b1e-b72f-bab3d5ceb51e None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:39.021661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583acc-6c27-4b1e-b72f-bab3d5ceb51e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:39.022834 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93583acc-6c27-4b1e-b72f-bab3d5ceb51e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:39.024301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93583acc-6c27-4b1e-b72f-bab3d5ceb51e None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:39.026205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 159/327] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:39.031960 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dd4b5-30c5-42ef-99cd-27d4b3519581 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:39.129003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2768b-7c8d-4cbf-9b0f-22ff541420a7 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:39.129248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2768b-7c8d-4cbf-9b0f-22ff541420a7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:39.129471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2768b-7c8d-4cbf-9b0f-22ff541420a7 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:39.130919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 160/328] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:18:39.137128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a324bd-4d32-49e6-9215-a19efa346f69 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:39.137421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a324bd-4d32-49e6-9215-a19efa346f69 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:39.137691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a324bd-4d32-49e6-9215-a19efa346f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:39.151652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dd4b5-30c5-42ef-99cd-27d4b3519581 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:39.158255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c9a324bd-4d32-49e6-9215-a19efa346f69 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:39.159523 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c9a324bd-4d32-49e6-9215-a19efa346f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:39.161845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:39.188528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dbc3f-9c85-44ac-a6b6-68c7ca05a664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:39.189169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dbc3f-9c85-44ac-a6b6-68c7ca05a664 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:39.189443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dbc3f-9c85-44ac-a6b6-68c7ca05a664 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:39.189728 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dbc3f-9c85-44ac-a6b6-68c7ca05a664 None admin] PATH_INFO: `/v3/groups` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:39.190423 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dbc3f-9c85-44ac-a6b6-68c7ca05a664 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:39.191956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dbc3f-9c85-44ac-a6b6-68c7ca05a664 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:39.237191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 161/329] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:39.259463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a324bd-4d32-49e6-9215-a19efa346f69 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:39.283970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 169/330] 10.222.0.60 () {60 vars in 1134 bytes} [Thu Aug 4 02:18:39 2022] POST /identity/v3/groups => generated 226 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:18:39.321201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:39.365241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a324bd-4d32-49e6-9215-a19efa346f69 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:39.402275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381788a8-f278-4531-a6a9-6e5676ad7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:39.402899 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381788a8-f278-4531-a6a9-6e5676ad7502 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:39.403220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381788a8-f278-4531-a6a9-6e5676ad7502 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:39.403524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381788a8-f278-4531-a6a9-6e5676ad7502 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:39.414398 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381788a8-f278-4531-a6a9-6e5676ad7502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-381788a8-f278-4531-a6a9-6e5676ad7502 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:39.419584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:39.420496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:39.421471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 162/331] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:18:39.426747 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dbc3f-9c85-44ac-a6b6-68c7ca05a664 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:39.533390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dbc3f-9c85-44ac-a6b6-68c7ca05a664 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:39.569709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739ac85-4fc6-43af-9b41-7668a9665073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:39.570334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739ac85-4fc6-43af-9b41-7668a9665073 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:39.570668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739ac85-4fc6-43af-9b41-7668a9665073 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:39.570949 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739ac85-4fc6-43af-9b41-7668a9665073 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:39.571675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739ac85-4fc6-43af-9b41-7668a9665073 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:39.571989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739ac85-4fc6-43af-9b41-7668a9665073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:39.574007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739ac85-4fc6-43af-9b41-7668a9665073 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:39.583230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 170/332] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:39.589256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381788a8-f278-4531-a6a9-6e5676ad7502 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:39.704487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381788a8-f278-4531-a6a9-6e5676ad7502 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:39.723292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:39.741532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d5b85-4757-49af-9d82-18311ed70c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:39.742180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d5b85-4757-49af-9d82-18311ed70c2e None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:39.742459 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d5b85-4757-49af-9d82-18311ed70c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:39.742783 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d5b85-4757-49af-9d82-18311ed70c2e None admin] PATH_INFO: `/v3/users/d48f43a67b84470e9b5038f358455e22` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:39.743953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d5b85-4757-49af-9d82-18311ed70c2e None admin] RBAC: Authorizing `identity:get_user(user_id=d48f43a67b84470e9b5038f358455e22)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:39.745453 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d5b85-4757-49af-9d82-18311ed70c2e None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:39.747423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 163/333] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:39 2022] GET /identity/v3/users/d48f43a67b84470e9b5038f358455e22 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:39.753143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739ac85-4fc6-43af-9b41-7668a9665073 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:39.789915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:39.867541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739ac85-4fc6-43af-9b41-7668a9665073 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:39.906717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fa995-0b55-46a5-afb0-5f780b9ff90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:39.907620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fa995-0b55-46a5-afb0-5f780b9ff90d None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:39.908049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fa995-0b55-46a5-afb0-5f780b9ff90d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:39.908469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fa995-0b55-46a5-afb0-5f780b9ff90d None admin] PATH_INFO: `/v3/system/users/d48f43a67b84470e9b5038f358455e22/roles/da2284a36aac460aa87d838a8734cab3` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:39.910279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fa995-0b55-46a5-afb0-5f780b9ff90d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d48f43a67b84470e9b5038f358455e22, role_id=da2284a36aac460aa87d838a8734cab3)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:39.911916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fa995-0b55-46a5-afb0-5f780b9ff90d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:39.995712 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 171/334] 10.222.0.60 () {58 vars in 1334 bytes} [Thu Aug 4 02:18:39 2022] PUT /identity/v3/system/users/d48f43a67b84470e9b5038f358455e22/roles/da2284a36aac460aa87d838a8734cab3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:18:42.146831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec41095-dc0b-4fc0-a825-7ff80e27c315 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:42.147332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec41095-dc0b-4fc0-a825-7ff80e27c315 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:42.147433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec41095-dc0b-4fc0-a825-7ff80e27c315 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:42.148977 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 164/335] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:42.154033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be27019-1cf5-4526-810f-1eb957924c95 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:42.154466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be27019-1cf5-4526-810f-1eb957924c95 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:42.154662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be27019-1cf5-4526-810f-1eb957924c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:42.180280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2be27019-1cf5-4526-810f-1eb957924c95 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:42.181507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2be27019-1cf5-4526-810f-1eb957924c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:42.263741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 172/336] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:42.308746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec41095-dc0b-4fc0-a825-7ff80e27c315 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:42.435112 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec41095-dc0b-4fc0-a825-7ff80e27c315 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:42.480415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa389fc-f482-4076-a177-5c531d3b91ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:42.481067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa389fc-f482-4076-a177-5c531d3b91ff None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:42.481347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa389fc-f482-4076-a177-5c531d3b91ff None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:42.481618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa389fc-f482-4076-a177-5c531d3b91ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:42.498256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa389fc-f482-4076-a177-5c531d3b91ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-afa389fc-f482-4076-a177-5c531d3b91ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:42.503614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:42.504560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:42.505774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 165/337] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:42.513646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be27019-1cf5-4526-810f-1eb957924c95 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:42.525804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdef242-bea6-49ed-a71e-5384a8a4b035 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:42.526185 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdef242-bea6-49ed-a71e-5384a8a4b035 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:42.526411 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdef242-bea6-49ed-a71e-5384a8a4b035 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:42.527822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 166/338] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:18:42.535966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483260a-4430-4578-aef3-b0a5804153c7 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:42.536256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483260a-4430-4578-aef3-b0a5804153c7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:42.536474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483260a-4430-4578-aef3-b0a5804153c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:42.563670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:42.575829 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-5483260a-4430-4578-aef3-b0a5804153c7 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:42.578568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5483260a-4430-4578-aef3-b0a5804153c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:42.674276 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:42.678994 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 167/339] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 04 02:18:42.681044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4cdfe-6630-478a-a61e-bb2a725e1cac None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:42.681405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4cdfe-6630-478a-a61e-bb2a725e1cac None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:42.682475 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4cdfe-6630-478a-a61e-bb2a725e1cac None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:42.683377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be27019-1cf5-4526-810f-1eb957924c95 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:42.684163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 168/340] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:42.685328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6315cf-a44a-42f7-b152-680308c53c4f None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:42.685649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6315cf-a44a-42f7-b152-680308c53c4f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:42.690916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6315cf-a44a-42f7-b152-680308c53c4f None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:42.692482 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 169/341] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:42.693558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b33bb0-bfe7-4b55-b343-aea0a1db8e54 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:42.693843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b33bb0-bfe7-4b55-b343-aea0a1db8e54 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:42.694121 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b33bb0-bfe7-4b55-b343-aea0a1db8e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:42.726227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-75b33bb0-bfe7-4b55-b343-aea0a1db8e54 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:42.727469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-75b33bb0-bfe7-4b55-b343-aea0a1db8e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:42.734956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bee62-3983-47f3-b963-dbb978d780b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:42.735595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bee62-3983-47f3-b963-dbb978d780b8 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:42.735884 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bee62-3983-47f3-b963-dbb978d780b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:42.736163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bee62-3983-47f3-b963-dbb978d780b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:42.736891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bee62-3983-47f3-b963-dbb978d780b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:42.737203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bee62-3983-47f3-b963-dbb978d780b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:42.738687 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bee62-3983-47f3-b963-dbb978d780b8 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:42.749116 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 173/342] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:42.750536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d41750-1b21-41bf-ab3a-b397950ba225 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:42.750835 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d41750-1b21-41bf-ab3a-b397950ba225 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:42.751115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d41750-1b21-41bf-ab3a-b397950ba225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:42.769943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-d7d41750-1b21-41bf-ab3a-b397950ba225 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:42.771216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d7d41750-1b21-41bf-ab3a-b397950ba225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:42.826785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 170/343] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:42.827675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b33bb0-bfe7-4b55-b343-aea0a1db8e54 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:42.846796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 174/344] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:42.847615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d41750-1b21-41bf-ab3a-b397950ba225 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:42.874442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:42.960321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b33bb0-bfe7-4b55-b343-aea0a1db8e54 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:42.969089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:42.975370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d41750-1b21-41bf-ab3a-b397950ba225 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:43.008193 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa7690-fd39-4ff5-819a-2e80b7245c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:43.008938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa7690-fd39-4ff5-819a-2e80b7245c3c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.009227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa7690-fd39-4ff5-819a-2e80b7245c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.009506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa7690-fd39-4ff5-819a-2e80b7245c3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.016162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331f999-7561-49b2-a533-a1eb39e6bc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:43.016162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331f999-7561-49b2-a533-a1eb39e6bc90 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.016162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331f999-7561-49b2-a533-a1eb39e6bc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.016456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331f999-7561-49b2-a533-a1eb39e6bc90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.032998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa7690-fd39-4ff5-819a-2e80b7245c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-36fa7690-fd39-4ff5-819a-2e80b7245c3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:43.039065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:43.039945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:43.040742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:43.040742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:43.040742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:43.040742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:43.040742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:43.040742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:43.040742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:43.040742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:43.040742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:43.040742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:43.040742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:43.040742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:43.043945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 171/345] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:43.047824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa7690-fd39-4ff5-819a-2e80b7245c3c None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:43.106160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331f999-7561-49b2-a533-a1eb39e6bc90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:43.107627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331f999-7561-49b2-a533-a1eb39e6bc90 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:43.126767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:43.173027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa7690-fd39-4ff5-819a-2e80b7245c3c None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:43.224409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bece4c-9e97-4f7c-9892-1e383195419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:43.225073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 175/346] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:43.225917 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331f999-7561-49b2-a533-a1eb39e6bc90 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:43.229654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bece4c-9e97-4f7c-9892-1e383195419f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.230007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bece4c-9e97-4f7c-9892-1e383195419f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.230298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bece4c-9e97-4f7c-9892-1e383195419f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.251703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bece4c-9e97-4f7c-9892-1e383195419f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-45bece4c-9e97-4f7c-9892-1e383195419f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:43.257888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:43.258854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:43.259947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 172/347] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:43.261871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bece4c-9e97-4f7c-9892-1e383195419f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:43.298174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:43.376525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331f999-7561-49b2-a533-a1eb39e6bc90 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:43.394278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:43.405327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bece4c-9e97-4f7c-9892-1e383195419f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:43.425216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24453a-698c-442a-b44e-cda04605693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:43.425883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24453a-698c-442a-b44e-cda04605693b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.426168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24453a-698c-442a-b44e-cda04605693b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.426460 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24453a-698c-442a-b44e-cda04605693b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.440582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24453a-698c-442a-b44e-cda04605693b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-dd24453a-698c-442a-b44e-cda04605693b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:43.446093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:43.447279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:43.448299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 176/348] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:43.448948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1516-823f-4048-a5ae-b28f8d85f63a None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.449132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1516-823f-4048-a5ae-b28f8d85f63a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.449409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1516-823f-4048-a5ae-b28f8d85f63a None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.450953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 177/349] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:43.451656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc1516-823f-4048-a5ae-b28f8d85f63a None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:43.459110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b734-fe71-4e4d-ac8c-e1e5862ec565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:43.459648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b734-fe71-4e4d-ac8c-e1e5862ec565 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.461526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b734-fe71-4e4d-ac8c-e1e5862ec565 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.461526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b734-fe71-4e4d-ac8c-e1e5862ec565 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.461526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8b734-fe71-4e4d-ac8c-e1e5862ec565 None admin] RBAC: Adding query filter params (name=member) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:43.462061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8b734-fe71-4e4d-ac8c-e1e5862ec565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:43.464645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8b734-fe71-4e4d-ac8c-e1e5862ec565 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:43.475067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 173/350] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:43.482248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b734-fe71-4e4d-ac8c-e1e5862ec565 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:43.568108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc1516-823f-4048-a5ae-b28f8d85f63a None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:43.590409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:43.606052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697703a-791a-4822-8388-93703de91c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:43.606303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b734-fe71-4e4d-ac8c-e1e5862ec565 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:43.608792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697703a-791a-4822-8388-93703de91c36 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.608792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697703a-791a-4822-8388-93703de91c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.608792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697703a-791a-4822-8388-93703de91c36 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.609663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697703a-791a-4822-8388-93703de91c36 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:43.611220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697703a-791a-4822-8388-93703de91c36 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:43.613564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 178/351] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:43 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:43.614125 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697703a-791a-4822-8388-93703de91c36 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:43.655188 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b9f7b-08cf-4ccf-9a61-5eaa91ad3e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:43.655188 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9f7b-08cf-4ccf-9a61-5eaa91ad3e0f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.655188 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9f7b-08cf-4ccf-9a61-5eaa91ad3e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.655188 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9f7b-08cf-4ccf-9a61-5eaa91ad3e0f None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.655559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9f7b-08cf-4ccf-9a61-5eaa91ad3e0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:43.655559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9f7b-08cf-4ccf-9a61-5eaa91ad3e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:43.655886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b9f7b-08cf-4ccf-9a61-5eaa91ad3e0f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:43.664393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 174/352] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:18:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:43.665428 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:43.665678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5ac7-2ef3-48f1-a3ee-9675aa729813 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.666931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5ac7-2ef3-48f1-a3ee-9675aa729813 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.667369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5ac7-2ef3-48f1-a3ee-9675aa729813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.688220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f0aa5ac7-2ef3-48f1-a3ee-9675aa729813 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:43.689431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f0aa5ac7-2ef3-48f1-a3ee-9675aa729813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:43.732870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697703a-791a-4822-8388-93703de91c36 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:43.776212 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 175/353] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:43.777044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa5ac7-2ef3-48f1-a3ee-9675aa729813 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:43.777915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8917834-1f39-44e4-a413-b87c12e9a4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:43.778590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917834-1f39-44e4-a413-b87c12e9a4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.778881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917834-1f39-44e4-a413-b87c12e9a4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.779170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8917834-1f39-44e4-a413-b87c12e9a4d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.779899 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8917834-1f39-44e4-a413-b87c12e9a4d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:43.780210 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8917834-1f39-44e4-a413-b87c12e9a4d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:43.782824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8917834-1f39-44e4-a413-b87c12e9a4d9 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:43.792375 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 179/354] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:43.793632 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051d029-5a93-43e7-beaf-ccdc74dad7a9 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.793927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051d029-5a93-43e7-beaf-ccdc74dad7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.794211 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051d029-5a93-43e7-beaf-ccdc74dad7a9 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.796319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 180/355] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:43.797094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051d029-5a93-43e7-beaf-ccdc74dad7a9 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:43.885417 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:43.905868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa5ac7-2ef3-48f1-a3ee-9675aa729813 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:43.924826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051d029-5a93-43e7-beaf-ccdc74dad7a9 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:43.934374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:43.949815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317d3f6-8ee9-437f-a634-5c9919f171c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:43.950672 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317d3f6-8ee9-437f-a634-5c9919f171c2 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.951101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317d3f6-8ee9-437f-a634-5c9919f171c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.951371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317d3f6-8ee9-437f-a634-5c9919f171c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.963990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48652eac-5cb1-4150-aacb-3f654b0a4a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:43.965015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48652eac-5cb1-4150-aacb-3f654b0a4a0d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:43.965015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48652eac-5cb1-4150-aacb-3f654b0a4a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:43.965194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48652eac-5cb1-4150-aacb-3f654b0a4a0d None admin] PATH_INFO: `/v3/groups/8bf835a1ce7e4d7194393d0b936d1261` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:43.973760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48652eac-5cb1-4150-aacb-3f654b0a4a0d None admin] RBAC: Authorizing `identity:get_group(group_id=8bf835a1ce7e4d7194393d0b936d1261)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:43.975369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48652eac-5cb1-4150-aacb-3f654b0a4a0d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:43.977047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 181/356] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:43 2022] GET /identity/v3/groups/8bf835a1ce7e4d7194393d0b936d1261 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:43.977824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48652eac-5cb1-4150-aacb-3f654b0a4a0d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:44.037988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317d3f6-8ee9-437f-a634-5c9919f171c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:44.040243 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317d3f6-8ee9-437f-a634-5c9919f171c2 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:44.099686 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48652eac-5cb1-4150-aacb-3f654b0a4a0d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:44.142941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6042aa3-d49e-447e-a44d-5ba9c7f8bc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:44.143570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6042aa3-d49e-447e-a44d-5ba9c7f8bc7b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:44.143853 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6042aa3-d49e-447e-a44d-5ba9c7f8bc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:44.144124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6042aa3-d49e-447e-a44d-5ba9c7f8bc7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:44.145164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:44.167818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 176/357] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:44.169203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317d3f6-8ee9-437f-a634-5c9919f171c2 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:44.195001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:44.229560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6042aa3-d49e-447e-a44d-5ba9c7f8bc7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:44.231165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6042aa3-d49e-447e-a44d-5ba9c7f8bc7b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:44.291487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317d3f6-8ee9-437f-a634-5c9919f171c2 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:44.335080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2dc9e-5c0d-43db-b32c-5c35b446bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:44.335732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2dc9e-5c0d-43db-b32c-5c35b446bddf None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:44.336011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2dc9e-5c0d-43db-b32c-5c35b446bddf None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:44.336286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2dc9e-5c0d-43db-b32c-5c35b446bddf None admin] PATH_INFO: `/v3/users/d48f43a67b84470e9b5038f358455e22` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:44.337469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2dc9e-5c0d-43db-b32c-5c35b446bddf None admin] RBAC: Authorizing `identity:get_user(user_id=d48f43a67b84470e9b5038f358455e22)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:44.340091 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2dc9e-5c0d-43db-b32c-5c35b446bddf None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:44.342320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 177/358] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:18:44 2022] GET /identity/v3/users/d48f43a67b84470e9b5038f358455e22 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:44.342606 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1244cfc-7703-4324-a39d-1c9adff1e1e9 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:44.343040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1244cfc-7703-4324-a39d-1c9adff1e1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:44.343143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1244cfc-7703-4324-a39d-1c9adff1e1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:44.350169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 182/359] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:44.350945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6042aa3-d49e-447e-a44d-5ba9c7f8bc7b None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:44.363042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c1244cfc-7703-4324-a39d-1c9adff1e1e9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:44.364232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c1244cfc-7703-4324-a39d-1c9adff1e1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:44.413970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:44.433663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:44.441008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 178/360] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:44.441983 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1244cfc-7703-4324-a39d-1c9adff1e1e9 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:44.471902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6042aa3-d49e-447e-a44d-5ba9c7f8bc7b None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:44.516809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b89d73-4cff-4e28-b6f7-b7665602756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:44.517501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b89d73-4cff-4e28-b6f7-b7665602756c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:44.517794 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b89d73-4cff-4e28-b6f7-b7665602756c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:44.518075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b89d73-4cff-4e28-b6f7-b7665602756c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:44.533947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b89d73-4cff-4e28-b6f7-b7665602756c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-f5b89d73-4cff-4e28-b6f7-b7665602756c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:44.539657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:44.540668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:44.541493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 183/361] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:44.542149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b89d73-4cff-4e28-b6f7-b7665602756c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:44.567172 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1244cfc-7703-4324-a39d-1c9adff1e1e9 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:44.613546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb401e29-9b54-4464-a84a-78b859b7d2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:44.614289 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb401e29-9b54-4464-a84a-78b859b7d2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:44.614610 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb401e29-9b54-4464-a84a-78b859b7d2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:44.615393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb401e29-9b54-4464-a84a-78b859b7d2d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:44.616968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb401e29-9b54-4464-a84a-78b859b7d2d4 None admin] RBAC: Adding query filter params (group.id=8bf835a1ce7e4d7194393d0b936d1261, role.id=b83f9277d44246c5983fe3b6d7d5af96, scope.project.id=b312e6a347184d229a1a2c04149bbe2e) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:44.616968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb401e29-9b54-4464-a84a-78b859b7d2d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:44.618147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb401e29-9b54-4464-a84a-78b859b7d2d4 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:44.625030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 179/362] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Aug 4 02:18:44 2022] GET /identity/v3/role_assignments?group.id=8bf835a1ce7e4d7194393d0b936d1261&scope.project.id=b312e6a347184d229a1a2c04149bbe2e&role.id=b83f9277d44246c5983fe3b6d7d5af96 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:44.625845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb401e29-9b54-4464-a84a-78b859b7d2d4 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:44.674037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b89d73-4cff-4e28-b6f7-b7665602756c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:44.679802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:44.706326 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:44.713951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54150e11-0102-44a1-b904-319d7b4690c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:44.714762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54150e11-0102-44a1-b904-319d7b4690c3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:44.715051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54150e11-0102-44a1-b904-319d7b4690c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:44.715331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54150e11-0102-44a1-b904-319d7b4690c3 None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:44.716557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54150e11-0102-44a1-b904-319d7b4690c3 None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:44.718042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54150e11-0102-44a1-b904-319d7b4690c3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:44.719987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 184/363] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:44 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:44.720581 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54150e11-0102-44a1-b904-319d7b4690c3 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:44.754868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb401e29-9b54-4464-a84a-78b859b7d2d4 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:44.795537 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeae301-7da1-413a-83c0-71db1d7515a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:44.796162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeae301-7da1-413a-83c0-71db1d7515a1 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:44.796450 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeae301-7da1-413a-83c0-71db1d7515a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:44.796790 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeae301-7da1-413a-83c0-71db1d7515a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:44.797594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeae301-7da1-413a-83c0-71db1d7515a1 None admin] RBAC: Adding query filter params (role.id=da2284a36aac460aa87d838a8734cab3, user.id=d48f43a67b84470e9b5038f358455e22, scope.system=all) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:44.797934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeae301-7da1-413a-83c0-71db1d7515a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:44.799422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeae301-7da1-413a-83c0-71db1d7515a1 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:44.812285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 180/364] 10.222.0.60 () {56 vars in 1308 bytes} [Thu Aug 4 02:18:44 2022] GET /identity/v3/role_assignments?user.id=d48f43a67b84470e9b5038f358455e22&scope.system=all&role.id=da2284a36aac460aa87d838a8734cab3 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:44.813116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeae301-7da1-413a-83c0-71db1d7515a1 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:44.853950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54150e11-0102-44a1-b904-319d7b4690c3 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:44.902587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e66d2-a848-48af-b2cf-90033d9ae745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:44.904246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e66d2-a848-48af-b2cf-90033d9ae745 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:44.904717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e66d2-a848-48af-b2cf-90033d9ae745 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:44.905433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e66d2-a848-48af-b2cf-90033d9ae745 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:44.907258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e66d2-a848-48af-b2cf-90033d9ae745 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:44.909986 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e66d2-a848-48af-b2cf-90033d9ae745 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:44.912399 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 185/365] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:44 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:44.913474 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e66d2-a848-48af-b2cf-90033d9ae745 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:44.946709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:44.952074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeae301-7da1-413a-83c0-71db1d7515a1 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:44.995947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1c477-5aeb-4dba-9bd8-bf9a42ec4d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:44.996516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1c477-5aeb-4dba-9bd8-bf9a42ec4d70 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:44.996800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1c477-5aeb-4dba-9bd8-bf9a42ec4d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:44.997077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1c477-5aeb-4dba-9bd8-bf9a42ec4d70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:45.009160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:45.009347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1c477-5aeb-4dba-9bd8-bf9a42ec4d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-0ca1c477-5aeb-4dba-9bd8-bf9a42ec4d70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:45.014140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:45.017567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:45.018601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 181/366] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:18:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:45.021243 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1c477-5aeb-4dba-9bd8-bf9a42ec4d70 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:45.066251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e66d2-a848-48af-b2cf-90033d9ae745 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:45.120054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615729fb-2508-41a9-b6c5-5c236c7bb589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:45.120690 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615729fb-2508-41a9-b6c5-5c236c7bb589 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:45.120976 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615729fb-2508-41a9-b6c5-5c236c7bb589 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:45.121253 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615729fb-2508-41a9-b6c5-5c236c7bb589 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:45.121979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615729fb-2508-41a9-b6c5-5c236c7bb589 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:45.122287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615729fb-2508-41a9-b6c5-5c236c7bb589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:45.123789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615729fb-2508-41a9-b6c5-5c236c7bb589 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:45.136725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 186/367] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:18:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:45.137775 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615729fb-2508-41a9-b6c5-5c236c7bb589 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:45.161714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1c477-5aeb-4dba-9bd8-bf9a42ec4d70 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:45.213278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec3a75-94d9-4d2f-9660-fb542758c509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:45.213928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec3a75-94d9-4d2f-9660-fb542758c509 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:45.214213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec3a75-94d9-4d2f-9660-fb542758c509 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:45.214559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec3a75-94d9-4d2f-9660-fb542758c509 None admin] PATH_INFO: `/v3/groups/8bf835a1ce7e4d7194393d0b936d1261` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:45.215771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec3a75-94d9-4d2f-9660-fb542758c509 None admin] RBAC: Authorizing `identity:get_group(group_id=8bf835a1ce7e4d7194393d0b936d1261)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:45.217462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec3a75-94d9-4d2f-9660-fb542758c509 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:45.219005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 182/368] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:45 2022] GET /identity/v3/groups/8bf835a1ce7e4d7194393d0b936d1261 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:45.219593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec3a75-94d9-4d2f-9660-fb542758c509 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:45.257164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:45.268263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615729fb-2508-41a9-b6c5-5c236c7bb589 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:45.301902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:45.314222 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2cd63-661b-4c19-81b2-397b83fd9bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:45.314911 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2cd63-661b-4c19-81b2-397b83fd9bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:45.315199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2cd63-661b-4c19-81b2-397b83fd9bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:45.315478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2cd63-661b-4c19-81b2-397b83fd9bf4 None admin] PATH_INFO: `/v3/groups/8bf835a1ce7e4d7194393d0b936d1261` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:45.316885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2cd63-661b-4c19-81b2-397b83fd9bf4 None admin] RBAC: Authorizing `identity:get_group(group_id=8bf835a1ce7e4d7194393d0b936d1261)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:45.318141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2cd63-661b-4c19-81b2-397b83fd9bf4 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:45.320001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 187/369] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:45 2022] GET /identity/v3/groups/8bf835a1ce7e4d7194393d0b936d1261 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:45.320595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2cd63-661b-4c19-81b2-397b83fd9bf4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:45.353619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec3a75-94d9-4d2f-9660-fb542758c509 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:45.389528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ce09-0445-4d69-b6bd-1a73eac377e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:45.390260 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ce09-0445-4d69-b6bd-1a73eac377e7 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:45.390578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ce09-0445-4d69-b6bd-1a73eac377e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:45.390866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ce09-0445-4d69-b6bd-1a73eac377e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:45.391584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3ce09-0445-4d69-b6bd-1a73eac377e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:45.391893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3ce09-0445-4d69-b6bd-1a73eac377e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:45.393273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3ce09-0445-4d69-b6bd-1a73eac377e7 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:45.406657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 183/370] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:45.406657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ce09-0445-4d69-b6bd-1a73eac377e7 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:45.434274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2cd63-661b-4c19-81b2-397b83fd9bf4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:45.468758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d48cd-ccf9-41ff-976d-b80c7d3ffc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:45.469406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d48cd-ccf9-41ff-976d-b80c7d3ffc12 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:45.469684 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d48cd-ccf9-41ff-976d-b80c7d3ffc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:45.469971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d48cd-ccf9-41ff-976d-b80c7d3ffc12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:45.498846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:45.508313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ce09-0445-4d69-b6bd-1a73eac377e7 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:45.537293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:45.543451 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfd09-c30f-4996-b04b-9981dda78058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:45.544066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfd09-c30f-4996-b04b-9981dda78058 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:45.544351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfd09-c30f-4996-b04b-9981dda78058 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:45.544626 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfd09-c30f-4996-b04b-9981dda78058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:45.546450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d48cd-ccf9-41ff-976d-b80c7d3ffc12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:45.546567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfd09-c30f-4996-b04b-9981dda78058 None admin] RBAC: Adding query filter params (group.id=8bf835a1ce7e4d7194393d0b936d1261, role.id=b83f9277d44246c5983fe3b6d7d5af96, scope.project.id=0d82d9815c484e6abe046fa9caa21713) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:45.546567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfd09-c30f-4996-b04b-9981dda78058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:45.546695 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d48cd-ccf9-41ff-976d-b80c7d3ffc12 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:45.547312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfd09-c30f-4996-b04b-9981dda78058 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:45.553745 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 184/371] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Aug 4 02:18:45 2022] GET /identity/v3/role_assignments?group.id=8bf835a1ce7e4d7194393d0b936d1261&scope.project.id=0d82d9815c484e6abe046fa9caa21713&role.id=b83f9277d44246c5983fe3b6d7d5af96 => generated 260 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:45.554357 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfd09-c30f-4996-b04b-9981dda78058 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:45.678078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 188/372] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:45.679091 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d48cd-ccf9-41ff-976d-b80c7d3ffc12 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:45.700544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfd09-c30f-4996-b04b-9981dda78058 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:45.748694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d880a5-be86-4718-8116-7f822cd0efdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:45.749353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d880a5-be86-4718-8116-7f822cd0efdf None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:45.749639 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d880a5-be86-4718-8116-7f822cd0efdf None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:45.749920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d880a5-be86-4718-8116-7f822cd0efdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:45.751156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d880a5-be86-4718-8116-7f822cd0efdf None admin] RBAC: Adding query filter params (group.id=8bf835a1ce7e4d7194393d0b936d1261, role.id=d2d09ac7138145968d31dde4d5b9ee5a, scope.project.id=b312e6a347184d229a1a2c04149bbe2e) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:45.751483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d880a5-be86-4718-8116-7f822cd0efdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:45.753294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d880a5-be86-4718-8116-7f822cd0efdf None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:45.763622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 185/373] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Aug 4 02:18:45 2022] GET /identity/v3/role_assignments?group.id=8bf835a1ce7e4d7194393d0b936d1261&scope.project.id=b312e6a347184d229a1a2c04149bbe2e&role.id=d2d09ac7138145968d31dde4d5b9ee5a => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:45.764507 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d880a5-be86-4718-8116-7f822cd0efdf None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:45.790097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:45.802789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:45.810778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d48cd-ccf9-41ff-976d-b80c7d3ffc12 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:45.853955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b4cf0-7fcd-43ee-a17a-27fa19b16058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:45.855065 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4cf0-7fcd-43ee-a17a-27fa19b16058 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:45.855611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4cf0-7fcd-43ee-a17a-27fa19b16058 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:45.856108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4cf0-7fcd-43ee-a17a-27fa19b16058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:45.882332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d880a5-be86-4718-8116-7f822cd0efdf None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:45.921351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347c651-06dc-4385-96f5-08c19f2e3374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:45.921887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c651-06dc-4385-96f5-08c19f2e3374 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:45.922168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c651-06dc-4385-96f5-08c19f2e3374 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:45.922446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c651-06dc-4385-96f5-08c19f2e3374 None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:45.923728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347c651-06dc-4385-96f5-08c19f2e3374 None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:45.925206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347c651-06dc-4385-96f5-08c19f2e3374 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:45.927371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 186/374] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:45 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:45.933272 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347c651-06dc-4385-96f5-08c19f2e3374 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:45.942405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b4cf0-7fcd-43ee-a17a-27fa19b16058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:45.944152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b4cf0-7fcd-43ee-a17a-27fa19b16058 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:46.049817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:46.058979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:46.069568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 189/375] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:46.076787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b4cf0-7fcd-43ee-a17a-27fa19b16058 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:46.084089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347c651-06dc-4385-96f5-08c19f2e3374 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:46.137183 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d976d0-05cf-44b8-b0db-490282eed2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:46.137827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d976d0-05cf-44b8-b0db-490282eed2ac None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:46.138105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d976d0-05cf-44b8-b0db-490282eed2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:46.138374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d976d0-05cf-44b8-b0db-490282eed2ac None admin] PATH_INFO: `/v3/groups/8bf835a1ce7e4d7194393d0b936d1261` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:46.140434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d976d0-05cf-44b8-b0db-490282eed2ac None admin] RBAC: Authorizing `identity:get_group(group_id=8bf835a1ce7e4d7194393d0b936d1261)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:46.141089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d976d0-05cf-44b8-b0db-490282eed2ac None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:46.142999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 187/376] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:45 2022] GET /identity/v3/groups/8bf835a1ce7e4d7194393d0b936d1261 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:46.148652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d976d0-05cf-44b8-b0db-490282eed2ac None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:46.197936 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b4cf0-7fcd-43ee-a17a-27fa19b16058 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:46.236788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d672b70-475c-49b9-b9f7-0524fab384a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:46.237813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d672b70-475c-49b9-b9f7-0524fab384a5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:46.238308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d672b70-475c-49b9-b9f7-0524fab384a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:46.238812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d672b70-475c-49b9-b9f7-0524fab384a5 None admin] PATH_INFO: `/v3/projects/7aa60e5b58354576a0cb898fee2dc9ca` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:46.240661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d672b70-475c-49b9-b9f7-0524fab384a5 None admin] RBAC: Authorizing `identity:get_project(project_id=7aa60e5b58354576a0cb898fee2dc9ca)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:46.242328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d672b70-475c-49b9-b9f7-0524fab384a5 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:46.245062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 190/377] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:46 2022] GET /identity/v3/projects/7aa60e5b58354576a0cb898fee2dc9ca => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:46.251678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d672b70-475c-49b9-b9f7-0524fab384a5 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:46.326106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:46.373557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d672b70-475c-49b9-b9f7-0524fab384a5 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:46.412854 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadeb07-1fc7-45bf-8278-61b2c5b08e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:46.413869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadeb07-1fc7-45bf-8278-61b2c5b08e69 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:46.414361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadeb07-1fc7-45bf-8278-61b2c5b08e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:46.414865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadeb07-1fc7-45bf-8278-61b2c5b08e69 None admin] PATH_INFO: `/v3/groups/33ea2d3d887a467db56b72c99ed95a7b` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:46.421506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadeb07-1fc7-45bf-8278-61b2c5b08e69 None admin] RBAC: Authorizing `identity:get_group(group_id=33ea2d3d887a467db56b72c99ed95a7b)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:46.423750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadeb07-1fc7-45bf-8278-61b2c5b08e69 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:46.426028 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 191/378] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:46 2022] GET /identity/v3/groups/33ea2d3d887a467db56b72c99ed95a7b => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:46.433143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadeb07-1fc7-45bf-8278-61b2c5b08e69 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:46.437863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d976d0-05cf-44b8-b0db-490282eed2ac None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:46.507366 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6c772-a31d-409d-b4cc-2906d1a516c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:46.507963 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6c772-a31d-409d-b4cc-2906d1a516c1 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:46.508233 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6c772-a31d-409d-b4cc-2906d1a516c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:46.508511 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6c772-a31d-409d-b4cc-2906d1a516c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:46.509864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6c772-a31d-409d-b4cc-2906d1a516c1 None admin] RBAC: Adding query filter params (group.id=8bf835a1ce7e4d7194393d0b936d1261, role.id=d2d09ac7138145968d31dde4d5b9ee5a, scope.project.id=0d82d9815c484e6abe046fa9caa21713) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:46.510182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6c772-a31d-409d-b4cc-2906d1a516c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:46.511817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6c772-a31d-409d-b4cc-2906d1a516c1 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:46.527744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 188/379] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Aug 4 02:18:46 2022] GET /identity/v3/role_assignments?group.id=8bf835a1ce7e4d7194393d0b936d1261&scope.project.id=0d82d9815c484e6abe046fa9caa21713&role.id=d2d09ac7138145968d31dde4d5b9ee5a => generated 260 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:46.555227 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadeb07-1fc7-45bf-8278-61b2c5b08e69 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:46.586040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:46.602150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbf8a6-a07b-4350-b688-1226828aa52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:46.604839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbf8a6-a07b-4350-b688-1226828aa52c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:46.604839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbf8a6-a07b-4350-b688-1226828aa52c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:46.604839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbf8a6-a07b-4350-b688-1226828aa52c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:46.605339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbf8a6-a07b-4350-b688-1226828aa52c None admin] RBAC: Adding query filter params (group.id=33ea2d3d887a467db56b72c99ed95a7b, role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=7aa60e5b58354576a0cb898fee2dc9ca) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:46.605854 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbf8a6-a07b-4350-b688-1226828aa52c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:46.607593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbf8a6-a07b-4350-b688-1226828aa52c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:46.614657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 192/380] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Aug 4 02:18:46 2022] GET /identity/v3/role_assignments?group.id=33ea2d3d887a467db56b72c99ed95a7b&scope.project.id=7aa60e5b58354576a0cb898fee2dc9ca&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:46.877692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e65df-d6d2-4572-8e5e-ef46c3effbe3 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:46.878036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e65df-d6d2-4572-8e5e-ef46c3effbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:46.878228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e65df-d6d2-4572-8e5e-ef46c3effbe3 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:46.879849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 189/381] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:46.885848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59be562-140f-4b74-865e-b7e28ae1b344 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:46.886142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59be562-140f-4b74-865e-b7e28ae1b344 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:46.886423 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59be562-140f-4b74-865e-b7e28ae1b344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:46.911380 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-e59be562-140f-4b74-865e-b7e28ae1b344 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:46.912592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e59be562-140f-4b74-865e-b7e28ae1b344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:46.999063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 193/382] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:47.034557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e65df-d6d2-4572-8e5e-ef46c3effbe3 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:47.072543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:47.179227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e65df-d6d2-4572-8e5e-ef46c3effbe3 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:47.224145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e0c5f-9326-4b4f-a18a-fc23d6547bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:47.224808 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e0c5f-9326-4b4f-a18a-fc23d6547bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:47.225089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e0c5f-9326-4b4f-a18a-fc23d6547bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:47.225365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e0c5f-9326-4b4f-a18a-fc23d6547bd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:47.236980 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e0c5f-9326-4b4f-a18a-fc23d6547bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-be4e0c5f-9326-4b4f-a18a-fc23d6547bd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:47.247242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:47.248174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:47.249431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 190/383] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:47.255362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59be562-140f-4b74-865e-b7e28ae1b344 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:47.391035 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59be562-140f-4b74-865e-b7e28ae1b344 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:47.425151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:47.444888 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e0756-717b-4269-8eb6-d09636b8cb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:47.445448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e0756-717b-4269-8eb6-d09636b8cb96 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:47.445776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e0756-717b-4269-8eb6-d09636b8cb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:47.446051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e0756-717b-4269-8eb6-d09636b8cb96 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:47.446863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e0756-717b-4269-8eb6-d09636b8cb96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:47.447164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e0756-717b-4269-8eb6-d09636b8cb96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:47.448607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e0756-717b-4269-8eb6-d09636b8cb96 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:47.465222 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 194/384] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:47.471159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e0c5f-9326-4b4f-a18a-fc23d6547bd9 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:47.587088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:47.609999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e0c5f-9326-4b4f-a18a-fc23d6547bd9 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:47.658046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17827334-7354-4b42-b080-2aee92932e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:47.658726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17827334-7354-4b42-b080-2aee92932e18 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:47.659014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17827334-7354-4b42-b080-2aee92932e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:47.659292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17827334-7354-4b42-b080-2aee92932e18 None admin] PATH_INFO: `/v3/groups/8bf835a1ce7e4d7194393d0b936d1261` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:47.660452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17827334-7354-4b42-b080-2aee92932e18 None admin] RBAC: Authorizing `identity:get_group(group_id=8bf835a1ce7e4d7194393d0b936d1261)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:47.661914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17827334-7354-4b42-b080-2aee92932e18 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:47.663787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 191/385] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:47 2022] GET /identity/v3/groups/8bf835a1ce7e4d7194393d0b936d1261 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:47.669560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e0756-717b-4269-8eb6-d09636b8cb96 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:47.826225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e0756-717b-4269-8eb6-d09636b8cb96 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:47.873525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76800830-4154-4cce-a46c-3fb7f710b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:47.874173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76800830-4154-4cce-a46c-3fb7f710b116 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:47.874456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76800830-4154-4cce-a46c-3fb7f710b116 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:47.874759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76800830-4154-4cce-a46c-3fb7f710b116 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:47.876103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76800830-4154-4cce-a46c-3fb7f710b116 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:47.877543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76800830-4154-4cce-a46c-3fb7f710b116 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:47.879735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 195/386] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:47 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:47.885463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17827334-7354-4b42-b080-2aee92932e18 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:48.010389 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17827334-7354-4b42-b080-2aee92932e18 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:48.050552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48dc00-62f0-4616-b26e-46fee593002b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:48.050552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48dc00-62f0-4616-b26e-46fee593002b None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:48.050552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48dc00-62f0-4616-b26e-46fee593002b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:48.050552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48dc00-62f0-4616-b26e-46fee593002b None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e/groups/8bf835a1ce7e4d7194393d0b936d1261/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:48.051311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48dc00-62f0-4616-b26e-46fee593002b None admin] RBAC: Authorizing `identity:create_grant(project_id=b312e6a347184d229a1a2c04149bbe2e, group_id=8bf835a1ce7e4d7194393d0b936d1261, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:48.051474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48dc00-62f0-4616-b26e-46fee593002b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:48.055619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807201a8-e9f1-44b8-84c6-6912bbd33187 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:48.055905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807201a8-e9f1-44b8-84c6-6912bbd33187 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:48.056268 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807201a8-e9f1-44b8-84c6-6912bbd33187 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:48.058444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 196/387] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:48.063594 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46623a50-2487-470a-a6ad-4ed2ff2630e9 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:48.063886 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46623a50-2487-470a-a6ad-4ed2ff2630e9 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:48.064227 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46623a50-2487-470a-a6ad-4ed2ff2630e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:48.086905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-46623a50-2487-470a-a6ad-4ed2ff2630e9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:48.088485 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-46623a50-2487-470a-a6ad-4ed2ff2630e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:48.132103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 192/388] 10.222.0.60 () {58 vars in 1442 bytes} [Thu Aug 4 02:18:47 2022] PUT /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e/groups/8bf835a1ce7e4d7194393d0b936d1261/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:18:48.163308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:48.196570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 197/389] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:48.218769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48dc00-62f0-4616-b26e-46fee593002b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:48.230068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:48.348444 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48dc00-62f0-4616-b26e-46fee593002b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:48.383963 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1099af-2b9f-4fdb-9cb9-2969cd759f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:48.385158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1099af-2b9f-4fdb-9cb9-2969cd759f11 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:48.385447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1099af-2b9f-4fdb-9cb9-2969cd759f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:48.385728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1099af-2b9f-4fdb-9cb9-2969cd759f11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:48.396402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1099af-2b9f-4fdb-9cb9-2969cd759f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-4b1099af-2b9f-4fdb-9cb9-2969cd759f11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:48.402064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:48.402972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:48.403852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 193/390] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:48.409719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46623a50-2487-470a-a6ad-4ed2ff2630e9 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:48.575251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46623a50-2487-470a-a6ad-4ed2ff2630e9 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:48.622605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82b5b9-be89-4e9d-9438-14b65225a6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:48.623163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82b5b9-be89-4e9d-9438-14b65225a6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:48.623452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82b5b9-be89-4e9d-9438-14b65225a6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:48.623732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82b5b9-be89-4e9d-9438-14b65225a6e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:48.624464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82b5b9-be89-4e9d-9438-14b65225a6e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:48.624776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82b5b9-be89-4e9d-9438-14b65225a6e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:48.626182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82b5b9-be89-4e9d-9438-14b65225a6e3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:48.635339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 198/391] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:48.640534 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1099af-2b9f-4fdb-9cb9-2969cd759f11 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:48.688228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c2bfa-e2b8-4375-b13f-83147b759041 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:48.688912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c2bfa-e2b8-4375-b13f-83147b759041 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:48.689391 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c2bfa-e2b8-4375-b13f-83147b759041 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:48.691229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 199/392] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:48.696670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5284bad-ec0c-47a5-a1e7-27b4c403b942 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:48.697713 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5284bad-ec0c-47a5-a1e7-27b4c403b942 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:48.698189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5284bad-ec0c-47a5-a1e7-27b4c403b942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:48.741040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:48.747118 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b5284bad-ec0c-47a5-a1e7-27b4c403b942 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:48.749628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b5284bad-ec0c-47a5-a1e7-27b4c403b942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:48.811356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1099af-2b9f-4fdb-9cb9-2969cd759f11 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:48.835969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:48.886616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 200/393] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:48.887619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743060-e513-47ca-80e9-b0367ae0f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:48.888530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743060-e513-47ca-80e9-b0367ae0f41a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:48.889080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743060-e513-47ca-80e9-b0367ae0f41a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:48.889558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743060-e513-47ca-80e9-b0367ae0f41a None admin] PATH_INFO: `/v3/groups/8bf835a1ce7e4d7194393d0b936d1261` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:48.890958 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85743060-e513-47ca-80e9-b0367ae0f41a None admin] RBAC: Authorizing `identity:get_group(group_id=8bf835a1ce7e4d7194393d0b936d1261)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:48.892592 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85743060-e513-47ca-80e9-b0367ae0f41a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:48.895667 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 194/394] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:48 2022] GET /identity/v3/groups/8bf835a1ce7e4d7194393d0b936d1261 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:48.902590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5284bad-ec0c-47a5-a1e7-27b4c403b942 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:48.928487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743060-e513-47ca-80e9-b0367ae0f41a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:49.035361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5284bad-ec0c-47a5-a1e7-27b4c403b942 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:49.046861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743060-e513-47ca-80e9-b0367ae0f41a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:49.071422 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce580287-1ccc-4cba-a6d2-ca740d796ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:49.072632 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce580287-1ccc-4cba-a6d2-ca740d796ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.072920 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce580287-1ccc-4cba-a6d2-ca740d796ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.073203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce580287-1ccc-4cba-a6d2-ca740d796ae3 None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.074404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce580287-1ccc-4cba-a6d2-ca740d796ae3 None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:49.075876 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce580287-1ccc-4cba-a6d2-ca740d796ae3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:49.077839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 201/395] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:48 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:49.083692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1068-532d-4f94-bbbd-ed786bc4ee15 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.083981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1068-532d-4f94-bbbd-ed786bc4ee15 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.084268 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1068-532d-4f94-bbbd-ed786bc4ee15 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.085325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c02fed-9bbe-40a8-bc93-0a8b872c0df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:49.085713 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 202/396] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:49.085978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c02fed-9bbe-40a8-bc93-0a8b872c0df3 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.086193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca1068-532d-4f94-bbbd-ed786bc4ee15 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:49.086287 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c02fed-9bbe-40a8-bc93-0a8b872c0df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.090403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c02fed-9bbe-40a8-bc93-0a8b872c0df3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.093031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:49.104722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c02fed-9bbe-40a8-bc93-0a8b872c0df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-61c02fed-9bbe-40a8-bc93-0a8b872c0df3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:49.111730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:49.112738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:49.113547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:49.113547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:49.113547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:49.113547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:49.113547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:49.113547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:49.113547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:49.113547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:49.113547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:49.113547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:49.113547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:49.113547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:49.118296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 195/397] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:49.120248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1c051-6d96-42e4-b1c3-cc5572c42fdd None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.120794 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1c051-6d96-42e4-b1c3-cc5572c42fdd None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.121259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1c051-6d96-42e4-b1c3-cc5572c42fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.140946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-08b1c051-6d96-42e4-b1c3-cc5572c42fdd None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:49.142060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-08b1c051-6d96-42e4-b1c3-cc5572c42fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:49.152904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:49.214389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca1068-532d-4f94-bbbd-ed786bc4ee15 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:49.222536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 196/398] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:49.222536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1c051-6d96-42e4-b1c3-cc5572c42fdd None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:49.263702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd59cf-e4a7-4eb5-aad0-16f7aaa3b78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:49.264300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd59cf-e4a7-4eb5-aad0-16f7aaa3b78e None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.264586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd59cf-e4a7-4eb5-aad0-16f7aaa3b78e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.265001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd59cf-e4a7-4eb5-aad0-16f7aaa3b78e None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713/groups/8bf835a1ce7e4d7194393d0b936d1261/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.266819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd59cf-e4a7-4eb5-aad0-16f7aaa3b78e None admin] RBAC: Authorizing `identity:create_grant(project_id=0d82d9815c484e6abe046fa9caa21713, group_id=8bf835a1ce7e4d7194393d0b936d1261, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:49.268282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd59cf-e4a7-4eb5-aad0-16f7aaa3b78e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:49.333983 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1c051-6d96-42e4-b1c3-cc5572c42fdd None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:49.348811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 203/399] 10.222.0.60 () {58 vars in 1442 bytes} [Thu Aug 4 02:18:49 2022] PUT /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713/groups/8bf835a1ce7e4d7194393d0b936d1261/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:18:49.358733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af22b4-055c-4b4a-a936-c9174a562acf None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.358733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af22b4-055c-4b4a-a936-c9174a562acf None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.358733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af22b4-055c-4b4a-a936-c9174a562acf None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.358733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 204/400] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:49.358733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af22b4-055c-4b4a-a936-c9174a562acf None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:49.373876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:49.387567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c352f26-b5ca-4c76-856e-a1ca61476e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:49.388397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c352f26-b5ca-4c76-856e-a1ca61476e93 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.388759 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c352f26-b5ca-4c76-856e-a1ca61476e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.389042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c352f26-b5ca-4c76-856e-a1ca61476e93 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.389825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c352f26-b5ca-4c76-856e-a1ca61476e93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:49.390180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c352f26-b5ca-4c76-856e-a1ca61476e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:49.391837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c352f26-b5ca-4c76-856e-a1ca61476e93 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:49.404343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 197/401] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:18:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:49.413419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde931a-40ed-43a1-af04-5b32933b65b9 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.413419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde931a-40ed-43a1-af04-5b32933b65b9 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.413419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde931a-40ed-43a1-af04-5b32933b65b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.427827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-efde931a-40ed-43a1-af04-5b32933b65b9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:49.429257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-efde931a-40ed-43a1-af04-5b32933b65b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:49.510162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af22b4-055c-4b4a-a936-c9174a562acf None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:49.520310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:49.526237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 198/402] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:49.530917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde931a-40ed-43a1-af04-5b32933b65b9 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:49.574375 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744569ea-29fe-4577-a095-1e595f2ffa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:49.575081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744569ea-29fe-4577-a095-1e595f2ffa1b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.575369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744569ea-29fe-4577-a095-1e595f2ffa1b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.575650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744569ea-29fe-4577-a095-1e595f2ffa1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.590193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744569ea-29fe-4577-a095-1e595f2ffa1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-744569ea-29fe-4577-a095-1e595f2ffa1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:49.597064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:49.598128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:49.599138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 205/403] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:49.603595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744569ea-29fe-4577-a095-1e595f2ffa1b None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:49.660671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde931a-40ed-43a1-af04-5b32933b65b9 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:49.682388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:49.706605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babc394-0261-4f5d-91b8-d6ed2d588eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:49.707514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babc394-0261-4f5d-91b8-d6ed2d588eda None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.707723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744569ea-29fe-4577-a095-1e595f2ffa1b None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:49.708100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babc394-0261-4f5d-91b8-d6ed2d588eda None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.708539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babc394-0261-4f5d-91b8-d6ed2d588eda None admin] PATH_INFO: `/v3/groups/8bf835a1ce7e4d7194393d0b936d1261` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.710861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babc394-0261-4f5d-91b8-d6ed2d588eda None admin] RBAC: Authorizing `identity:get_group(group_id=8bf835a1ce7e4d7194393d0b936d1261)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:49.712878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babc394-0261-4f5d-91b8-d6ed2d588eda None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:49.719362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 199/404] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:49 2022] GET /identity/v3/groups/8bf835a1ce7e4d7194393d0b936d1261 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:49.720941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babc394-0261-4f5d-91b8-d6ed2d588eda None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:49.755355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ec2d1-7e0a-4458-a571-ab22de773bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:49.756940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ec2d1-7e0a-4458-a571-ab22de773bad None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.757443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ec2d1-7e0a-4458-a571-ab22de773bad None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.757936 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ec2d1-7e0a-4458-a571-ab22de773bad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.773342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ec2d1-7e0a-4458-a571-ab22de773bad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-464ec2d1-7e0a-4458-a571-ab22de773bad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:49.780276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:49.781160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:49.781954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:49.781954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:49.781954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:49.781954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:49.781954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:49.781954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:49.781954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:49.781954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:49.781954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:49.781954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:49.781954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:49.781954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:49.789195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 206/405] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:18:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:49.789195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ec2d1-7e0a-4458-a571-ab22de773bad None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:49.818542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:49.870034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babc394-0261-4f5d-91b8-d6ed2d588eda None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:49.906696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30b50c-5b24-40a5-8278-3ce2fe63ec43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:49.907200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30b50c-5b24-40a5-8278-3ce2fe63ec43 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.907484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30b50c-5b24-40a5-8278-3ce2fe63ec43 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.907761 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30b50c-5b24-40a5-8278-3ce2fe63ec43 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.908484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30b50c-5b24-40a5-8278-3ce2fe63ec43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:49.908801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30b50c-5b24-40a5-8278-3ce2fe63ec43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:49.910329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30b50c-5b24-40a5-8278-3ce2fe63ec43 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:49.917531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ec2d1-7e0a-4458-a571-ab22de773bad None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:49.923874 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 200/406] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:18:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:49.924819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30b50c-5b24-40a5-8278-3ce2fe63ec43 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:49.957467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510403-7623-4f51-bc3c-c26d5d117563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:49.958459 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510403-7623-4f51-bc3c-c26d5d117563 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:49.959088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510403-7623-4f51-bc3c-c26d5d117563 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:49.959677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01510403-7623-4f51-bc3c-c26d5d117563 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:49.961072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510403-7623-4f51-bc3c-c26d5d117563 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:49.963900 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01510403-7623-4f51-bc3c-c26d5d117563 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:49.971343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 207/407] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:49 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:49.972689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510403-7623-4f51-bc3c-c26d5d117563 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:49.984363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:50.050517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30b50c-5b24-40a5-8278-3ce2fe63ec43 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:50.082986 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:50.089664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6669b3-05a8-44e8-802d-5a85ca2339a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:50.090731 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6669b3-05a8-44e8-802d-5a85ca2339a2 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:50.091241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6669b3-05a8-44e8-802d-5a85ca2339a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:50.091833 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6669b3-05a8-44e8-802d-5a85ca2339a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:50.092764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6669b3-05a8-44e8-802d-5a85ca2339a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:50.093186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01510403-7623-4f51-bc3c-c26d5d117563 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:50.093475 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6669b3-05a8-44e8-802d-5a85ca2339a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:50.095210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6669b3-05a8-44e8-802d-5a85ca2339a2 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:50.105186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 201/408] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:50.106359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6669b3-05a8-44e8-802d-5a85ca2339a2 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:50.130206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef1128-e784-41f3-ab8f-f45d380f5ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:50.130893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef1128-e784-41f3-ab8f-f45d380f5ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:50.131176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef1128-e784-41f3-ab8f-f45d380f5ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:50.131451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef1128-e784-41f3-ab8f-f45d380f5ab3 None admin] PATH_INFO: `/v3/groups/8bf835a1ce7e4d7194393d0b936d1261` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:50.132617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef1128-e784-41f3-ab8f-f45d380f5ab3 None admin] RBAC: Authorizing `identity:get_group(group_id=8bf835a1ce7e4d7194393d0b936d1261)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:50.134135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef1128-e784-41f3-ab8f-f45d380f5ab3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:50.136199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 208/409] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:49 2022] GET /identity/v3/groups/8bf835a1ce7e4d7194393d0b936d1261 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:50.136961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef1128-e784-41f3-ab8f-f45d380f5ab3 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:50.219708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6669b3-05a8-44e8-802d-5a85ca2339a2 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:50.230094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:50.240598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef1128-e784-41f3-ab8f-f45d380f5ab3 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:50.257794 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076444e8-60d5-46d2-a5d5-a67f2fef3f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:50.258827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076444e8-60d5-46d2-a5d5-a67f2fef3f80 None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:50.259769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076444e8-60d5-46d2-a5d5-a67f2fef3f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:50.260275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076444e8-60d5-46d2-a5d5-a67f2fef3f80 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e/groups/8bf835a1ce7e4d7194393d0b936d1261/roles/d2d09ac7138145968d31dde4d5b9ee5a` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:50.262821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076444e8-60d5-46d2-a5d5-a67f2fef3f80 None admin] RBAC: Authorizing `identity:create_grant(project_id=b312e6a347184d229a1a2c04149bbe2e, group_id=8bf835a1ce7e4d7194393d0b936d1261, role_id=d2d09ac7138145968d31dde4d5b9ee5a)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:50.264536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076444e8-60d5-46d2-a5d5-a67f2fef3f80 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:50.276420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63746d4-1a64-4433-98b7-1835b62c4b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:50.277063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63746d4-1a64-4433-98b7-1835b62c4b52 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:50.280871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63746d4-1a64-4433-98b7-1835b62c4b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:50.280871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63746d4-1a64-4433-98b7-1835b62c4b52 None admin] PATH_INFO: `/v3/groups/33ea2d3d887a467db56b72c99ed95a7b` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:50.280871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63746d4-1a64-4433-98b7-1835b62c4b52 None admin] RBAC: Authorizing `identity:get_group(group_id=33ea2d3d887a467db56b72c99ed95a7b)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:50.280871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63746d4-1a64-4433-98b7-1835b62c4b52 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:50.286403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 209/410] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:50 2022] GET /identity/v3/groups/33ea2d3d887a467db56b72c99ed95a7b => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:50.286403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63746d4-1a64-4433-98b7-1835b62c4b52 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:50.315436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:50.365967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 202/411] 10.222.0.60 () {58 vars in 1442 bytes} [Thu Aug 4 02:18:50 2022] PUT /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e/groups/8bf835a1ce7e4d7194393d0b936d1261/roles/d2d09ac7138145968d31dde4d5b9ee5a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:18:50.372028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076444e8-60d5-46d2-a5d5-a67f2fef3f80 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:50.389855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63746d4-1a64-4433-98b7-1835b62c4b52 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:50.439332 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f084645-834a-4a62-8113-ebd59f2239d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:50.440005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f084645-834a-4a62-8113-ebd59f2239d4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:50.440602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f084645-834a-4a62-8113-ebd59f2239d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:50.440602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f084645-834a-4a62-8113-ebd59f2239d4 None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:50.441796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f084645-834a-4a62-8113-ebd59f2239d4 None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:50.443271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f084645-834a-4a62-8113-ebd59f2239d4 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:50.445104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 210/412] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:50 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:50.451559 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f084645-834a-4a62-8113-ebd59f2239d4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:50.557540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076444e8-60d5-46d2-a5d5-a67f2fef3f80 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:50.580333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:50.589513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f084645-834a-4a62-8113-ebd59f2239d4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:50.605852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ebfbe-eece-4718-8994-f2eacdce70fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:50.608612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ebfbe-eece-4718-8994-f2eacdce70fc None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:50.608612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ebfbe-eece-4718-8994-f2eacdce70fc None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:50.608612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ebfbe-eece-4718-8994-f2eacdce70fc None admin] PATH_INFO: `/v3/projects/7aa60e5b58354576a0cb898fee2dc9ca` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:50.608826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ebfbe-eece-4718-8994-f2eacdce70fc None admin] RBAC: Authorizing `identity:get_project(project_id=7aa60e5b58354576a0cb898fee2dc9ca)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:50.610576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ebfbe-eece-4718-8994-f2eacdce70fc None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:50.612035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 203/413] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:50 2022] GET /identity/v3/projects/7aa60e5b58354576a0cb898fee2dc9ca => generated 344 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:50.616814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4dea4-eff5-431c-8c08-356e5926f5d7 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:50.616814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4dea4-eff5-431c-8c08-356e5926f5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:50.616814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4dea4-eff5-431c-8c08-356e5926f5d7 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:50.616814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 204/414] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:50.620031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4dea4-eff5-431c-8c08-356e5926f5d7 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:50.643229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e5a77-4279-498d-90b0-4c3c475e4a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:50.643914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e5a77-4279-498d-90b0-4c3c475e4a0c None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:50.644200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e5a77-4279-498d-90b0-4c3c475e4a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:50.644479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e5a77-4279-498d-90b0-4c3c475e4a0c None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713/groups/8bf835a1ce7e4d7194393d0b936d1261/roles/d2d09ac7138145968d31dde4d5b9ee5a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:50.648484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e5a77-4279-498d-90b0-4c3c475e4a0c None admin] RBAC: Authorizing `identity:create_grant(project_id=0d82d9815c484e6abe046fa9caa21713, group_id=8bf835a1ce7e4d7194393d0b936d1261, role_id=d2d09ac7138145968d31dde4d5b9ee5a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:50.650729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e5a77-4279-498d-90b0-4c3c475e4a0c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:50.663527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:50.722682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 211/415] 10.222.0.60 () {58 vars in 1442 bytes} [Thu Aug 4 02:18:50 2022] PUT /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713/groups/8bf835a1ce7e4d7194393d0b936d1261/roles/d2d09ac7138145968d31dde4d5b9ee5a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:18:50.729323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce5f01-24ea-4ab5-a208-601482837a00 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:50.729890 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce5f01-24ea-4ab5-a208-601482837a00 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:50.730277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce5f01-24ea-4ab5-a208-601482837a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:50.745976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4dea4-eff5-431c-8c08-356e5926f5d7 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:50.773666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-29ce5f01-24ea-4ab5-a208-601482837a00 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:50.775345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-29ce5f01-24ea-4ab5-a208-601482837a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:50.826597 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40896e5-3cda-4760-aade-fd331d2e81c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:50.827283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40896e5-3cda-4760-aade-fd331d2e81c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:50.827600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40896e5-3cda-4760-aade-fd331d2e81c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:50.827879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40896e5-3cda-4760-aade-fd331d2e81c9 None admin] PATH_INFO: `/v3/projects/7aa60e5b58354576a0cb898fee2dc9ca/groups/33ea2d3d887a467db56b72c99ed95a7b/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:50.832033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40896e5-3cda-4760-aade-fd331d2e81c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7aa60e5b58354576a0cb898fee2dc9ca, group_id=33ea2d3d887a467db56b72c99ed95a7b, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:50.834478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40896e5-3cda-4760-aade-fd331d2e81c9 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:50.888937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 212/416] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:50.916516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce5f01-24ea-4ab5-a208-601482837a00 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:50.922922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 205/417] 10.222.0.60 () {58 vars in 1442 bytes} [Thu Aug 4 02:18:50 2022] PUT /identity/v3/projects/7aa60e5b58354576a0cb898fee2dc9ca/groups/33ea2d3d887a467db56b72c99ed95a7b/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:18:51.025777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:51.044722 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce5f01-24ea-4ab5-a208-601482837a00 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:51.084200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513e509-c473-4a50-a803-ea548220bc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:51.084776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513e509-c473-4a50-a803-ea548220bc1e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:51.085115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513e509-c473-4a50-a803-ea548220bc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:51.085404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513e509-c473-4a50-a803-ea548220bc1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:51.096779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513e509-c473-4a50-a803-ea548220bc1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-9513e509-c473-4a50-a803-ea548220bc1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:51.101982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:51.103508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:51.104362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:51.104362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:51.104362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:51.104362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:51.104362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:51.104362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:51.104362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:51.104362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:51.104362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:51.104362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:51.104362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:51.104362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:51.107769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 213/418] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:51.110240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40896e5-3cda-4760-aade-fd331d2e81c9 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:51.216823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:51.225474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40896e5-3cda-4760-aade-fd331d2e81c9 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:51.263946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e4aae-c169-4a4a-955e-f46d2d71ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:51.266080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e4aae-c169-4a4a-955e-f46d2d71ed72 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:51.266382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e4aae-c169-4a4a-955e-f46d2d71ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:51.266773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e4aae-c169-4a4a-955e-f46d2d71ed72 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:51.267616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e4aae-c169-4a4a-955e-f46d2d71ed72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:51.267929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e4aae-c169-4a4a-955e-f46d2d71ed72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:51.269340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e4aae-c169-4a4a-955e-f46d2d71ed72 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:51.283844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 206/419] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:51.285410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513e509-c473-4a50-a803-ea548220bc1e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:51.396207 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513e509-c473-4a50-a803-ea548220bc1e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:51.431728 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e2ab3-a957-4cd5-b6fb-291c6c08018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:51.432553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e2ab3-a957-4cd5-b6fb-291c6c08018e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:51.432860 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e2ab3-a957-4cd5-b6fb-291c6c08018e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:51.433143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e2ab3-a957-4cd5-b6fb-291c6c08018e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:51.454608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:51.507494 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e2ab3-a957-4cd5-b6fb-291c6c08018e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:51.509159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e2ab3-a957-4cd5-b6fb-291c6c08018e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:51.549805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0718c7-12e2-403d-940e-c0cea22fe9c8 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:51.550148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0718c7-12e2-403d-940e-c0cea22fe9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:51.550369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0718c7-12e2-403d-940e-c0cea22fe9c8 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:51.552308 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 207/420] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:51.558537 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ba2b1-997e-4c38-b4b0-7ca2567ec9f0 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:51.559109 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ba2b1-997e-4c38-b4b0-7ca2567ec9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:51.559610 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ba2b1-997e-4c38-b4b0-7ca2567ec9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:51.583966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-649ba2b1-997e-4c38-b4b0-7ca2567ec9f0 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:51.585557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-649ba2b1-997e-4c38-b4b0-7ca2567ec9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:51.653679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 214/421] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:51.667950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e2ab3-a957-4cd5-b6fb-291c6c08018e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:51.684160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 208/422] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:51.721985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ba2b1-997e-4c38-b4b0-7ca2567ec9f0 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:51.763344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:51.815860 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e2ab3-a957-4cd5-b6fb-291c6c08018e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:51.855516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d216e8-8dcb-41d5-afde-f5e83bd39d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:51.856861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d216e8-8dcb-41d5-afde-f5e83bd39d09 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:51.857692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d216e8-8dcb-41d5-afde-f5e83bd39d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:51.858180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d216e8-8dcb-41d5-afde-f5e83bd39d09 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:51.859663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d216e8-8dcb-41d5-afde-f5e83bd39d09 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:51.861347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d216e8-8dcb-41d5-afde-f5e83bd39d09 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:51.863791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 215/423] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:51 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:51.869166 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d216e8-8dcb-41d5-afde-f5e83bd39d09 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:51.891062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:51.915750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ba2b1-997e-4c38-b4b0-7ca2567ec9f0 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:51.995957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10d772-6434-467e-a30f-49864dd0ea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:51.996447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10d772-6434-467e-a30f-49864dd0ea60 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:51.996736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10d772-6434-467e-a30f-49864dd0ea60 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:51.997008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10d772-6434-467e-a30f-49864dd0ea60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:52.028355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10d772-6434-467e-a30f-49864dd0ea60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-db10d772-6434-467e-a30f-49864dd0ea60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:52.034267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:52.035221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:52.036014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:52.036014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:52.036014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:52.036014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:52.036014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:52.036014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:52.036014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:52.036014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:52.036014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:52.036014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:52.036014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:18:52.036014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:52.037348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d216e8-8dcb-41d5-afde-f5e83bd39d09 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:52.043707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 209/424] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:52.062249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:52.063480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10d772-6434-467e-a30f-49864dd0ea60 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:52.083180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee22ac-0379-4518-b2df-7d47c26c13f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:52.084196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee22ac-0379-4518-b2df-7d47c26c13f1 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:52.084557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee22ac-0379-4518-b2df-7d47c26c13f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:52.084937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee22ac-0379-4518-b2df-7d47c26c13f1 None admin] PATH_INFO: `/v3/groups/8bf835a1ce7e4d7194393d0b936d1261` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:52.086219 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee22ac-0379-4518-b2df-7d47c26c13f1 None admin] RBAC: Authorizing `identity:get_group(group_id=8bf835a1ce7e4d7194393d0b936d1261)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:52.087965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee22ac-0379-4518-b2df-7d47c26c13f1 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:52.089986 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 216/425] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:51 2022] GET /identity/v3/groups/8bf835a1ce7e4d7194393d0b936d1261 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:52.102497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee22ac-0379-4518-b2df-7d47c26c13f1 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:52.217493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee22ac-0379-4518-b2df-7d47c26c13f1 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:52.254452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f09e3b-735c-4ec0-8cb7-9c3efed4ef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:52.255114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f09e3b-735c-4ec0-8cb7-9c3efed4ef42 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:52.255521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f09e3b-735c-4ec0-8cb7-9c3efed4ef42 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:52.255909 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f09e3b-735c-4ec0-8cb7-9c3efed4ef42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:52.256807 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f09e3b-735c-4ec0-8cb7-9c3efed4ef42 None admin] RBAC: Adding query filter params (group.id=8bf835a1ce7e4d7194393d0b936d1261, role.id=b83f9277d44246c5983fe3b6d7d5af96, scope.project.id=b312e6a347184d229a1a2c04149bbe2e) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:52.257263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f09e3b-735c-4ec0-8cb7-9c3efed4ef42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:52.259497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f09e3b-735c-4ec0-8cb7-9c3efed4ef42 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:52.266261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 217/426] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Aug 4 02:18:52 2022] GET /identity/v3/role_assignments?group.id=8bf835a1ce7e4d7194393d0b936d1261&scope.project.id=b312e6a347184d229a1a2c04149bbe2e&role.id=b83f9277d44246c5983fe3b6d7d5af96 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:52.303637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10d772-6434-467e-a30f-49864dd0ea60 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:52.362289 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdba765-d516-4400-af25-9389edc10e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:52.363197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdba765-d516-4400-af25-9389edc10e37 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:52.363652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdba765-d516-4400-af25-9389edc10e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:52.364078 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdba765-d516-4400-af25-9389edc10e37 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:52.365030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdba765-d516-4400-af25-9389edc10e37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:52.365486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdba765-d516-4400-af25-9389edc10e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:52.367142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdba765-d516-4400-af25-9389edc10e37 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:52.377518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 210/427] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:18:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:52.384027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f09e3b-735c-4ec0-8cb7-9c3efed4ef42 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:52.468544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:52.528511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f09e3b-735c-4ec0-8cb7-9c3efed4ef42 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:52.565299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51979be3-173a-477e-b041-5cfc91ac1464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:52.565933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51979be3-173a-477e-b041-5cfc91ac1464 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:52.566220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51979be3-173a-477e-b041-5cfc91ac1464 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:52.566518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51979be3-173a-477e-b041-5cfc91ac1464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:52.642846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51979be3-173a-477e-b041-5cfc91ac1464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:52.644364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51979be3-173a-477e-b041-5cfc91ac1464 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:52.693193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:52.752599 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 218/428] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:52.758139 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdba765-d516-4400-af25-9389edc10e37 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:52.773058 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:52.801791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a245b58-878f-409b-9265-9081ed644dbb None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:52.802133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a245b58-878f-409b-9265-9081ed644dbb None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:52.802423 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a245b58-878f-409b-9265-9081ed644dbb None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:52.803812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 219/429] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:18:52.812071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0dea5-de63-41a7-b68c-08abe97668dc None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:52.812359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0dea5-de63-41a7-b68c-08abe97668dc None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:52.812640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0dea5-de63-41a7-b68c-08abe97668dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:52.837849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-c7f0dea5-de63-41a7-b68c-08abe97668dc None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:52.841437 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c7f0dea5-de63-41a7-b68c-08abe97668dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:52.875143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdba765-d516-4400-af25-9389edc10e37 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:52.915564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 220/430] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:52.916537 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b8caf-a921-4280-a822-8abce14bac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:52.917186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b8caf-a921-4280-a822-8abce14bac3b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:52.917476 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b8caf-a921-4280-a822-8abce14bac3b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:52.917758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b8caf-a921-4280-a822-8abce14bac3b None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:52.919079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b8caf-a921-4280-a822-8abce14bac3b None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:52.920550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b8caf-a921-4280-a822-8abce14bac3b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:52.922223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 211/431] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:52 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:52.927637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0dea5-de63-41a7-b68c-08abe97668dc None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:52.957257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b8caf-a921-4280-a822-8abce14bac3b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:53.034245 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:53.066150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0dea5-de63-41a7-b68c-08abe97668dc None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:53.079685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:53.112380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b8caf-a921-4280-a822-8abce14bac3b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:53.115477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c989d8-3086-455c-a95f-84af1ff1b680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:53.116146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c989d8-3086-455c-a95f-84af1ff1b680 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:53.116432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c989d8-3086-455c-a95f-84af1ff1b680 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:53.116708 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c989d8-3086-455c-a95f-84af1ff1b680 None admin] PATH_INFO: `/v3/groups/8bf835a1ce7e4d7194393d0b936d1261` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:53.118616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c989d8-3086-455c-a95f-84af1ff1b680 None admin] RBAC: Authorizing `identity:get_group(group_id=8bf835a1ce7e4d7194393d0b936d1261)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:53.120085 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c989d8-3086-455c-a95f-84af1ff1b680 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:53.121706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 221/432] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:52 2022] GET /identity/v3/groups/8bf835a1ce7e4d7194393d0b936d1261 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:53.128945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c989d8-3086-455c-a95f-84af1ff1b680 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:53.159372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff25dc-0c8b-48f1-bf56-b12e24f87306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:53.160026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff25dc-0c8b-48f1-bf56-b12e24f87306 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:53.160320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff25dc-0c8b-48f1-bf56-b12e24f87306 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:53.160602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff25dc-0c8b-48f1-bf56-b12e24f87306 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:53.175650 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff25dc-0c8b-48f1-bf56-b12e24f87306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-d9ff25dc-0c8b-48f1-bf56-b12e24f87306 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:53.183305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:53.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:53.185059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:53.185059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:53.185059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:53.185059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:53.185059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:53.185059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:53.185059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:53.185059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:53.185059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:53.185059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:53.185059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:53.185059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:53.185660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 212/433] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:18:53.191805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff25dc-0c8b-48f1-bf56-b12e24f87306 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:53.260517 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c989d8-3086-455c-a95f-84af1ff1b680 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:53.299268 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27156cc5-8db2-468e-adaf-4bb3806a3060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:53.299820 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27156cc5-8db2-468e-adaf-4bb3806a3060 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:53.300108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27156cc5-8db2-468e-adaf-4bb3806a3060 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:53.300387 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27156cc5-8db2-468e-adaf-4bb3806a3060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:53.301254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27156cc5-8db2-468e-adaf-4bb3806a3060 None admin] RBAC: Adding query filter params (group.id=8bf835a1ce7e4d7194393d0b936d1261, role.id=b83f9277d44246c5983fe3b6d7d5af96, scope.project.id=0d82d9815c484e6abe046fa9caa21713) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:53.301567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27156cc5-8db2-468e-adaf-4bb3806a3060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:53.303068 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27156cc5-8db2-468e-adaf-4bb3806a3060 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:53.310302 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 222/434] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Aug 4 02:18:53 2022] GET /identity/v3/role_assignments?group.id=8bf835a1ce7e4d7194393d0b936d1261&scope.project.id=0d82d9815c484e6abe046fa9caa21713&role.id=b83f9277d44246c5983fe3b6d7d5af96 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:53.315586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff25dc-0c8b-48f1-bf56-b12e24f87306 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:53.357683 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484896c2-ab42-4025-b862-00d7ed94c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:53.358396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484896c2-ab42-4025-b862-00d7ed94c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:53.358722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484896c2-ab42-4025-b862-00d7ed94c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:53.359001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484896c2-ab42-4025-b862-00d7ed94c3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:53.359759 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484896c2-ab42-4025-b862-00d7ed94c3b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:53.360072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484896c2-ab42-4025-b862-00d7ed94c3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:53.361511 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484896c2-ab42-4025-b862-00d7ed94c3b9 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:53.367856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:53.373384 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 213/435] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:18:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:53.379146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27156cc5-8db2-468e-adaf-4bb3806a3060 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:53.390869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:53.494518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27156cc5-8db2-468e-adaf-4bb3806a3060 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:53.530218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79cd5f-9825-438a-9aee-a87d4266b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:53.530869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79cd5f-9825-438a-9aee-a87d4266b10c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:53.531150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79cd5f-9825-438a-9aee-a87d4266b10c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:53.531422 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79cd5f-9825-438a-9aee-a87d4266b10c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:53.545997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84746507-8ee1-43c6-9070-09c1f608a339 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:53.546316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84746507-8ee1-43c6-9070-09c1f608a339 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:53.547184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84746507-8ee1-43c6-9070-09c1f608a339 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:53.548491 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 214/436] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:53.553363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeb9cb-692d-40c3-9b14-9dfaf3fc7647 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:53.553615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeb9cb-692d-40c3-9b14-9dfaf3fc7647 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:53.553848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeb9cb-692d-40c3-9b14-9dfaf3fc7647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:53.574944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-bdaeb9cb-692d-40c3-9b14-9dfaf3fc7647 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:53.576345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-bdaeb9cb-692d-40c3-9b14-9dfaf3fc7647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:53.613464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79cd5f-9825-438a-9aee-a87d4266b10c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:53.615000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79cd5f-9825-438a-9aee-a87d4266b10c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:53.623814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:53.651959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 215/437] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:53.656228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08377d39-738f-4540-8451-b235cf4c8150 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:53.656521 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08377d39-738f-4540-8451-b235cf4c8150 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:53.656803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08377d39-738f-4540-8451-b235cf4c8150 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:53.658477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 216/438] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:53.663512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c019b8-7c2f-4b23-a805-b4099de118ba None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:53.663797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c019b8-7c2f-4b23-a805-b4099de118ba None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:53.664065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c019b8-7c2f-4b23-a805-b4099de118ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:53.682418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-23c019b8-7c2f-4b23-a805-b4099de118ba None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:53.683617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-23c019b8-7c2f-4b23-a805-b4099de118ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:53.718850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 223/439] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:53.719778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79cd5f-9825-438a-9aee-a87d4266b10c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:53.758121 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 217/440] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:53.759462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c019b8-7c2f-4b23-a805-b4099de118ba None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:53.820268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:53.820618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79cd5f-9825-438a-9aee-a87d4266b10c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:53.828491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:53.854654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c0a70-96f3-40af-94b0-ec3fafa9d01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:53.855286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c0a70-96f3-40af-94b0-ec3fafa9d01d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:53.855629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c0a70-96f3-40af-94b0-ec3fafa9d01d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:53.855887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c0a70-96f3-40af-94b0-ec3fafa9d01d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:53.862994 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c019b8-7c2f-4b23-a805-b4099de118ba None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:53.865662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c0a70-96f3-40af-94b0-ec3fafa9d01d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-1d2c0a70-96f3-40af-94b0-ec3fafa9d01d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:53.870764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:53.871753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 224/441] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:53.877821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c0a70-96f3-40af-94b0-ec3fafa9d01d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:53.900107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c517f-f029-4847-851f-bb5b5ad92463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:53.900749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c517f-f029-4847-851f-bb5b5ad92463 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:53.901031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c517f-f029-4847-851f-bb5b5ad92463 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:53.901309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c517f-f029-4847-851f-bb5b5ad92463 None admin] PATH_INFO: `/v3/projects/b312e6a347184d229a1a2c04149bbe2e` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:53.902479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c517f-f029-4847-851f-bb5b5ad92463 None admin] RBAC: Authorizing `identity:get_project(project_id=b312e6a347184d229a1a2c04149bbe2e)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:53.903947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c517f-f029-4847-851f-bb5b5ad92463 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:53.905871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 218/442] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:53 2022] GET /identity/v3/projects/b312e6a347184d229a1a2c04149bbe2e => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:53.906646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c517f-f029-4847-851f-bb5b5ad92463 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:53.975077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c0a70-96f3-40af-94b0-ec3fafa9d01d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:54.004088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c517f-f029-4847-851f-bb5b5ad92463 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:54.009149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f6b4c-e5d6-49fc-b108-2c86d4c1cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:54.009784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f6b4c-e5d6-49fc-b108-2c86d4c1cb5c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:54.010068 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f6b4c-e5d6-49fc-b108-2c86d4c1cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:54.010345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f6b4c-e5d6-49fc-b108-2c86d4c1cb5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:54.020327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f6b4c-e5d6-49fc-b108-2c86d4c1cb5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-278f6b4c-e5d6-49fc-b108-2c86d4c1cb5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:18:54.025319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:54.026274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 225/443] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:18:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:54.032551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f6b4c-e5d6-49fc-b108-2c86d4c1cb5c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:54.034108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:54.038218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dba439-a137-4f27-bdb2-c318cd116f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:54.038871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dba439-a137-4f27-bdb2-c318cd116f32 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:54.039152 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dba439-a137-4f27-bdb2-c318cd116f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:54.039429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dba439-a137-4f27-bdb2-c318cd116f32 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:54.041058 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dba439-a137-4f27-bdb2-c318cd116f32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:54.047857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dba439-a137-4f27-bdb2-c318cd116f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:54.047857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dba439-a137-4f27-bdb2-c318cd116f32 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:54.051080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 219/444] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:18:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:54.051855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dba439-a137-4f27-bdb2-c318cd116f32 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:54.061735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:54.133471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f6b4c-e5d6-49fc-b108-2c86d4c1cb5c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:54.149619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dba439-a137-4f27-bdb2-c318cd116f32 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:54.167797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6e361-a0e9-432a-9cb3-37886bf9030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:54.168438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6e361-a0e9-432a-9cb3-37886bf9030a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:54.168723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6e361-a0e9-432a-9cb3-37886bf9030a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:54.169163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6e361-a0e9-432a-9cb3-37886bf9030a None admin] PATH_INFO: `/v3/groups/8bf835a1ce7e4d7194393d0b936d1261` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:54.170349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6e361-a0e9-432a-9cb3-37886bf9030a None admin] RBAC: Authorizing `identity:get_group(group_id=8bf835a1ce7e4d7194393d0b936d1261)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:54.171844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6e361-a0e9-432a-9cb3-37886bf9030a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:54.173430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 226/445] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:54 2022] GET /identity/v3/groups/8bf835a1ce7e4d7194393d0b936d1261 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:54.174187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6e361-a0e9-432a-9cb3-37886bf9030a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:54.184568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa887b5-635b-409b-9ca3-92a56924282c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:54.185175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa887b5-635b-409b-9ca3-92a56924282c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:54.185455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa887b5-635b-409b-9ca3-92a56924282c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:54.185726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa887b5-635b-409b-9ca3-92a56924282c None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:54.186732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa887b5-635b-409b-9ca3-92a56924282c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:54.187036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa887b5-635b-409b-9ca3-92a56924282c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:54.188394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa887b5-635b-409b-9ca3-92a56924282c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:54.196729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 220/446] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:18:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:54.197634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa887b5-635b-409b-9ca3-92a56924282c None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:54.250502 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:54.271190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:54.278362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6e361-a0e9-432a-9cb3-37886bf9030a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:54.297218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa887b5-635b-409b-9ca3-92a56924282c None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:54.312486 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d0cc3-4dc0-47f3-8222-8d3b2845b82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:54.313253 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d0cc3-4dc0-47f3-8222-8d3b2845b82a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:54.313646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d0cc3-4dc0-47f3-8222-8d3b2845b82a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:54.314026 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d0cc3-4dc0-47f3-8222-8d3b2845b82a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:54.334336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12016cbc-27dd-441d-bb82-02fb24a945f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:54.334959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12016cbc-27dd-441d-bb82-02fb24a945f3 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:54.335242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12016cbc-27dd-441d-bb82-02fb24a945f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:54.335517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12016cbc-27dd-441d-bb82-02fb24a945f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:54.336300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12016cbc-27dd-441d-bb82-02fb24a945f3 None admin] RBAC: Adding query filter params (group.id=8bf835a1ce7e4d7194393d0b936d1261, role.id=d2d09ac7138145968d31dde4d5b9ee5a, scope.project.id=b312e6a347184d229a1a2c04149bbe2e) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:54.336606 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12016cbc-27dd-441d-bb82-02fb24a945f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:54.338638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12016cbc-27dd-441d-bb82-02fb24a945f3 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:54.344187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 221/447] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Aug 4 02:18:54 2022] GET /identity/v3/role_assignments?group.id=8bf835a1ce7e4d7194393d0b936d1261&scope.project.id=b312e6a347184d229a1a2c04149bbe2e&role.id=d2d09ac7138145968d31dde4d5b9ee5a => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:54.344946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12016cbc-27dd-441d-bb82-02fb24a945f3 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:54.408826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d0cc3-4dc0-47f3-8222-8d3b2845b82a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:54.411292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d0cc3-4dc0-47f3-8222-8d3b2845b82a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:54.469220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12016cbc-27dd-441d-bb82-02fb24a945f3 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:54.488232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:54.510368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaca636-46f2-4735-a9d3-48d2aee3e78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:54.511283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaca636-46f2-4735-a9d3-48d2aee3e78a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:54.511757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaca636-46f2-4735-a9d3-48d2aee3e78a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:54.511885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaca636-46f2-4735-a9d3-48d2aee3e78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:54.519582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:54.530531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 227/448] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:54.536950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d0cc3-4dc0-47f3-8222-8d3b2845b82a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:54.603734 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaca636-46f2-4735-a9d3-48d2aee3e78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:54.605686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaca636-46f2-4735-a9d3-48d2aee3e78a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:54.656625 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d0cc3-4dc0-47f3-8222-8d3b2845b82a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:54.702271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480282e-7885-4a83-ad79-03b340b7fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:54.702882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480282e-7885-4a83-ad79-03b340b7fe7c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:54.703386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480282e-7885-4a83-ad79-03b340b7fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:54.703498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480282e-7885-4a83-ad79-03b340b7fe7c None admin] PATH_INFO: `/v3/projects/0d82d9815c484e6abe046fa9caa21713` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:54.704612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480282e-7885-4a83-ad79-03b340b7fe7c None admin] RBAC: Authorizing `identity:get_project(project_id=0d82d9815c484e6abe046fa9caa21713)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:54.706060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480282e-7885-4a83-ad79-03b340b7fe7c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:54.707833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 228/449] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:54 2022] GET /identity/v3/projects/0d82d9815c484e6abe046fa9caa21713 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:54.714618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480282e-7885-4a83-ad79-03b340b7fe7c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:54.727128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 222/450] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:18:54.733476 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaca636-46f2-4735-a9d3-48d2aee3e78a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:54.753228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:54.793671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:54.840951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480282e-7885-4a83-ad79-03b340b7fe7c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:54.850352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaca636-46f2-4735-a9d3-48d2aee3e78a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:54.877240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1f3dd-4606-404b-9800-6f35752f6672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:54.877895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1f3dd-4606-404b-9800-6f35752f6672 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:54.878180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1f3dd-4606-404b-9800-6f35752f6672 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:54.878461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1f3dd-4606-404b-9800-6f35752f6672 None admin] PATH_INFO: `/v3/groups/8bf835a1ce7e4d7194393d0b936d1261` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:54.879652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1f3dd-4606-404b-9800-6f35752f6672 None admin] RBAC: Authorizing `identity:get_group(group_id=8bf835a1ce7e4d7194393d0b936d1261)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:54.881120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1f3dd-4606-404b-9800-6f35752f6672 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:54.882791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 229/451] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:54 2022] GET /identity/v3/groups/8bf835a1ce7e4d7194393d0b936d1261 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:54.887743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191b4d5-bc4d-49bf-a92f-e17d81a01af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:54.888447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191b4d5-bc4d-49bf-a92f-e17d81a01af3 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:54.888733 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191b4d5-bc4d-49bf-a92f-e17d81a01af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:54.888826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1f3dd-4606-404b-9800-6f35752f6672 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:54.889008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191b4d5-bc4d-49bf-a92f-e17d81a01af3 None admin] PATH_INFO: `/v3/projects/7aa60e5b58354576a0cb898fee2dc9ca` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:54.890159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191b4d5-bc4d-49bf-a92f-e17d81a01af3 None admin] RBAC: Authorizing `identity:get_project(project_id=7aa60e5b58354576a0cb898fee2dc9ca)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:54.891671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191b4d5-bc4d-49bf-a92f-e17d81a01af3 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:54.893321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 223/452] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:18:54 2022] GET /identity/v3/projects/7aa60e5b58354576a0cb898fee2dc9ca => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:54.898421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191b4d5-bc4d-49bf-a92f-e17d81a01af3 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:54.982268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:54.988758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1f3dd-4606-404b-9800-6f35752f6672 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:54.998007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191b4d5-bc4d-49bf-a92f-e17d81a01af3 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:55.016913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:55.022802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8282aaa-ea81-4040-aa5b-6d9dfdfde865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:55.023481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8282aaa-ea81-4040-aa5b-6d9dfdfde865 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:55.024040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8282aaa-ea81-4040-aa5b-6d9dfdfde865 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:55.024040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8282aaa-ea81-4040-aa5b-6d9dfdfde865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:55.025357 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8282aaa-ea81-4040-aa5b-6d9dfdfde865 None admin] RBAC: Adding query filter params (group.id=8bf835a1ce7e4d7194393d0b936d1261, role.id=d2d09ac7138145968d31dde4d5b9ee5a, scope.project.id=0d82d9815c484e6abe046fa9caa21713) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:55.025672 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8282aaa-ea81-4040-aa5b-6d9dfdfde865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:55.027160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8282aaa-ea81-4040-aa5b-6d9dfdfde865 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:55.032022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c8489-bff2-4aec-85ea-9503cc7c76fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:55.032656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c8489-bff2-4aec-85ea-9503cc7c76fa None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:55.032927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 230/453] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Aug 4 02:18:54 2022] GET /identity/v3/role_assignments?group.id=8bf835a1ce7e4d7194393d0b936d1261&scope.project.id=0d82d9815c484e6abe046fa9caa21713&role.id=d2d09ac7138145968d31dde4d5b9ee5a => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:55.033047 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c8489-bff2-4aec-85ea-9503cc7c76fa None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:55.033204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c8489-bff2-4aec-85ea-9503cc7c76fa None admin] PATH_INFO: `/v3/groups/33ea2d3d887a467db56b72c99ed95a7b` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:55.034372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c8489-bff2-4aec-85ea-9503cc7c76fa None admin] RBAC: Authorizing `identity:get_group(group_id=33ea2d3d887a467db56b72c99ed95a7b)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:55.035847 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c8489-bff2-4aec-85ea-9503cc7c76fa None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:55.037628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 224/454] 10.222.0.60 () {56 vars in 1180 bytes} [Thu Aug 4 02:18:54 2022] GET /identity/v3/groups/33ea2d3d887a467db56b72c99ed95a7b => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:55.047744 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8282aaa-ea81-4040-aa5b-6d9dfdfde865 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:55.171049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8282aaa-ea81-4040-aa5b-6d9dfdfde865 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:55.212339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec4a6f-0250-47eb-9c55-ffd06ecc4960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:55.213194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec4a6f-0250-47eb-9c55-ffd06ecc4960 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:55.213587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec4a6f-0250-47eb-9c55-ffd06ecc4960 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:55.213969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec4a6f-0250-47eb-9c55-ffd06ecc4960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:55.215155 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec4a6f-0250-47eb-9c55-ffd06ecc4960 None admin] RBAC: Adding query filter params (group.id=33ea2d3d887a467db56b72c99ed95a7b, role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=7aa60e5b58354576a0cb898fee2dc9ca) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:55.215598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec4a6f-0250-47eb-9c55-ffd06ecc4960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:55.217716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec4a6f-0250-47eb-9c55-ffd06ecc4960 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:55.225785 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 231/455] 10.222.0.60 () {56 vars in 1376 bytes} [Thu Aug 4 02:18:55 2022] GET /identity/v3/role_assignments?group.id=33ea2d3d887a467db56b72c99ed95a7b&scope.project.id=7aa60e5b58354576a0cb898fee2dc9ca&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:57.718517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115f8df-7aaf-47c3-b41b-4df8db9d3f5a None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:57.719066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115f8df-7aaf-47c3-b41b-4df8db9d3f5a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:57.719066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115f8df-7aaf-47c3-b41b-4df8db9d3f5a None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:57.720743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 225/456] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:57.726435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eba2a5-e181-45bb-a7c2-cdd14ae2eb0c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:57.727513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eba2a5-e181-45bb-a7c2-cdd14ae2eb0c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:57.728039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eba2a5-e181-45bb-a7c2-cdd14ae2eb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:57.755592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-48eba2a5-e181-45bb-a7c2-cdd14ae2eb0c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:57.757146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-48eba2a5-e181-45bb-a7c2-cdd14ae2eb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:57.804781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ee6b3-7e43-4455-b64f-5c6fe48a8da0 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:57.805100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ee6b3-7e43-4455-b64f-5c6fe48a8da0 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:57.805383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ee6b3-7e43-4455-b64f-5c6fe48a8da0 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:57.808281 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 226/457] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:57.812957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248a312-a524-42ab-9703-85888264d242 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:57.813250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248a312-a524-42ab-9703-85888264d242 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:57.813531 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248a312-a524-42ab-9703-85888264d242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:57.842890 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:57.847601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b248a312-a524-42ab-9703-85888264d242 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:57.850181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b248a312-a524-42ab-9703-85888264d242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:57.872291 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 232/458] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:57.917729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eba2a5-e181-45bb-a7c2-cdd14ae2eb0c None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:57.943879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 227/459] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:58.021933 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248a312-a524-42ab-9703-85888264d242 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:58.060274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eba2a5-e181-45bb-a7c2-cdd14ae2eb0c None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:58.106344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f785909-77ed-4d3d-82a2-9d3f8680757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:58.107040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f785909-77ed-4d3d-82a2-9d3f8680757d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:58.107818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f785909-77ed-4d3d-82a2-9d3f8680757d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:58.108108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f785909-77ed-4d3d-82a2-9d3f8680757d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:58.115002 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:58.121493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f785909-77ed-4d3d-82a2-9d3f8680757d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:58.123238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f785909-77ed-4d3d-82a2-9d3f8680757d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:58.140842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248a312-a524-42ab-9703-85888264d242 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-4f785909-77ed-4d3d-82a2-9d3f8680757d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:18:58.144038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:58.145058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:58.145915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:18:58.145915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:18:58.145915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:18:58.145915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:58.145915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 233/460] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:58.150516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f97b41-3829-4b21-b26e-8fff73e81e24 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:58.150516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f97b41-3829-4b21-b26e-8fff73e81e24 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:58.150516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f97b41-3829-4b21-b26e-8fff73e81e24 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:58.150516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 234/461] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:58.156584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab4eb5-cba6-4aaa-8298-65d8b721332b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:58.156877 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab4eb5-cba6-4aaa-8298-65d8b721332b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:58.157159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab4eb5-cba6-4aaa-8298-65d8b721332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:58.177401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-93ab4eb5-cba6-4aaa-8298-65d8b721332b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:58.178756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-93ab4eb5-cba6-4aaa-8298-65d8b721332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:58.185406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4d23c-2048-48c8-8f84-b55460c9b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:58.186058 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d23c-2048-48c8-8f84-b55460c9b5dd None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:58.187237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d23c-2048-48c8-8f84-b55460c9b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:58.189084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d23c-2048-48c8-8f84-b55460c9b5dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:58.203407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4d23c-2048-48c8-8f84-b55460c9b5dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:58.205140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4d23c-2048-48c8-8f84-b55460c9b5dd None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:58.219999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-9ce4d23c-2048-48c8-8f84-b55460c9b5dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:18:58.226730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:58.229026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:58.230090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:18:58.230090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:18:58.230090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:18:58.230090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:58.230515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 228/462] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:58.235020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4d23c-2048-48c8-8f84-b55460c9b5dd None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:58.264867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 235/463] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:58.271433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab4eb5-cba6-4aaa-8298-65d8b721332b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:58.356423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4d23c-2048-48c8-8f84-b55460c9b5dd None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:58.394337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bd9b9-7819-4f8a-8aed-c991128d292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:58.395017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bd9b9-7819-4f8a-8aed-c991128d292a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:58.395301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bd9b9-7819-4f8a-8aed-c991128d292a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:58.395681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bd9b9-7819-4f8a-8aed-c991128d292a None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:58.396416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bd9b9-7819-4f8a-8aed-c991128d292a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:58.396799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bd9b9-7819-4f8a-8aed-c991128d292a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:58.398207 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bd9b9-7819-4f8a-8aed-c991128d292a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:58.400002 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab4eb5-cba6-4aaa-8298-65d8b721332b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:58.400801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:58.412808 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 229/464] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:58.413815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bd9b9-7819-4f8a-8aed-c991128d292a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:58.442339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6cc6-08d6-44dd-876e-ee555a3e69b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:58.443060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6cc6-08d6-44dd-876e-ee555a3e69b7 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:58.443347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6cc6-08d6-44dd-876e-ee555a3e69b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:58.443630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6cc6-08d6-44dd-876e-ee555a3e69b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:58.444327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c6cc6-08d6-44dd-876e-ee555a3e69b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:58.444638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c6cc6-08d6-44dd-876e-ee555a3e69b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:58.446709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c6cc6-08d6-44dd-876e-ee555a3e69b7 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:58.467320 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 236/465] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:58.468528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6cc6-08d6-44dd-876e-ee555a3e69b7 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:58.501302 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:58.526053 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bd9b9-7819-4f8a-8aed-c991128d292a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:58.564409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e81ef5-d807-495c-b31a-1aa7533905e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:58.565064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e81ef5-d807-495c-b31a-1aa7533905e7 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:58.565350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e81ef5-d807-495c-b31a-1aa7533905e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:58.565722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e81ef5-d807-495c-b31a-1aa7533905e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:58.578210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e81ef5-d807-495c-b31a-1aa7533905e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:58.579758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6cc6-08d6-44dd-876e-ee555a3e69b7 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:58.579968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e81ef5-d807-495c-b31a-1aa7533905e7 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-b6e81ef5-d807-495c-b31a-1aa7533905e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:18:58.597105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:58.599151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:58.601258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:18:58.601258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:18:58.601258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:18:58.601258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:58.601258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 230/466] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:58.601258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e81ef5-d807-495c-b31a-1aa7533905e7 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:58.622572 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c256862-a590-41bf-bb49-7abc1742138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:58.623111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c256862-a590-41bf-bb49-7abc1742138a None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:58.623397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c256862-a590-41bf-bb49-7abc1742138a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:58.623674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c256862-a590-41bf-bb49-7abc1742138a None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:58.624377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c256862-a590-41bf-bb49-7abc1742138a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:58.625845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c256862-a590-41bf-bb49-7abc1742138a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:58.652455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:58.705318 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e81ef5-d807-495c-b31a-1aa7533905e7 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:58.731079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 237/467] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:18:58 2022] POST /identity/v3/users => generated 246 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:18:58.739615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9eaf1-14f6-43c7-8a22-c9124c3e6afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:58.740317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9eaf1-14f6-43c7-8a22-c9124c3e6afa None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:58.740552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9eaf1-14f6-43c7-8a22-c9124c3e6afa None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:58.740835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9eaf1-14f6-43c7-8a22-c9124c3e6afa None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:58.741586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9eaf1-14f6-43c7-8a22-c9124c3e6afa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:58.743649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9eaf1-14f6-43c7-8a22-c9124c3e6afa None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:58.744630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248fa78-9812-4c16-97ab-e11ba58f09d1 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:58.744928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248fa78-9812-4c16-97ab-e11ba58f09d1 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:58.745209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248fa78-9812-4c16-97ab-e11ba58f09d1 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:58.746612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 238/468] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:58 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:18:58.751353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248fa78-9812-4c16-97ab-e11ba58f09d1 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:58.834697 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 231/469] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:18:58 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:18:58.836565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f64508-2ec8-4911-b63d-4b08f8e95604 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:58.837124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f64508-2ec8-4911-b63d-4b08f8e95604 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:58.837908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f64508-2ec8-4911-b63d-4b08f8e95604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:58.883313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-d7f64508-2ec8-4911-b63d-4b08f8e95604 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:58.888562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d7f64508-2ec8-4911-b63d-4b08f8e95604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:58.907497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:58.930002 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248fa78-9812-4c16-97ab-e11ba58f09d1 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:58.976278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b5c51-85ae-497d-9777-ba91a3d77f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:58.978038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b5c51-85ae-497d-9777-ba91a3d77f68 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:58.978038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b5c51-85ae-497d-9777-ba91a3d77f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:58.978770 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b5c51-85ae-497d-9777-ba91a3d77f68 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:58.979410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b5c51-85ae-497d-9777-ba91a3d77f68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:58.979729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b5c51-85ae-497d-9777-ba91a3d77f68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:58.981272 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b5c51-85ae-497d-9777-ba91a3d77f68 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:58.991878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 232/470] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:18:59.000789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 239/471] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:18:59.006162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f64508-2ec8-4911-b63d-4b08f8e95604 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:59.032811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b5c51-85ae-497d-9777-ba91a3d77f68 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:59.060249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:59.144812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f64508-2ec8-4911-b63d-4b08f8e95604 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:59.177080 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b5c51-85ae-497d-9777-ba91a3d77f68 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:59.184162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1b603-60a9-4c9d-9c98-a6203eec62ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:59.184793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1b603-60a9-4c9d-9c98-a6203eec62ff None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:59.185080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1b603-60a9-4c9d-9c98-a6203eec62ff None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:59.185360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1b603-60a9-4c9d-9c98-a6203eec62ff None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:59.186323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1b603-60a9-4c9d-9c98-a6203eec62ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:59.187952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1b603-60a9-4c9d-9c98-a6203eec62ff None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:59.221702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1c322-2555-4e85-81c1-8a25180715ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:59.222358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c322-2555-4e85-81c1-8a25180715ed None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:59.222763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c322-2555-4e85-81c1-8a25180715ed None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:59.223054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c322-2555-4e85-81c1-8a25180715ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:59.236928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1c322-2555-4e85-81c1-8a25180715ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:59.239468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1c322-2555-4e85-81c1-8a25180715ed None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:59.247665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-35e1c322-2555-4e85-81c1-8a25180715ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:18:59.257552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:18:59.258698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:18:59.259776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:18:59.259776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:18:59.259776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:18:59.259776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:18:59.261480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 240/472] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:59.270188 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1c322-2555-4e85-81c1-8a25180715ed None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:59.275670 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 233/473] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:18:59 2022] POST /identity/v3/users => generated 248 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:18:59.325420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367b21-7d72-45a8-95ce-91063f17af69 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:59.325961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367b21-7d72-45a8-95ce-91063f17af69 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:59.326429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367b21-7d72-45a8-95ce-91063f17af69 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:59.328032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 234/474] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:18:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:18:59.334537 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f1822-497e-487b-90c7-d5b51e373628 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:59.334972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f1822-497e-487b-90c7-d5b51e373628 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:59.335395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f1822-497e-487b-90c7-d5b51e373628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:59.356362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-0f4f1822-497e-487b-90c7-d5b51e373628 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:18:59.357717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0f4f1822-497e-487b-90c7-d5b51e373628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:18:59.403644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1c322-2555-4e85-81c1-8a25180715ed None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:59.437648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 235/475] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:18:59.444557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de053b-5833-4502-8025-c3ff8b670d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:59.445439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de053b-5833-4502-8025-c3ff8b670d84 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:59.445907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de053b-5833-4502-8025-c3ff8b670d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:59.446361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de053b-5833-4502-8025-c3ff8b670d84 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:59.447253 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de053b-5833-4502-8025-c3ff8b670d84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:18:59.447714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de053b-5833-4502-8025-c3ff8b670d84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:59.449385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de053b-5833-4502-8025-c3ff8b670d84 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:59.462281 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f1822-497e-487b-90c7-d5b51e373628 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:59.465361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 241/476] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:18:59.476202 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de053b-5833-4502-8025-c3ff8b670d84 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:59.494372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:59.553229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:59.580603 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f1822-497e-487b-90c7-d5b51e373628 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:59.601911 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de053b-5833-4502-8025-c3ff8b670d84 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:59.620328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cf4e8-0502-46b1-836e-d89ea36cdde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:59.620990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cf4e8-0502-46b1-836e-d89ea36cdde7 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:59.621395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cf4e8-0502-46b1-836e-d89ea36cdde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:59.621769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cf4e8-0502-46b1-836e-d89ea36cdde7 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:59.622625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cf4e8-0502-46b1-836e-d89ea36cdde7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:59.624223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cf4e8-0502-46b1-836e-d89ea36cdde7 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:59.645009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29687c1-fef7-4fc7-9864-c2d6c611b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:59.645872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29687c1-fef7-4fc7-9864-c2d6c611b584 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:59.646330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29687c1-fef7-4fc7-9864-c2d6c611b584 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:59.646786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29687c1-fef7-4fc7-9864-c2d6c611b584 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:59.647614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29687c1-fef7-4fc7-9864-c2d6c611b584 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:18:59.649946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29687c1-fef7-4fc7-9864-c2d6c611b584 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:18:59.663158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.sql.core [None req-026cf4e8-0502-46b1-836e-d89ea36cdde7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 02:18:59.663158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 02:18:59.663158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [parameters: {'id': '28c610bd8205444a84727cf3ed745b8c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 02:18:59.663158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80641) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-026cf4e8-0502-46b1-836e-d89ea36cdde7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application conn.query(q) Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application result.read() Aug 04 02:18:59.681530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return ref.to_dict() Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 02:18:59.682722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application next(self.gen) Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application yield resource Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application next(self.gen) Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise self.value Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application session.commit() Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 02:18:59.683892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self.session.flush() Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application compat.raise_( Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 02:18:59.685068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 02:18:59.686300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application conn.query(q) Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application result.read() Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 02:18:59.687982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [parameters: {'id': '28c610bd8205444a84727cf3ed745b8c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:18:59.691119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 02:18:59.692902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:18:59.694941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 236/477] 10.222.0.60 () {60 vars in 1131 bytes} [Thu Aug 4 02:18:59 2022] POST /identity/v3/roles => generated 144 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:18:59.694941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cf4e8-0502-46b1-836e-d89ea36cdde7 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:18:59.726981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 242/478] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:18:59 2022] POST /identity/v3/users => generated 249 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:18:59.806538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:18:59.830630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cf4e8-0502-46b1-836e-d89ea36cdde7 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:18:59.979798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc41f9-811e-44a5-8179-f12d15db6ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:18:59.980934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc41f9-811e-44a5-8179-f12d15db6ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:18:59.981423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc41f9-811e-44a5-8179-f12d15db6ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:18:59.981903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc41f9-811e-44a5-8179-f12d15db6ed6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:18:59.996503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc41f9-811e-44a5-8179-f12d15db6ed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-dcbc41f9-811e-44a5-8179-f12d15db6ed6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:00.001921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:00.002851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:00.003660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:00.003660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:00.003660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:00.003660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:00.003660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:00.003660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:00.003660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:00.003660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:00.003660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:00.003660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:00.003660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:19:00.003660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:00.006404 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 237/479] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:18:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:00.012534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29687c1-fef7-4fc7-9864-c2d6c611b584 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:00.165870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29687c1-fef7-4fc7-9864-c2d6c611b584 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:00.182852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:00.206113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe72f6-632d-443d-9ec9-9daaf6ffda3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:00.206797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe72f6-632d-443d-9ec9-9daaf6ffda3c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:00.207090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe72f6-632d-443d-9ec9-9daaf6ffda3c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:00.207369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe72f6-632d-443d-9ec9-9daaf6ffda3c None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:00.214221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe72f6-632d-443d-9ec9-9daaf6ffda3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:00.214221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe72f6-632d-443d-9ec9-9daaf6ffda3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:00.214221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe72f6-632d-443d-9ec9-9daaf6ffda3c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:00.220208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 243/480] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:01.336235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b8e8b-3672-4c2c-8297-e75fcf47092c None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:01.338116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b8e8b-3672-4c2c-8297-e75fcf47092c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:01.338593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b8e8b-3672-4c2c-8297-e75fcf47092c None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:01.340443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 238/481] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:01.346515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871bf05-bb9f-431c-a5b7-0818d8893f6a None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:01.346966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871bf05-bb9f-431c-a5b7-0818d8893f6a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:01.347062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871bf05-bb9f-431c-a5b7-0818d8893f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:01.375588 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f871bf05-bb9f-431c-a5b7-0818d8893f6a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:01.376852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f871bf05-bb9f-431c-a5b7-0818d8893f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:01.477719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 244/482] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:01.517749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871bf05-bb9f-431c-a5b7-0818d8893f6a None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:01.518029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c880d-a34e-4044-87db-11a0b4c79576 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:01.518323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c880d-a34e-4044-87db-11a0b4c79576 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:01.518650 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c880d-a34e-4044-87db-11a0b4c79576 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:01.520248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 239/483] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:01.526087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e61b3-dc5f-441e-8035-a28ff7b68645 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:01.526376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e61b3-dc5f-441e-8035-a28ff7b68645 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:01.526680 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e61b3-dc5f-441e-8035-a28ff7b68645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:01.564551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b88e61b3-dc5f-441e-8035-a28ff7b68645 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:01.565771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b88e61b3-dc5f-441e-8035-a28ff7b68645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:01.716349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871bf05-bb9f-431c-a5b7-0818d8893f6a None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:01.724184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 240/484] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:01.730782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:01.759192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd51059-9464-47e9-b09f-23296bef5b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:01.759850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd51059-9464-47e9-b09f-23296bef5b14 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:01.760137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd51059-9464-47e9-b09f-23296bef5b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:01.760419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd51059-9464-47e9-b09f-23296bef5b14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:01.768159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e61b3-dc5f-441e-8035-a28ff7b68645 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:01.786833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd51059-9464-47e9-b09f-23296bef5b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-9fd51059-9464-47e9-b09f-23296bef5b14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:01.792940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:01.793826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:01.794660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:01.794660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:01.794660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:01.794660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:01.794660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:01.794660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:01.794660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:01.794660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:01.794660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:01.794660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:01.794660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:01.794660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:01.803887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 245/485] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:01.804751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd51059-9464-47e9-b09f-23296bef5b14 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:01.916839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:01.947038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd51059-9464-47e9-b09f-23296bef5b14 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:01.994674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e61b3-dc5f-441e-8035-a28ff7b68645 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:02.001814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1373a-c4ad-4f66-8eed-4d8e1dfba49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:02.002736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1373a-c4ad-4f66-8eed-4d8e1dfba49b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.003057 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1373a-c4ad-4f66-8eed-4d8e1dfba49b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.003337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1373a-c4ad-4f66-8eed-4d8e1dfba49b None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.004060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1373a-c4ad-4f66-8eed-4d8e1dfba49b None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:02.004370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1373a-c4ad-4f66-8eed-4d8e1dfba49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:02.005759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1373a-c4ad-4f66-8eed-4d8e1dfba49b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:02.016030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 246/486] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:02.017303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7695053-ef9f-4531-9ae6-3b0d7c3ffbd4 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.017592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7695053-ef9f-4531-9ae6-3b0d7c3ffbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.017871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7695053-ef9f-4531-9ae6-3b0d7c3ffbd4 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.023172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 247/487] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:02.024177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7695053-ef9f-4531-9ae6-3b0d7c3ffbd4 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:02.056794 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:02.058588 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2988dba-8cc7-404e-90f3-caff5b11bc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:02.059488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2988dba-8cc7-404e-90f3-caff5b11bc19 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.060168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2988dba-8cc7-404e-90f3-caff5b11bc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.061201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2988dba-8cc7-404e-90f3-caff5b11bc19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.075232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2988dba-8cc7-404e-90f3-caff5b11bc19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-c2988dba-8cc7-404e-90f3-caff5b11bc19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:02.082140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:02.083111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:02.083898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:02.083898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:02.083898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:02.083898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:02.083898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:02.083898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:02.083898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:02.083898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:02.083898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:02.083898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:02.083898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:02.083898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:02.087242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 241/488] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:02.089511 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa3318-a6b9-4c46-8ecc-04fa195844da None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.090324 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa3318-a6b9-4c46-8ecc-04fa195844da None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.090819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa3318-a6b9-4c46-8ecc-04fa195844da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.117548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-34aa3318-a6b9-4c46-8ecc-04fa195844da None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:02.120186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-34aa3318-a6b9-4c46-8ecc-04fa195844da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:02.154146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7695053-ef9f-4531-9ae6-3b0d7c3ffbd4 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:02.199029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246e1a2-7ebe-429c-8323-ac137b95e599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:02.199837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e1a2-7ebe-429c-8323-ac137b95e599 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.199965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e1a2-7ebe-429c-8323-ac137b95e599 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.200240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246e1a2-7ebe-429c-8323-ac137b95e599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.210129 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 242/489] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:02.211435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa3318-a6b9-4c46-8ecc-04fa195844da None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:02.219721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246e1a2-7ebe-429c-8323-ac137b95e599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:02.221377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246e1a2-7ebe-429c-8323-ac137b95e599 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-0246e1a2-7ebe-429c-8323-ac137b95e599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:02.249132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:02.250050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:02.251523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:02.251523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:02.251523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:02.251523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:02.254861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 248/490] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:02.255756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246e1a2-7ebe-429c-8323-ac137b95e599 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:02.295429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:02.345215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa3318-a6b9-4c46-8ecc-04fa195844da None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:02.347589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:02.369146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246e1a2-7ebe-429c-8323-ac137b95e599 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:02.385115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33cc6e-8a60-430f-b9fa-da265b53da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:02.386277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33cc6e-8a60-430f-b9fa-da265b53da31 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.386969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33cc6e-8a60-430f-b9fa-da265b53da31 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.387471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33cc6e-8a60-430f-b9fa-da265b53da31 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.388756 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33cc6e-8a60-430f-b9fa-da265b53da31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:02.389301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33cc6e-8a60-430f-b9fa-da265b53da31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:02.391439 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33cc6e-8a60-430f-b9fa-da265b53da31 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:02.406164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 243/491] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:02.406164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33cc6e-8a60-430f-b9fa-da265b53da31 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:02.409605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d7f52-0278-463b-b44f-80372aaa9298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:02.411525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d7f52-0278-463b-b44f-80372aaa9298 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.411889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d7f52-0278-463b-b44f-80372aaa9298 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.412179 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d7f52-0278-463b-b44f-80372aaa9298 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.412889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d7f52-0278-463b-b44f-80372aaa9298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:02.413202 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d7f52-0278-463b-b44f-80372aaa9298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:02.415197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d7f52-0278-463b-b44f-80372aaa9298 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:02.437649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 249/492] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:02.437649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c4d4-fbef-47c8-88ad-da885b9d04dd None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.437649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c4d4-fbef-47c8-88ad-da885b9d04dd None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.437649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c4d4-fbef-47c8-88ad-da885b9d04dd None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.437649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 250/493] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:02.437649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c4d4-fbef-47c8-88ad-da885b9d04dd None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:02.516534 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33cc6e-8a60-430f-b9fa-da265b53da31 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:02.543786 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:02.553640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c4d4-fbef-47c8-88ad-da885b9d04dd None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:02.555620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c208f5-528b-4c03-9ffa-18eaa3596bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:02.555620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c208f5-528b-4c03-9ffa-18eaa3596bdb None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.555620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c208f5-528b-4c03-9ffa-18eaa3596bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.556008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c208f5-528b-4c03-9ffa-18eaa3596bdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.567320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c208f5-528b-4c03-9ffa-18eaa3596bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-31c208f5-528b-4c03-9ffa-18eaa3596bdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:02.572440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:02.573620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 244/494] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:02.579358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c208f5-528b-4c03-9ffa-18eaa3596bdb None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:02.600635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa165ec3-5eb2-4b9d-9236-6bf0022104bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:02.601461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165ec3-5eb2-4b9d-9236-6bf0022104bf None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.601754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165ec3-5eb2-4b9d-9236-6bf0022104bf None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.602606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165ec3-5eb2-4b9d-9236-6bf0022104bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.611655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:02.613869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa165ec3-5eb2-4b9d-9236-6bf0022104bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:02.615373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa165ec3-5eb2-4b9d-9236-6bf0022104bf None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-aa165ec3-5eb2-4b9d-9236-6bf0022104bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:02.630813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:02.631732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:02.632599 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:02.632599 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:02.632599 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:02.632599 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:02.632599 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 251/495] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:02.634244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5949dd-ac8b-4f6d-8b43-5bca52872185 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.634627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5949dd-ac8b-4f6d-8b43-5bca52872185 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.634909 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5949dd-ac8b-4f6d-8b43-5bca52872185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.653446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-8a5949dd-ac8b-4f6d-8b43-5bca52872185 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:02.654697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8a5949dd-ac8b-4f6d-8b43-5bca52872185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:02.690142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c208f5-528b-4c03-9ffa-18eaa3596bdb None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:02.725763 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b81dea-f2e3-469f-a677-c79dbaaafbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:02.726535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b81dea-f2e3-469f-a677-c79dbaaafbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.726845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b81dea-f2e3-469f-a677-c79dbaaafbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.727664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b81dea-f2e3-469f-a677-c79dbaaafbb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.735092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 252/496] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:02.735092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5949dd-ac8b-4f6d-8b43-5bca52872185 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:02.740432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b81dea-f2e3-469f-a677-c79dbaaafbb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:02.741920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b81dea-f2e3-469f-a677-c79dbaaafbb8 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-b8b81dea-f2e3-469f-a677-c79dbaaafbb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:02.756661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:02.757637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:02.759222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:02.759222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:02.759222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:02.759222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:02.759222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:02.759222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:02.759222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:02.759222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:02.759222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:19:02.759222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:02.759222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 245/497] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Aug 4 02:19:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:02.759222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b81dea-f2e3-469f-a677-c79dbaaafbb8 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:02.810557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:02.853061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5949dd-ac8b-4f6d-8b43-5bca52872185 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:02.870882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b81dea-f2e3-469f-a677-c79dbaaafbb8 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:02.877785 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:02.891147 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c079f-d43b-441c-ae87-91009dc68395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:02.891776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c079f-d43b-441c-ae87-91009dc68395 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.892320 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c079f-d43b-441c-ae87-91009dc68395 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.892320 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c079f-d43b-441c-ae87-91009dc68395 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.893254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c079f-d43b-441c-ae87-91009dc68395 None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:02.893522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c079f-d43b-441c-ae87-91009dc68395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:02.895016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c079f-d43b-441c-ae87-91009dc68395 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:02.905528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 253/498] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:02.905528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c079f-d43b-441c-ae87-91009dc68395 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:02.912837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76346bcb-cc3b-490a-ace8-55db5afbb862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:02.913648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76346bcb-cc3b-490a-ace8-55db5afbb862 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:02.914164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76346bcb-cc3b-490a-ace8-55db5afbb862 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:02.914644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76346bcb-cc3b-490a-ace8-55db5afbb862 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:02.915499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76346bcb-cc3b-490a-ace8-55db5afbb862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:02.916102 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76346bcb-cc3b-490a-ace8-55db5afbb862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:02.917526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76346bcb-cc3b-490a-ace8-55db5afbb862 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:02.932707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 246/499] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:02.933563 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76346bcb-cc3b-490a-ace8-55db5afbb862 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:03.026983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c079f-d43b-441c-ae87-91009dc68395 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:03.039607 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76346bcb-cc3b-490a-ace8-55db5afbb862 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:03.046981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:03.062525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3341121-d6c6-4fc5-a566-94fdabc6d296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:03.063124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3341121-d6c6-4fc5-a566-94fdabc6d296 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.063411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3341121-d6c6-4fc5-a566-94fdabc6d296 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.063691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3341121-d6c6-4fc5-a566-94fdabc6d296 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.074564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3341121-d6c6-4fc5-a566-94fdabc6d296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:03.079548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cf8f1-3cf2-4dd1-b373-0d313d378de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-b3341121-d6c6-4fc5-a566-94fdabc6d296 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:03.080038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:03.080910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:03.081696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:03.081696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:03.081696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:03.081696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:03.081696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:03.081696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:03.081696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:03.081696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:03.081696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:03.081696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:03.081696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:03.081696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:03.082301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf8f1-3cf2-4dd1-b373-0d313d378de1 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.082301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf8f1-3cf2-4dd1-b373-0d313d378de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.082301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf8f1-3cf2-4dd1-b373-0d313d378de1 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.082479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 254/500] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:03.082574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cf8f1-3cf2-4dd1-b373-0d313d378de1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:03.082640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3341121-d6c6-4fc5-a566-94fdabc6d296 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:03.082704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cf8f1-3cf2-4dd1-b373-0d313d378de1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:03.083546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cf8f1-3cf2-4dd1-b373-0d313d378de1 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:03.123036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 247/501] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Aug 4 02:19:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:03.124434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cf8f1-3cf2-4dd1-b373-0d313d378de1 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:03.131134 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:03.189168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3341121-d6c6-4fc5-a566-94fdabc6d296 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:03.224336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082942e4-1c5b-4289-b48f-75b11f6c7829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:03.224983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082942e4-1c5b-4289-b48f-75b11f6c7829 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.225266 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082942e4-1c5b-4289-b48f-75b11f6c7829 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.225543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082942e4-1c5b-4289-b48f-75b11f6c7829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.236602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082942e4-1c5b-4289-b48f-75b11f6c7829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:03.238050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082942e4-1c5b-4289-b48f-75b11f6c7829 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:03.244843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cf8f1-3cf2-4dd1-b373-0d313d378de1 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-082942e4-1c5b-4289-b48f-75b11f6c7829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:03.253240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:03.254111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:03.255318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:03.255318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:03.255318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:03.255318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:03.255318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 255/502] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:03.255731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffafa04-bff7-4d5f-84df-7d0993bb72a2 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.256030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffafa04-bff7-4d5f-84df-7d0993bb72a2 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.256307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffafa04-bff7-4d5f-84df-7d0993bb72a2 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.262250 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 256/503] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:03.262250 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffafa04-bff7-4d5f-84df-7d0993bb72a2 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:03.284303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed720e-7b93-475c-87e6-90a94bba1942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:03.284944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed720e-7b93-475c-87e6-90a94bba1942 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.285226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed720e-7b93-475c-87e6-90a94bba1942 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.285502 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed720e-7b93-475c-87e6-90a94bba1942 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.292478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed720e-7b93-475c-87e6-90a94bba1942 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:03.293936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed720e-7b93-475c-87e6-90a94bba1942 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-efed720e-7b93-475c-87e6-90a94bba1942 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:03.306008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:03.307013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:03.307921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:03.307921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:03.307921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:03.307921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:03.307921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:03.307921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:03.307921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:03.307921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:03.307921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 02:19:03.307921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:03.307921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 248/504] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:03.307921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed720e-7b93-475c-87e6-90a94bba1942 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:03.332772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:03.358557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:03.365435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffafa04-bff7-4d5f-84df-7d0993bb72a2 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:03.400775 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4384d31-f527-47bf-953c-32c163f6ab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:03.401404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4384d31-f527-47bf-953c-32c163f6ab8b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.401685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4384d31-f527-47bf-953c-32c163f6ab8b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.401966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4384d31-f527-47bf-953c-32c163f6ab8b None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.402715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4384d31-f527-47bf-953c-32c163f6ab8b None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:03.403021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4384d31-f527-47bf-953c-32c163f6ab8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:03.404416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4384d31-f527-47bf-953c-32c163f6ab8b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:03.410312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed720e-7b93-475c-87e6-90a94bba1942 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:03.412404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 257/505] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:03.413228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4384d31-f527-47bf-953c-32c163f6ab8b None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:03.451164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65faa0-11fe-4eac-bfc9-89ff6816a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:03.451795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65faa0-11fe-4eac-bfc9-89ff6816a73c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.452083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65faa0-11fe-4eac-bfc9-89ff6816a73c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.452363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65faa0-11fe-4eac-bfc9-89ff6816a73c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.517720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4384d31-f527-47bf-953c-32c163f6ab8b None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:03.521427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65faa0-11fe-4eac-bfc9-89ff6816a73c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:03.522955 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65faa0-11fe-4eac-bfc9-89ff6816a73c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:03.546448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:03.551310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa49e40-1ce6-4469-841d-40d66ba4b48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:03.551934 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa49e40-1ce6-4469-841d-40d66ba4b48d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.552210 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa49e40-1ce6-4469-841d-40d66ba4b48d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.552488 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa49e40-1ce6-4469-841d-40d66ba4b48d None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.553176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa49e40-1ce6-4469-841d-40d66ba4b48d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:03.553486 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa49e40-1ce6-4469-841d-40d66ba4b48d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:03.555431 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa49e40-1ce6-4469-841d-40d66ba4b48d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:03.567837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 258/506] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:03.569110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaa00e-2430-4e32-9f46-8430a0f2a612 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.569402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaa00e-2430-4e32-9f46-8430a0f2a612 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.569682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaa00e-2430-4e32-9f46-8430a0f2a612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.587945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-77aaa00e-2430-4e32-9f46-8430a0f2a612 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:03.589091 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-77aaa00e-2430-4e32-9f46-8430a0f2a612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:03.603676 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:03.626924 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 249/507] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:03.627785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65faa0-11fe-4eac-bfc9-89ff6816a73c None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:03.658426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 259/508] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:03.659309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aaa00e-2430-4e32-9f46-8430a0f2a612 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:03.740233 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65faa0-11fe-4eac-bfc9-89ff6816a73c None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:03.762685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:03.763492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aaa00e-2430-4e32-9f46-8430a0f2a612 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:03.774034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1428e-b2bd-4462-923b-57f07e94ff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:03.774709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1428e-b2bd-4462-923b-57f07e94ff92 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.774997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1428e-b2bd-4462-923b-57f07e94ff92 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.775279 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1428e-b2bd-4462-923b-57f07e94ff92 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.777147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1428e-b2bd-4462-923b-57f07e94ff92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:03.777147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1428e-b2bd-4462-923b-57f07e94ff92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:03.778758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1428e-b2bd-4462-923b-57f07e94ff92 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:03.796775 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 250/509] 10.222.0.60 () {56 vars in 1137 bytes} [Thu Aug 4 02:19:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:03.797491 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1428e-b2bd-4462-923b-57f07e94ff92 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:03.801801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b434cbd-f6f4-48e8-8ab7-f669648fc5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:03.802775 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b434cbd-f6f4-48e8-8ab7-f669648fc5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.803057 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b434cbd-f6f4-48e8-8ab7-f669648fc5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.803337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b434cbd-f6f4-48e8-8ab7-f669648fc5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.814756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b434cbd-f6f4-48e8-8ab7-f669648fc5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:03.816223 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b434cbd-f6f4-48e8-8ab7-f669648fc5e7 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:03.824849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-0b434cbd-f6f4-48e8-8ab7-f669648fc5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:03.831344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:03.832478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:03.833753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:03.833753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:03.833753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:03.833753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:03.833753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 260/510] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:03.833753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b434cbd-f6f4-48e8-8ab7-f669648fc5e7 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:03.935583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b434cbd-f6f4-48e8-8ab7-f669648fc5e7 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:03.936110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1428e-b2bd-4462-923b-57f07e94ff92 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:03.969256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d4c23-882e-4823-9e17-39060a69a025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:03.969472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95a7bd-c201-483b-997b-0758d7e5d871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:03.969895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d4c23-882e-4823-9e17-39060a69a025 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.970084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95a7bd-c201-483b-997b-0758d7e5d871 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:03.970172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d4c23-882e-4823-9e17-39060a69a025 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.970364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95a7bd-c201-483b-997b-0758d7e5d871 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:03.970461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d4c23-882e-4823-9e17-39060a69a025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.970708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95a7bd-c201-483b-997b-0758d7e5d871 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:03.978243 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95a7bd-c201-483b-997b-0758d7e5d871 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:03.979711 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95a7bd-c201-483b-997b-0758d7e5d871 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:03.981729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d4c23-882e-4823-9e17-39060a69a025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:03.983216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d4c23-882e-4823-9e17-39060a69a025 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-dd95a7bd-c201-483b-997b-0758d7e5d871 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:03.991062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:03.991965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:03.992942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:03.992942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:03.992942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:03.992942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:03.992942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:03.992942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:03.992942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:03.992942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:03.992942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:19:03.992942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:03.992942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 251/511] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:03.993871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95a7bd-c201-483b-997b-0758d7e5d871 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-138d4c23-882e-4823-9e17-39060a69a025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:03.999705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:04.000607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:04.001473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:04.001473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:04.001473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:04.001473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:04.001473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 261/512] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:04.001919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d4c23-882e-4823-9e17-39060a69a025 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:04.037851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:04.055787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:04.104627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d4c23-882e-4823-9e17-39060a69a025 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:04.120295 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95a7bd-c201-483b-997b-0758d7e5d871 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:04.138403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ef674-74ac-4bd8-bfe4-ad476d1eb131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:04.139064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef674-74ac-4bd8-bfe4-ad476d1eb131 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:04.139350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef674-74ac-4bd8-bfe4-ad476d1eb131 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:04.139628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef674-74ac-4bd8-bfe4-ad476d1eb131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:04.154712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8bae7-dc11-4803-a8cc-78bc393f322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:04.155355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8bae7-dc11-4803-a8cc-78bc393f322a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:04.155647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8bae7-dc11-4803-a8cc-78bc393f322a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:04.155924 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8bae7-dc11-4803-a8cc-78bc393f322a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:04.167459 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8bae7-dc11-4803-a8cc-78bc393f322a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:04.168978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8bae7-dc11-4803-a8cc-78bc393f322a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-c5f8bae7-dc11-4803-a8cc-78bc393f322a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:04.183589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:04.184530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:04.185392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:04.185392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:04.185392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:04.185392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:04.185392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 252/513] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:04.185696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8bae7-dc11-4803-a8cc-78bc393f322a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:04.212203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ef674-74ac-4bd8-bfe4-ad476d1eb131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:04.213754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ef674-74ac-4bd8-bfe4-ad476d1eb131 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:04.265553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:04.277622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:04.286269 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8bae7-dc11-4803-a8cc-78bc393f322a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:04.315722 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 262/514] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:04.316569 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ef674-74ac-4bd8-bfe4-ad476d1eb131 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:04.328369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e752d-4b2a-42a8-80ed-805c3fb5627a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:04.329037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e752d-4b2a-42a8-80ed-805c3fb5627a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:04.329955 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e752d-4b2a-42a8-80ed-805c3fb5627a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:04.330239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e752d-4b2a-42a8-80ed-805c3fb5627a None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:04.330999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e752d-4b2a-42a8-80ed-805c3fb5627a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:04.331311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e752d-4b2a-42a8-80ed-805c3fb5627a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:04.332723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e752d-4b2a-42a8-80ed-805c3fb5627a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:04.344498 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 253/515] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:04.345345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e752d-4b2a-42a8-80ed-805c3fb5627a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:04.420689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ef674-74ac-4bd8-bfe4-ad476d1eb131 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:04.447748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e752d-4b2a-42a8-80ed-805c3fb5627a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:04.454623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aee77e-2ae0-417b-a992-6c814e643bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:04.455242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aee77e-2ae0-417b-a992-6c814e643bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:04.455525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aee77e-2ae0-417b-a992-6c814e643bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:04.455804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aee77e-2ae0-417b-a992-6c814e643bd8 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:04.456593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aee77e-2ae0-417b-a992-6c814e643bd8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:04.456902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aee77e-2ae0-417b-a992-6c814e643bd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:04.458345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aee77e-2ae0-417b-a992-6c814e643bd8 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:04.481349 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f52e9-a022-4687-822d-506a542601f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:04.481961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f52e9-a022-4687-822d-506a542601f3 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:04.482241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f52e9-a022-4687-822d-506a542601f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:04.482543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f52e9-a022-4687-822d-506a542601f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:04.483231 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f52e9-a022-4687-822d-506a542601f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:04.483534 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f52e9-a022-4687-822d-506a542601f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:04.484897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f52e9-a022-4687-822d-506a542601f3 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:04.494500 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 263/516] 10.222.0.60 () {56 vars in 1137 bytes} [Thu Aug 4 02:19:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:04.495333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aee77e-2ae0-417b-a992-6c814e643bd8 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:04.497504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 254/517] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:04.498147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f52e9-a022-4687-822d-506a542601f3 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:04.507095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:04.512509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:04.596051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aee77e-2ae0-417b-a992-6c814e643bd8 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:04.599825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f52e9-a022-4687-822d-506a542601f3 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:04.632112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b187b-4c2f-456e-8038-e68d8ec3c882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:04.632754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b187b-4c2f-456e-8038-e68d8ec3c882 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:04.633146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b187b-4c2f-456e-8038-e68d8ec3c882 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:04.633543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b187b-4c2f-456e-8038-e68d8ec3c882 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:04.634182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b187b-4c2f-456e-8038-e68d8ec3c882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:04.634544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b187b-4c2f-456e-8038-e68d8ec3c882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:04.635077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2ef6e-025f-4383-a620-5394c034cdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:04.635725 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2ef6e-025f-4383-a620-5394c034cdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:04.635980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b187b-4c2f-456e-8038-e68d8ec3c882 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:04.636070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2ef6e-025f-4383-a620-5394c034cdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:04.636274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2ef6e-025f-4383-a620-5394c034cdf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:04.646657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2ef6e-025f-4383-a620-5394c034cdf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:04.647843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 264/518] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:04.648123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2ef6e-025f-4383-a620-5394c034cdf8 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:04.648711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b187b-4c2f-456e-8038-e68d8ec3c882 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-57d2ef6e-025f-4383-a620-5394c034cdf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:04.667135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:04.668227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:04.669068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:04.669068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:04.669068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:04.669068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:04.669068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 255/519] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:04.669340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2ef6e-025f-4383-a620-5394c034cdf8 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:04.721240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:04.734119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:04.752261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b187b-4c2f-456e-8038-e68d8ec3c882 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:04.771122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2ef6e-025f-4383-a620-5394c034cdf8 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:04.786842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfe661-962d-4e2e-ae05-40a8bca5e44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:04.787477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfe661-962d-4e2e-ae05-40a8bca5e44a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:04.787763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfe661-962d-4e2e-ae05-40a8bca5e44a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:04.788037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfe661-962d-4e2e-ae05-40a8bca5e44a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:04.796556 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfe661-962d-4e2e-ae05-40a8bca5e44a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:04.798008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfe661-962d-4e2e-ae05-40a8bca5e44a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:04.806744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a2d2a-f0f2-4a88-bbf6-64a67a27ed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:04.808145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a2d2a-f0f2-4a88-bbf6-64a67a27ed6a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:04.808145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a2d2a-f0f2-4a88-bbf6-64a67a27ed6a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:04.808145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a2d2a-f0f2-4a88-bbf6-64a67a27ed6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-f4dfe661-962d-4e2e-ae05-40a8bca5e44a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:04.810579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:04.811867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:04.812958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:04.812958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:04.812958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:04.812958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:04.812958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:04.812958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:04.812958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:04.812958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:04.812958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 02:19:04.812958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:04.812958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 265/520] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:04.812958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfe661-962d-4e2e-ae05-40a8bca5e44a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:04.880456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a2d2a-f0f2-4a88-bbf6-64a67a27ed6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:04.881950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a2d2a-f0f2-4a88-bbf6-64a67a27ed6a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:04.919113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfe661-962d-4e2e-ae05-40a8bca5e44a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:04.943613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:04.947481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:04.953370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdc2d8-7ea4-425c-82ca-654254f8fbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:04.954082 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdc2d8-7ea4-425c-82ca-654254f8fbdf None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:04.954370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdc2d8-7ea4-425c-82ca-654254f8fbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:04.954691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdc2d8-7ea4-425c-82ca-654254f8fbdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:04.962002 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdc2d8-7ea4-425c-82ca-654254f8fbdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:04.963602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdc2d8-7ea4-425c-82ca-654254f8fbdf None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-a8bdc2d8-7ea4-425c-82ca-654254f8fbdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:04.975685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:04.977331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:04.978378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:04.978378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:04.978378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:04.978378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:04.978378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:04.978378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:04.978378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:04.978378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:04.978378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 266/521] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:04.979590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdc2d8-7ea4-425c-82ca-654254f8fbdf None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:04.991681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 256/522] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:04.991681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a2d2a-f0f2-4a88-bbf6-64a67a27ed6a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:05.082875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdc2d8-7ea4-425c-82ca-654254f8fbdf None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:05.092736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a2d2a-f0f2-4a88-bbf6-64a67a27ed6a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:05.117205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f2459-02bf-45d5-a10f-8254c92f904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:05.117948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f2459-02bf-45d5-a10f-8254c92f904f None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:05.118150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f2459-02bf-45d5-a10f-8254c92f904f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:05.118427 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f2459-02bf-45d5-a10f-8254c92f904f None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:05.119138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f2459-02bf-45d5-a10f-8254c92f904f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:05.120582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f2459-02bf-45d5-a10f-8254c92f904f None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:05.126400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbafd5f-92dc-4ac2-8c1c-d04d7115683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:05.127049 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbafd5f-92dc-4ac2-8c1c-d04d7115683f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:05.127336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbafd5f-92dc-4ac2-8c1c-d04d7115683f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:05.127614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbafd5f-92dc-4ac2-8c1c-d04d7115683f None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:05.128313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbafd5f-92dc-4ac2-8c1c-d04d7115683f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:05.128620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbafd5f-92dc-4ac2-8c1c-d04d7115683f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:05.129990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbafd5f-92dc-4ac2-8c1c-d04d7115683f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:05.142121 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 257/523] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:05.142954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbafd5f-92dc-4ac2-8c1c-d04d7115683f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:05.168545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:05.210579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 267/524] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:19:04 2022] POST /identity/v3/users => generated 247 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:19:05.212165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f2459-02bf-45d5-a10f-8254c92f904f None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:05.246629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbafd5f-92dc-4ac2-8c1c-d04d7115683f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:05.276329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:05.286349 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368f17d-f6ed-4850-8634-b55b9aaff456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:05.290841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368f17d-f6ed-4850-8634-b55b9aaff456 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:05.290841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368f17d-f6ed-4850-8634-b55b9aaff456 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:05.290841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368f17d-f6ed-4850-8634-b55b9aaff456 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:05.290841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368f17d-f6ed-4850-8634-b55b9aaff456 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:05.290841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368f17d-f6ed-4850-8634-b55b9aaff456 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:05.292350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368f17d-f6ed-4850-8634-b55b9aaff456 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:05.318814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 258/525] 10.222.0.60 () {56 vars in 1139 bytes} [Thu Aug 4 02:19:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:05.320074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368f17d-f6ed-4850-8634-b55b9aaff456 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:05.342662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f2459-02bf-45d5-a10f-8254c92f904f None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:05.386724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0ad22-d86e-4429-97a9-fa85c50119ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:05.386724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0ad22-d86e-4429-97a9-fa85c50119ea None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:05.387027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0ad22-d86e-4429-97a9-fa85c50119ea None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:05.387257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0ad22-d86e-4429-97a9-fa85c50119ea None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:05.388112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0ad22-d86e-4429-97a9-fa85c50119ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:05.388350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0ad22-d86e-4429-97a9-fa85c50119ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:05.389796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0ad22-d86e-4429-97a9-fa85c50119ea None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:05.410755 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 268/526] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:05.411901 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0ad22-d86e-4429-97a9-fa85c50119ea None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:05.428462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:05.447770 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368f17d-f6ed-4850-8634-b55b9aaff456 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:05.486724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6b8c9-efe3-465a-a4a7-eb78c66d540f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:05.487640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6b8c9-efe3-465a-a4a7-eb78c66d540f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:05.488073 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6b8c9-efe3-465a-a4a7-eb78c66d540f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:05.488651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6b8c9-efe3-465a-a4a7-eb78c66d540f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:05.501572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6b8c9-efe3-465a-a4a7-eb78c66d540f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:05.502992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6b8c9-efe3-465a-a4a7-eb78c66d540f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-e8e6b8c9-efe3-465a-a4a7-eb78c66d540f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:05.519863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:05.520804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:05.527037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:05.527037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:05.527037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:05.527037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:05.527037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 259/527] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:05.527037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6b8c9-efe3-465a-a4a7-eb78c66d540f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:05.532331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0ad22-d86e-4429-97a9-fa85c50119ea None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:05.541949 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:05.569956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6086a9-5933-4195-99d3-a1aef756236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:05.571844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6086a9-5933-4195-99d3-a1aef756236d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:05.572343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6086a9-5933-4195-99d3-a1aef756236d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:05.572627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6086a9-5933-4195-99d3-a1aef756236d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:05.579948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6086a9-5933-4195-99d3-a1aef756236d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:05.581459 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6086a9-5933-4195-99d3-a1aef756236d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-0a6086a9-5933-4195-99d3-a1aef756236d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:05.594186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:05.595071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:05.595906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:05.595906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:05.595906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:05.595906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:05.595906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:05.595906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:05.595906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:05.595906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:05.595906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 269/528] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:05.596361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6086a9-5933-4195-99d3-a1aef756236d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:05.633938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6b8c9-efe3-465a-a4a7-eb78c66d540f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:05.670282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0d5dc-6424-4a27-838a-9d28a67fee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:05.670937 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0d5dc-6424-4a27-838a-9d28a67fee0c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:05.671224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0d5dc-6424-4a27-838a-9d28a67fee0c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:05.671504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0d5dc-6424-4a27-838a-9d28a67fee0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:05.674301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:05.711861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6086a9-5933-4195-99d3-a1aef756236d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:05.745798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0d5dc-6424-4a27-838a-9d28a67fee0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:05.747403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0d5dc-6424-4a27-838a-9d28a67fee0c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:05.747551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2619b2-fbae-4ee8-9134-66d8dee7a2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:05.748165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2619b2-fbae-4ee8-9134-66d8dee7a2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:05.748451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2619b2-fbae-4ee8-9134-66d8dee7a2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:05.748725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2619b2-fbae-4ee8-9134-66d8dee7a2a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:05.749517 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2619b2-fbae-4ee8-9134-66d8dee7a2a3 None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=c6d95db1228f48669e1985eb74306a25) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:05.749829 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2619b2-fbae-4ee8-9134-66d8dee7a2a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:05.751309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2619b2-fbae-4ee8-9134-66d8dee7a2a3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:05.766604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 270/529] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:05 2022] GET /identity/v3/role_assignments?user.id=c6d95db1228f48669e1985eb74306a25&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:05.766604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2619b2-fbae-4ee8-9134-66d8dee7a2a3 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:05.812733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:05.885401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 260/530] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:05.886559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0d5dc-6424-4a27-838a-9d28a67fee0c None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:05.896953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2619b2-fbae-4ee8-9134-66d8dee7a2a3 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:05.926758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:05.936752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9982-bedd-4840-8ff2-860642cbc1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:05.938449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9982-bedd-4840-8ff2-860642cbc1df None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:05.938449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9982-bedd-4840-8ff2-860642cbc1df None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:05.938449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9982-bedd-4840-8ff2-860642cbc1df None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:05.938887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9982-bedd-4840-8ff2-860642cbc1df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:05.939196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9982-bedd-4840-8ff2-860642cbc1df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:05.940665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9982-bedd-4840-8ff2-860642cbc1df None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:05.953893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 271/531] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:05.955148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9982-bedd-4840-8ff2-860642cbc1df None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:06.019205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0d5dc-6424-4a27-838a-9d28a67fee0c None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:06.068516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:06.073682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dbe08-e3e4-42b8-bec5-18b957e6a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:06.074871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dbe08-e3e4-42b8-bec5-18b957e6a329 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:06.080522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dbe08-e3e4-42b8-bec5-18b957e6a329 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:06.080522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dbe08-e3e4-42b8-bec5-18b957e6a329 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:06.080522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37dbe08-e3e4-42b8-bec5-18b957e6a329 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:06.080522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37dbe08-e3e4-42b8-bec5-18b957e6a329 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:06.080522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37dbe08-e3e4-42b8-bec5-18b957e6a329 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:06.080923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9982-bedd-4840-8ff2-860642cbc1df None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:06.108027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 261/532] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:06.109434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dbe08-e3e4-42b8-bec5-18b957e6a329 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:06.127756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20029e30-1a45-40fa-be3c-8f2cb63b0147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:06.128735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20029e30-1a45-40fa-be3c-8f2cb63b0147 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:06.129027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20029e30-1a45-40fa-be3c-8f2cb63b0147 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:06.129308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20029e30-1a45-40fa-be3c-8f2cb63b0147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:06.145184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20029e30-1a45-40fa-be3c-8f2cb63b0147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:06.146978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20029e30-1a45-40fa-be3c-8f2cb63b0147 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-20029e30-1a45-40fa-be3c-8f2cb63b0147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:06.169600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:06.170723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:06.171615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:06.171615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:06.171615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:06.171615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:06.171615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 272/533] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:06.172150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20029e30-1a45-40fa-be3c-8f2cb63b0147 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:06.228604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:06.237405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dbe08-e3e4-42b8-bec5-18b957e6a329 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:06.281477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fde614-7b57-4f89-bf79-b34b8f98b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:06.282042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fde614-7b57-4f89-bf79-b34b8f98b502 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:06.282327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fde614-7b57-4f89-bf79-b34b8f98b502 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:06.282643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fde614-7b57-4f89-bf79-b34b8f98b502 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:06.290821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fde614-7b57-4f89-bf79-b34b8f98b502 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:06.292448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fde614-7b57-4f89-bf79-b34b8f98b502 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:06.296092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20029e30-1a45-40fa-be3c-8f2cb63b0147 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-57fde614-7b57-4f89-bf79-b34b8f98b502 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:06.306462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:06.307423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:06.308266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:06.308266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:06.308266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:06.308266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:06.308266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:06.308266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:06.308266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:06.308266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:06.308266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 262/534] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:06.309063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fde614-7b57-4f89-bf79-b34b8f98b502 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:06.337527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643dd57-de69-4ba0-a50d-84cd86461c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:06.338156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643dd57-de69-4ba0-a50d-84cd86461c94 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:06.338767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643dd57-de69-4ba0-a50d-84cd86461c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:06.339051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643dd57-de69-4ba0-a50d-84cd86461c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:06.339918 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643dd57-de69-4ba0-a50d-84cd86461c94 None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=10bd2ed69b324e85b8166135f045b840) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:06.340232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643dd57-de69-4ba0-a50d-84cd86461c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:06.341762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643dd57-de69-4ba0-a50d-84cd86461c94 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:06.354673 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 273/535] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:06 2022] GET /identity/v3/role_assignments?user.id=10bd2ed69b324e85b8166135f045b840&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:06.355695 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643dd57-de69-4ba0-a50d-84cd86461c94 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:06.369650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:06.485902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643dd57-de69-4ba0-a50d-84cd86461c94 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:06.532200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fde614-7b57-4f89-bf79-b34b8f98b502 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:06.534225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be55b4-f2d1-4204-808d-36dfe7b4f3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:06.535425 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be55b4-f2d1-4204-808d-36dfe7b4f3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:06.535914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be55b4-f2d1-4204-808d-36dfe7b4f3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:06.536401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be55b4-f2d1-4204-808d-36dfe7b4f3e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:06.537388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be55b4-f2d1-4204-808d-36dfe7b4f3e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:06.537703 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be55b4-f2d1-4204-808d-36dfe7b4f3e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:06.539271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be55b4-f2d1-4204-808d-36dfe7b4f3e5 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:06.556008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 274/536] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:06.561608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be55b4-f2d1-4204-808d-36dfe7b4f3e5 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:06.589181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a87de0-d4d6-4dd1-9bfb-8d7f384a3a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:06.590340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a87de0-d4d6-4dd1-9bfb-8d7f384a3a9b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:06.590905 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a87de0-d4d6-4dd1-9bfb-8d7f384a3a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:06.591381 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a87de0-d4d6-4dd1-9bfb-8d7f384a3a9b None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:06.592376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a87de0-d4d6-4dd1-9bfb-8d7f384a3a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:06.592886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a87de0-d4d6-4dd1-9bfb-8d7f384a3a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:06.594473 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a87de0-d4d6-4dd1-9bfb-8d7f384a3a9b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:06.611739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 263/537] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:06.614094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a87de0-d4d6-4dd1-9bfb-8d7f384a3a9b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:06.631850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:06.705033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:06.722407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a87de0-d4d6-4dd1-9bfb-8d7f384a3a9b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:06.760487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd4d67-0ac1-4712-a61c-c1ab647246a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:06.761502 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4d67-0ac1-4712-a61c-c1ab647246a9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:06.762037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4d67-0ac1-4712-a61c-c1ab647246a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:06.762647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd4d67-0ac1-4712-a61c-c1ab647246a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:06.765602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be55b4-f2d1-4204-808d-36dfe7b4f3e5 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:06.770373 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd4d67-0ac1-4712-a61c-c1ab647246a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:06.772116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd4d67-0ac1-4712-a61c-c1ab647246a9 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-9efd4d67-0ac1-4712-a61c-c1ab647246a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:06.788083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:06.790344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:06.792946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:06.792946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:06.792946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:06.792946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:06.792946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:06.792946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:06.792946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:06.792946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:06.802761 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 264/538] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:06.808273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd4d67-0ac1-4712-a61c-c1ab647246a9 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:06.828990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2422e-110a-48c3-8ed7-3b354fe3832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:06.829631 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2422e-110a-48c3-8ed7-3b354fe3832b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:06.829924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2422e-110a-48c3-8ed7-3b354fe3832b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:06.830208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2422e-110a-48c3-8ed7-3b354fe3832b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:06.831051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2422e-110a-48c3-8ed7-3b354fe3832b None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=3ffc2cd3c6a84eef894edae6e9b38210) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:06.831371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2422e-110a-48c3-8ed7-3b354fe3832b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:06.834681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2422e-110a-48c3-8ed7-3b354fe3832b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:06.842419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 275/539] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:06 2022] GET /identity/v3/role_assignments?user.id=3ffc2cd3c6a84eef894edae6e9b38210&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:06.943793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:06.973133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd4d67-0ac1-4712-a61c-c1ab647246a9 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:07.028351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371dace-efc2-43a0-88f4-af15406af828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:07.029001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371dace-efc2-43a0-88f4-af15406af828 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:07.029287 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371dace-efc2-43a0-88f4-af15406af828 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:07.029567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371dace-efc2-43a0-88f4-af15406af828 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:07.030351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371dace-efc2-43a0-88f4-af15406af828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:07.030695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371dace-efc2-43a0-88f4-af15406af828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:07.032192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371dace-efc2-43a0-88f4-af15406af828 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:07.054242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 265/540] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:07.061667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2422e-110a-48c3-8ed7-3b354fe3832b None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:07.172330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2422e-110a-48c3-8ed7-3b354fe3832b None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:07.206845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:07.209080 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc17522-023c-4569-b080-15fc63f35048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:07.209777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc17522-023c-4569-b080-15fc63f35048 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:07.210066 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc17522-023c-4569-b080-15fc63f35048 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:07.210345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc17522-023c-4569-b080-15fc63f35048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:07.211206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc17522-023c-4569-b080-15fc63f35048 None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=1ac08ad57a8e442d89ba1881abf43cff) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:07.211524 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc17522-023c-4569-b080-15fc63f35048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:07.212979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc17522-023c-4569-b080-15fc63f35048 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:07.219164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 276/541] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:07 2022] GET /identity/v3/role_assignments?user.id=1ac08ad57a8e442d89ba1881abf43cff&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:07.444183 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824df6e-9bb8-47b3-99e8-da1e538fecc3 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:07.444471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824df6e-9bb8-47b3-99e8-da1e538fecc3 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:07.444757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824df6e-9bb8-47b3-99e8-da1e538fecc3 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:07.446735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 266/542] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:07.452309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddab6f-cc8c-4aeb-848e-af7588bdd57b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:07.452604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddab6f-cc8c-4aeb-848e-af7588bdd57b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:07.452891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddab6f-cc8c-4aeb-848e-af7588bdd57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:07.475149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b6ddab6f-cc8c-4aeb-848e-af7588bdd57b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:07.476402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b6ddab6f-cc8c-4aeb-848e-af7588bdd57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:07.552888 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 277/543] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:07.583743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824df6e-9bb8-47b3-99e8-da1e538fecc3 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:07.724300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824df6e-9bb8-47b3-99e8-da1e538fecc3 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:07.771887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3e23-9ff4-4894-94ae-bafc84b6f312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:07.772777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3e23-9ff4-4894-94ae-bafc84b6f312 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:07.773103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3e23-9ff4-4894-94ae-bafc84b6f312 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:07.773910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3e23-9ff4-4894-94ae-bafc84b6f312 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:07.776715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:07.793365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b3e23-9ff4-4894-94ae-bafc84b6f312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-8d5b3e23-9ff4-4894-94ae-bafc84b6f312 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:07.798298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:07.799375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:07.800365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:07.800365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:07.800365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:07.800365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:07.800365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:07.800365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:07.800365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:07.800365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:07.800365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:07.800365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:07.800365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:07.800365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:07.803803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 267/544] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:07.809681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddab6f-cc8c-4aeb-848e-af7588bdd57b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:07.948180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddab6f-cc8c-4aeb-848e-af7588bdd57b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:07.986151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:07.997865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa9d24-38ea-4041-ae78-ab53bba45bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:07.997865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa9d24-38ea-4041-ae78-ab53bba45bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:07.998115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa9d24-38ea-4041-ae78-ab53bba45bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:07.998182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa9d24-38ea-4041-ae78-ab53bba45bb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:07.998953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa9d24-38ea-4041-ae78-ab53bba45bb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:07.999516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa9d24-38ea-4041-ae78-ab53bba45bb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:08.000974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa9d24-38ea-4041-ae78-ab53bba45bb7 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:08.010766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 278/545] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:08.015960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3e23-9ff4-4894-94ae-bafc84b6f312 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:08.084086 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8cd0c-088b-4cfb-9ecb-08db551db951 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:08.084741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8cd0c-088b-4cfb-9ecb-08db551db951 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:08.085221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8cd0c-088b-4cfb-9ecb-08db551db951 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:08.087373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 279/546] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:19:08.100208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bfd75-b341-4261-be5c-ae250ae6afb8 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:08.100814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bfd75-b341-4261-be5c-ae250ae6afb8 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:08.101293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bfd75-b341-4261-be5c-ae250ae6afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:08.133886 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-0f5bfd75-b341-4261-be5c-ae250ae6afb8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:08.135466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0f5bfd75-b341-4261-be5c-ae250ae6afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:08.183900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3e23-9ff4-4894-94ae-bafc84b6f312 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:08.223581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdb5b6-1419-457b-adb8-83f4f1080517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:08.224663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdb5b6-1419-457b-adb8-83f4f1080517 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:08.225149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdb5b6-1419-457b-adb8-83f4f1080517 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:08.225654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdb5b6-1419-457b-adb8-83f4f1080517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:08.250185 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdb5b6-1419-457b-adb8-83f4f1080517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:08.252034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdb5b6-1419-457b-adb8-83f4f1080517 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:08.257042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 280/547] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:19:08.279623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bfd75-b341-4261-be5c-ae250ae6afb8 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-bccdb5b6-1419-457b-adb8-83f4f1080517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:08.286886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:08.287863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:08.289944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:08.289944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:08.289944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:08.289944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:08.289944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 268/548] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:08.295684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdb5b6-1419-457b-adb8-83f4f1080517 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:08.390634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bfd75-b341-4261-be5c-ae250ae6afb8 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:08.415752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:08.426815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a578a-2563-4310-871f-6e8be8451dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:08.427491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a578a-2563-4310-871f-6e8be8451dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:08.427746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a578a-2563-4310-871f-6e8be8451dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:08.428030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a578a-2563-4310-871f-6e8be8451dd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:08.439360 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a578a-2563-4310-871f-6e8be8451dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-853a578a-2563-4310-871f-6e8be8451dd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:08.444293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:08.445416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:08.446570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 281/549] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:08.452900 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a578a-2563-4310-871f-6e8be8451dd4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:08.533354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdb5b6-1419-457b-adb8-83f4f1080517 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:08.556130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a578a-2563-4310-871f-6e8be8451dd4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:08.583439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:08.602804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76ca6c-fcb2-41ca-893e-69ed50a5defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:08.603866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76ca6c-fcb2-41ca-893e-69ed50a5defa None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:08.604149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76ca6c-fcb2-41ca-893e-69ed50a5defa None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:08.604426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76ca6c-fcb2-41ca-893e-69ed50a5defa None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:08.605172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76ca6c-fcb2-41ca-893e-69ed50a5defa None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:08.605481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76ca6c-fcb2-41ca-893e-69ed50a5defa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:08.606962 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76ca6c-fcb2-41ca-893e-69ed50a5defa None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:08.611600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e8db0-7da7-4405-954f-2f225faa6779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:08.612288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e8db0-7da7-4405-954f-2f225faa6779 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:08.612515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e8db0-7da7-4405-954f-2f225faa6779 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:08.612789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e8db0-7da7-4405-954f-2f225faa6779 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:08.613509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e8db0-7da7-4405-954f-2f225faa6779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:08.613857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e8db0-7da7-4405-954f-2f225faa6779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:08.620755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e8db0-7da7-4405-954f-2f225faa6779 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:08.634293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 282/550] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:08.638577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76ca6c-fcb2-41ca-893e-69ed50a5defa None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:08.651407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 269/551] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:08.661109 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e8db0-7da7-4405-954f-2f225faa6779 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:08.688628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:08.750218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76ca6c-fcb2-41ca-893e-69ed50a5defa None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:08.787189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69cb4-c5ea-44f6-9650-81f7c4c6a752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:08.787761 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69cb4-c5ea-44f6-9650-81f7c4c6a752 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:08.788044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69cb4-c5ea-44f6-9650-81f7c4c6a752 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:08.788321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69cb4-c5ea-44f6-9650-81f7c4c6a752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:08.817263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69cb4-c5ea-44f6-9650-81f7c4c6a752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:08.818778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69cb4-c5ea-44f6-9650-81f7c4c6a752 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-70b69cb4-c5ea-44f6-9650-81f7c4c6a752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:08.845987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:08.846967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:08.848283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:08.848283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:08.848283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:08.848283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:08.848283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 283/552] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:08.851115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e8db0-7da7-4405-954f-2f225faa6779 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:08.853272 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69cb4-c5ea-44f6-9650-81f7c4c6a752 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:08.865275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:08.906589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49eafb-d1d3-47f7-b768-f5c91843db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:08.907277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49eafb-d1d3-47f7-b768-f5c91843db5f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:08.908013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49eafb-d1d3-47f7-b768-f5c91843db5f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:08.908299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49eafb-d1d3-47f7-b768-f5c91843db5f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:08.918361 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49eafb-d1d3-47f7-b768-f5c91843db5f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:08.920406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49eafb-d1d3-47f7-b768-f5c91843db5f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-0c49eafb-d1d3-47f7-b768-f5c91843db5f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:08.936415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:08.937430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:08.938600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:08.938600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:08.938600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:08.938600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:08.938600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:08.938600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:08.938600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:08.938600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:08.938600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:19:08.938600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:08.938600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 270/553] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:19:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:08.939572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4076050-a379-47aa-b0e3-2fcdc98131dd None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:08.942113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4076050-a379-47aa-b0e3-2fcdc98131dd None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:08.942113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4076050-a379-47aa-b0e3-2fcdc98131dd None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:08.942553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 271/554] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:08.943305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4076050-a379-47aa-b0e3-2fcdc98131dd None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:08.966914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:08.979581 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69cb4-c5ea-44f6-9650-81f7c4c6a752 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:09.031158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09793d9d-2479-415d-bcdc-dfe4bd78b144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:09.032550 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09793d9d-2479-415d-bcdc-dfe4bd78b144 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.033017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09793d9d-2479-415d-bcdc-dfe4bd78b144 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.033445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09793d9d-2479-415d-bcdc-dfe4bd78b144 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.034804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09793d9d-2479-415d-bcdc-dfe4bd78b144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:09.035682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09793d9d-2479-415d-bcdc-dfe4bd78b144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:09.037596 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09793d9d-2479-415d-bcdc-dfe4bd78b144 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:09.052627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 284/555] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:09.055031 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d95f5-ef77-44b0-8602-d5e11011fd47 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.055481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d95f5-ef77-44b0-8602-d5e11011fd47 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.055912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d95f5-ef77-44b0-8602-d5e11011fd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.074375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4076050-a379-47aa-b0e3-2fcdc98131dd None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:09.079573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-739d95f5-ef77-44b0-8602-d5e11011fd47 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:09.081027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-739d95f5-ef77-44b0-8602-d5e11011fd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:09.115899 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1a1b6-8327-498a-9950-ac5fd4784cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:09.117326 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a1b6-8327-498a-9950-ac5fd4784cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.117898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a1b6-8327-498a-9950-ac5fd4784cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.118477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a1b6-8327-498a-9950-ac5fd4784cf1 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.119424 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1a1b6-8327-498a-9950-ac5fd4784cf1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:09.120145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1a1b6-8327-498a-9950-ac5fd4784cf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:09.123440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1a1b6-8327-498a-9950-ac5fd4784cf1 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:09.155695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 272/556] 10.222.0.60 () {56 vars in 1135 bytes} [Thu Aug 4 02:19:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:09.157012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1a1b6-8327-498a-9950-ac5fd4784cf1 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:09.178886 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 285/557] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:09.178886 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d95f5-ef77-44b0-8602-d5e11011fd47 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:09.205827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:09.297322 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:09.308709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1a1b6-8327-498a-9950-ac5fd4784cf1 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:09.325090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d95f5-ef77-44b0-8602-d5e11011fd47 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:09.357107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41385027-1912-44cc-9e69-ffd2dafb1e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:09.358258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41385027-1912-44cc-9e69-ffd2dafb1e87 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.358666 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41385027-1912-44cc-9e69-ffd2dafb1e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.359011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41385027-1912-44cc-9e69-ffd2dafb1e87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.370148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41385027-1912-44cc-9e69-ffd2dafb1e87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:09.371986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41385027-1912-44cc-9e69-ffd2dafb1e87 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:09.372194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8a2ba-9179-4030-b13b-2f70c89dd350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:09.373094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8a2ba-9179-4030-b13b-2f70c89dd350 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.373559 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8a2ba-9179-4030-b13b-2f70c89dd350 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.374303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8a2ba-9179-4030-b13b-2f70c89dd350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-41385027-1912-44cc-9e69-ffd2dafb1e87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:09.390890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:09.392400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:09.393368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:09.393368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:09.393368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:09.393368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:09.393368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:09.393368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:09.393368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:09.393368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:09.393368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:19:09.393368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:09.396890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 273/558] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Aug 4 02:19:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:09.397738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41385027-1912-44cc-9e69-ffd2dafb1e87 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:09.466009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8a2ba-9179-4030-b13b-2f70c89dd350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:09.467628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8a2ba-9179-4030-b13b-2f70c89dd350 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:09.492775 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:09.510902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41385027-1912-44cc-9e69-ffd2dafb1e87 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:09.547719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378644-5fda-43e0-a841-051209dfd794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:09.548657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378644-5fda-43e0-a841-051209dfd794 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.549136 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378644-5fda-43e0-a841-051209dfd794 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.549598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68378644-5fda-43e0-a841-051209dfd794 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.562190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68378644-5fda-43e0-a841-051209dfd794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:09.567332 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-68378644-5fda-43e0-a841-051209dfd794 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:09.568016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:09.569022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:09.569931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:09.569931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:09.569931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:09.569931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:09.569931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:09.569931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:09.569931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:09.569931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:09.569931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:09.569931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:09.569931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:09.569931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:09.578084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 274/559] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:09.579139 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378644-5fda-43e0-a841-051209dfd794 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:09.600507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 286/560] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:09.602259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8a2ba-9179-4030-b13b-2f70c89dd350 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:09.689299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68378644-5fda-43e0-a841-051209dfd794 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:09.725806 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8a2ba-9179-4030-b13b-2f70c89dd350 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:09.727958 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb3a28-8531-4b05-9aa8-535f5187b8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:09.729647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb3a28-8531-4b05-9aa8-535f5187b8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.730110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb3a28-8531-4b05-9aa8-535f5187b8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.730560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb3a28-8531-4b05-9aa8-535f5187b8e5 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.731516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb3a28-8531-4b05-9aa8-535f5187b8e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:09.732702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb3a28-8531-4b05-9aa8-535f5187b8e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:09.734919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb3a28-8531-4b05-9aa8-535f5187b8e5 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:09.757501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 275/561] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Aug 4 02:19:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:09.757501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb3a28-8531-4b05-9aa8-535f5187b8e5 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:09.757501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:09.768361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0d796-c5a6-4144-afe5-553b404b27fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:09.768984 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0d796-c5a6-4144-afe5-553b404b27fd None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.770647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0d796-c5a6-4144-afe5-553b404b27fd None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.770647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0d796-c5a6-4144-afe5-553b404b27fd None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.770647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0d796-c5a6-4144-afe5-553b404b27fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:09.770647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0d796-c5a6-4144-afe5-553b404b27fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:09.771947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0d796-c5a6-4144-afe5-553b404b27fd None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:09.781029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 287/562] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:09.782382 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864a982-52fa-42bb-988b-b3275aaf7ed8 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.782704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864a982-52fa-42bb-988b-b3275aaf7ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.782981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864a982-52fa-42bb-988b-b3275aaf7ed8 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.784479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 288/563] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:09.785184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864a982-52fa-42bb-988b-b3275aaf7ed8 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:09.833404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:09.871507 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb3a28-8531-4b05-9aa8-535f5187b8e5 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:09.895457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864a982-52fa-42bb-988b-b3275aaf7ed8 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:09.911556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3edf6-fd0c-4542-bafa-32fc5cc11396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:09.912195 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3edf6-fd0c-4542-bafa-32fc5cc11396 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.912475 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3edf6-fd0c-4542-bafa-32fc5cc11396 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.912751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3edf6-fd0c-4542-bafa-32fc5cc11396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.922790 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3edf6-fd0c-4542-bafa-32fc5cc11396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:09.924262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3edf6-fd0c-4542-bafa-32fc5cc11396 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:09.931411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df9123-b5d7-4550-b3aa-093b307710cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:09.932113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df9123-b5d7-4550-b3aa-093b307710cb None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.932406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df9123-b5d7-4550-b3aa-093b307710cb None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.932685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df9123-b5d7-4550-b3aa-093b307710cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-c3c3edf6-fd0c-4542-bafa-32fc5cc11396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:09.939646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:09.940532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:09.941427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:09.941427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:09.941427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:09.941427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:09.941427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 276/564] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:09.941944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657d88-c0e8-4631-893f-d37be0a3acef None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.942233 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657d88-c0e8-4631-893f-d37be0a3acef None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.942533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657d88-c0e8-4631-893f-d37be0a3acef None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.943930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 277/565] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:09.944110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df9123-b5d7-4550-b3aa-093b307710cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:09.944473 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34657d88-c0e8-4631-893f-d37be0a3acef None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:09.946270 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df9123-b5d7-4550-b3aa-093b307710cb None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-27df9123-b5d7-4550-b3aa-093b307710cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:09.962616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:09.963688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:09.964576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:09.964576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:09.964576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:09.964576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:09.964576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 289/566] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:09.965303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe278098-b4b9-4b3a-b468-f9eb3fac687f None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:09.965598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe278098-b4b9-4b3a-b468-f9eb3fac687f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:09.966047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe278098-b4b9-4b3a-b468-f9eb3fac687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:09.983446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-fe278098-b4b9-4b3a-b468-f9eb3fac687f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:09.984643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-fe278098-b4b9-4b3a-b468-f9eb3fac687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:10.004834 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:10.053100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34657d88-c0e8-4631-893f-d37be0a3acef None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:10.056889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 290/567] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:10.057737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe278098-b4b9-4b3a-b468-f9eb3fac687f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:10.090776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:10.093222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e86b8b-8944-47da-a192-c0da579d9854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:10.093873 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e86b8b-8944-47da-a192-c0da579d9854 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:10.094158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e86b8b-8944-47da-a192-c0da579d9854 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:10.094435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e86b8b-8944-47da-a192-c0da579d9854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:10.105810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e86b8b-8944-47da-a192-c0da579d9854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:10.107288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e86b8b-8944-47da-a192-c0da579d9854 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-20e86b8b-8944-47da-a192-c0da579d9854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:10.122851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:10.123810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:10.124694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:10.124694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:10.124694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:10.124694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:10.124694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 278/568] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:10.125129 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5888fe3-0852-4e34-90e0-021028de76fc None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:10.125411 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5888fe3-0852-4e34-90e0-021028de76fc None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:10.125687 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5888fe3-0852-4e34-90e0-021028de76fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:10.143927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e5888fe3-0852-4e34-90e0-021028de76fc None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:10.145134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e5888fe3-0852-4e34-90e0-021028de76fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:10.170695 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe278098-b4b9-4b3a-b468-f9eb3fac687f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:10.205263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6286-0344-4672-8dcc-8edee507972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:10.205887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6286-0344-4672-8dcc-8edee507972d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:10.206168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6286-0344-4672-8dcc-8edee507972d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:10.206445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6286-0344-4672-8dcc-8edee507972d None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:10.207165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c6286-0344-4672-8dcc-8edee507972d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:10.207475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c6286-0344-4672-8dcc-8edee507972d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:10.208854 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c6286-0344-4672-8dcc-8edee507972d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:10.221160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 279/569] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:10.221160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5888fe3-0852-4e34-90e0-021028de76fc None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:10.221405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 291/570] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:10.221405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6286-0344-4672-8dcc-8edee507972d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:10.252787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:10.328784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:10.346007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5888fe3-0852-4e34-90e0-021028de76fc None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:10.353194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6286-0344-4672-8dcc-8edee507972d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:10.385259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd961a-38cf-4816-a3ce-4d960d54b3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:10.385877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd961a-38cf-4816-a3ce-4d960d54b3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:10.386160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd961a-38cf-4816-a3ce-4d960d54b3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:10.386434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd961a-38cf-4816-a3ce-4d960d54b3a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:10.387160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd961a-38cf-4816-a3ce-4d960d54b3a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:10.387464 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd961a-38cf-4816-a3ce-4d960d54b3a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:10.388060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b9c31-e693-4ec8-a42f-d873293ac635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:10.388701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9c31-e693-4ec8-a42f-d873293ac635 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:10.388851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd961a-38cf-4816-a3ce-4d960d54b3a7 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:10.388983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9c31-e693-4ec8-a42f-d873293ac635 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:10.389264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9c31-e693-4ec8-a42f-d873293ac635 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:10.400026 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b9c31-e693-4ec8-a42f-d873293ac635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:10.400312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 280/571] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:10.401282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd961a-38cf-4816-a3ce-4d960d54b3a7 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-ef0b9c31-e693-4ec8-a42f-d873293ac635 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:10.405256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:10.406394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 292/572] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:10.407359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b9c31-e693-4ec8-a42f-d873293ac635 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:10.498104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:10.503840 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd961a-38cf-4816-a3ce-4d960d54b3a7 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:10.511832 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b9c31-e693-4ec8-a42f-d873293ac635 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:10.542671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b9ead-5001-47a9-aeaa-e1b9fb7c42fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:10.543290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b9ead-5001-47a9-aeaa-e1b9fb7c42fb None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:10.543582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b9ead-5001-47a9-aeaa-e1b9fb7c42fb None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:10.543860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b9ead-5001-47a9-aeaa-e1b9fb7c42fb None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:10.544556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b9ead-5001-47a9-aeaa-e1b9fb7c42fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:10.544864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b9ead-5001-47a9-aeaa-e1b9fb7c42fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:10.545398 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31134ff-5b35-41d7-af1e-faa7ecd86877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:10.546033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31134ff-5b35-41d7-af1e-faa7ecd86877 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:10.546248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b9ead-5001-47a9-aeaa-e1b9fb7c42fb None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:10.546344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31134ff-5b35-41d7-af1e-faa7ecd86877 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:10.546594 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31134ff-5b35-41d7-af1e-faa7ecd86877 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:10.553084 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31134ff-5b35-41d7-af1e-faa7ecd86877 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:10.554593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31134ff-5b35-41d7-af1e-faa7ecd86877 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:10.557682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 281/573] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:10.558508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b9ead-5001-47a9-aeaa-e1b9fb7c42fb None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-b31134ff-5b35-41d7-af1e-faa7ecd86877 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:10.570767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:10.572006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:10.572893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:10.572893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:10.572893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:10.572893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:10.572893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:10.572893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:10.572893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:10.572893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:10.572893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 293/574] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:10.574159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31134ff-5b35-41d7-af1e-faa7ecd86877 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:10.577971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:10.668002 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b9ead-5001-47a9-aeaa-e1b9fb7c42fb None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:10.679266 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31134ff-5b35-41d7-af1e-faa7ecd86877 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:10.700711 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec519d-f296-4652-a175-41b98b9c4f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:10.701346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec519d-f296-4652-a175-41b98b9c4f98 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:10.701634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec519d-f296-4652-a175-41b98b9c4f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:10.701909 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec519d-f296-4652-a175-41b98b9c4f98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:10.712677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec519d-f296-4652-a175-41b98b9c4f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:10.713970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54805ba2-c276-4e9a-b340-c2f395be985f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:10.714637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805ba2-c276-4e9a-b340-c2f395be985f None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:10.714923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805ba2-c276-4e9a-b340-c2f395be985f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:10.715199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805ba2-c276-4e9a-b340-c2f395be985f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-91ec519d-f296-4652-a175-41b98b9c4f98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:10.718046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:10.719048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:10.719889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 282/575] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:10.720780 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec519d-f296-4652-a175-41b98b9c4f98 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:10.722001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54805ba2-c276-4e9a-b340-c2f395be985f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:10.723476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54805ba2-c276-4e9a-b340-c2f395be985f None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-54805ba2-c276-4e9a-b340-c2f395be985f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:10.735206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:10.736117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:10.737868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:10.737868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:10.737868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:10.737868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:10.737868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:10.737868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:10.737868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:10.737868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:10.737868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 294/576] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:10.737868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54805ba2-c276-4e9a-b340-c2f395be985f None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:10.743997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:10.801922 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:10.863946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54805ba2-c276-4e9a-b340-c2f395be985f None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:10.864488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec519d-f296-4652-a175-41b98b9c4f98 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:10.898050 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8619da-5f1e-4bd8-87ec-e56bbdc08524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:10.899138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141e611-2a04-4625-a574-03218bbadf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:10.899366 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8619da-5f1e-4bd8-87ec-e56bbdc08524 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:10.899701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8619da-5f1e-4bd8-87ec-e56bbdc08524 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:10.899794 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141e611-2a04-4625-a574-03218bbadf28 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:10.899979 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8619da-5f1e-4bd8-87ec-e56bbdc08524 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:10.900071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141e611-2a04-4625-a574-03218bbadf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:10.900305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141e611-2a04-4625-a574-03218bbadf28 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:10.900692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8619da-5f1e-4bd8-87ec-e56bbdc08524 None admin] RBAC: Adding query filter params (name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:10.900999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8619da-5f1e-4bd8-87ec-e56bbdc08524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:10.902378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8619da-5f1e-4bd8-87ec-e56bbdc08524 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:10.908049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141e611-2a04-4625-a574-03218bbadf28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:10.909478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141e611-2a04-4625-a574-03218bbadf28 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:10.910478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 283/577] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:10.911292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8619da-5f1e-4bd8-87ec-e56bbdc08524 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-a141e611-2a04-4625-a574-03218bbadf28 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:10.921649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:10.922741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:10.923732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:10.923732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:10.923732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:10.923732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:10.923732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:10.923732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:10.923732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:10.923732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:10.923732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 02:19:10.923732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:10.923732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 295/578] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:10.923732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141e611-2a04-4625-a574-03218bbadf28 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:10.996652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:11.017804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8619da-5f1e-4bd8-87ec-e56bbdc08524 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:11.025855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141e611-2a04-4625-a574-03218bbadf28 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:11.053158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8db25-825b-42b0-9bff-84fc7686b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:11.053786 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8db25-825b-42b0-9bff-84fc7686b154 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:11.054168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8db25-825b-42b0-9bff-84fc7686b154 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:11.055010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8db25-825b-42b0-9bff-84fc7686b154 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:11.055952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8db25-825b-42b0-9bff-84fc7686b154 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:11.056272 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8db25-825b-42b0-9bff-84fc7686b154 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:11.057736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8db25-825b-42b0-9bff-84fc7686b154 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:11.058047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:11.071590 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 284/579] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:11.072683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c055-5b2d-41a1-8e89-5fdafc30b1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:11.073496 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c055-5b2d-41a1-8e89-5fdafc30b1aa None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:11.073886 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c055-5b2d-41a1-8e89-5fdafc30b1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:11.074263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23c055-5b2d-41a1-8e89-5fdafc30b1aa None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:11.075295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23c055-5b2d-41a1-8e89-5fdafc30b1aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:11.075726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23c055-5b2d-41a1-8e89-5fdafc30b1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:11.077274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8db25-825b-42b0-9bff-84fc7686b154 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:11.077733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23c055-5b2d-41a1-8e89-5fdafc30b1aa None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:11.094633 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 296/580] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:11.095955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c055-5b2d-41a1-8e89-5fdafc30b1aa None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:11.189291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8db25-825b-42b0-9bff-84fc7686b154 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:11.196268 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23c055-5b2d-41a1-8e89-5fdafc30b1aa None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:11.224306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f59631-fa8e-4c45-87e2-4f8b058ccf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:11.224947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f59631-fa8e-4c45-87e2-4f8b058ccf67 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:11.225230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f59631-fa8e-4c45-87e2-4f8b058ccf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:11.225510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f59631-fa8e-4c45-87e2-4f8b058ccf67 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:11.226781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f59631-fa8e-4c45-87e2-4f8b058ccf67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:11.227092 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f59631-fa8e-4c45-87e2-4f8b058ccf67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:11.228536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f59631-fa8e-4c45-87e2-4f8b058ccf67 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:11.229903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ebbc9-4f5a-457c-a3da-a6693501b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:11.230579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ebbc9-4f5a-457c-a3da-a6693501b867 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:11.230864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ebbc9-4f5a-457c-a3da-a6693501b867 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:11.231150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ebbc9-4f5a-457c-a3da-a6693501b867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:11.235255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:11.240640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 285/581] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:11.244718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ebbc9-4f5a-457c-a3da-a6693501b867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:11.244837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f59631-fa8e-4c45-87e2-4f8b058ccf67 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:11.244928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ebbc9-4f5a-457c-a3da-a6693501b867 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-592ebbc9-4f5a-457c-a3da-a6693501b867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:11.259792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:11.260789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:11.262078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:11.262078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:11.262078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:11.262078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:11.262078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 297/582] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:11.262078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ebbc9-4f5a-457c-a3da-a6693501b867 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:11.301376 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:11.353112 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f59631-fa8e-4c45-87e2-4f8b058ccf67 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:11.365335 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ebbc9-4f5a-457c-a3da-a6693501b867 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:11.387677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36695407-b302-4870-ba10-7ca29d32048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:11.388298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36695407-b302-4870-ba10-7ca29d32048b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:11.388576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36695407-b302-4870-ba10-7ca29d32048b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:11.388855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36695407-b302-4870-ba10-7ca29d32048b None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:11.389654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36695407-b302-4870-ba10-7ca29d32048b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:11.389959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36695407-b302-4870-ba10-7ca29d32048b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:11.391418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36695407-b302-4870-ba10-7ca29d32048b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:11.400667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652710d4-def5-477c-8be6-8353afc258d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:11.401285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652710d4-def5-477c-8be6-8353afc258d7 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:11.401568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652710d4-def5-477c-8be6-8353afc258d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:11.401843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652710d4-def5-477c-8be6-8353afc258d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:11.402666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652710d4-def5-477c-8be6-8353afc258d7 None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=6414c895c6d642a2affb36013b71df34) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:11.402979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652710d4-def5-477c-8be6-8353afc258d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:11.404424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652710d4-def5-477c-8be6-8353afc258d7 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:11.409199 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 286/583] 10.222.0.60 () {56 vars in 1137 bytes} [Thu Aug 4 02:19:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:11.417020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 298/584] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:11 2022] GET /identity/v3/role_assignments?user.id=6414c895c6d642a2affb36013b71df34&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:11.417227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36695407-b302-4870-ba10-7ca29d32048b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:11.417309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652710d4-def5-477c-8be6-8353afc258d7 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:11.483406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:11.532924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652710d4-def5-477c-8be6-8353afc258d7 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:11.535010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36695407-b302-4870-ba10-7ca29d32048b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:11.535134 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:11.576362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da04803-c649-4191-8588-a84bd851f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:11.577115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da04803-c649-4191-8588-a84bd851f9dd None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:11.577312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da04803-c649-4191-8588-a84bd851f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:11.577589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da04803-c649-4191-8588-a84bd851f9dd None admin] PATH_INFO: `/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/c6d95db1228f48669e1985eb74306a25/roles/f71c9be92ae0492884ac931960b85e94` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:11.580456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c571-7a8c-4822-b12f-4f6fb536f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:11.582193 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c571-7a8c-4822-b12f-4f6fb536f820 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:11.582749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c571-7a8c-4822-b12f-4f6fb536f820 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:11.583249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c571-7a8c-4822-b12f-4f6fb536f820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:11.593087 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da04803-c649-4191-8588-a84bd851f9dd None admin] RBAC: Authorizing `identity:create_grant(project_id=fae65363f2fb415b834ac367a6c4b7ad, user_id=c6d95db1228f48669e1985eb74306a25, role_id=f71c9be92ae0492884ac931960b85e94)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:11.594558 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da04803-c649-4191-8588-a84bd851f9dd None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:11.596704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2c571-7a8c-4822-b12f-4f6fb536f820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:11.598891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2c571-7a8c-4822-b12f-4f6fb536f820 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-edf2c571-7a8c-4822-b12f-4f6fb536f820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:11.614322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:11.615492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:11.616378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:11.616378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:11.616378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:11.616378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:11.620843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 287/585] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:11.621722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c571-7a8c-4822-b12f-4f6fb536f820 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:11.690584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 299/586] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:19:11 2022] PUT /identity/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/c6d95db1228f48669e1985eb74306a25/roles/f71c9be92ae0492884ac931960b85e94 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:19:11.699625 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da04803-c649-4191-8588-a84bd851f9dd None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:11.745010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c571-7a8c-4822-b12f-4f6fb536f820 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:11.761942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:11.789973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48405a8d-682f-40a4-b0cb-e014c36c16cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:11.790660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48405a8d-682f-40a4-b0cb-e014c36c16cf None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:11.791016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48405a8d-682f-40a4-b0cb-e014c36c16cf None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:11.791298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48405a8d-682f-40a4-b0cb-e014c36c16cf None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:11.792014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48405a8d-682f-40a4-b0cb-e014c36c16cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:11.792322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48405a8d-682f-40a4-b0cb-e014c36c16cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:11.793732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48405a8d-682f-40a4-b0cb-e014c36c16cf None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:11.814012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 288/587] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:11.814012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48405a8d-682f-40a4-b0cb-e014c36c16cf None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:11.853294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da04803-c649-4191-8588-a84bd851f9dd None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:11.895093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ef4ae-5d83-405b-b25f-ad20f9422538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:11.898882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ef4ae-5d83-405b-b25f-ad20f9422538 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:11.898882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ef4ae-5d83-405b-b25f-ad20f9422538 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:11.898882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ef4ae-5d83-405b-b25f-ad20f9422538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:11.909464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ef4ae-5d83-405b-b25f-ad20f9422538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:11.912111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ef4ae-5d83-405b-b25f-ad20f9422538 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-b61ef4ae-5d83-405b-b25f-ad20f9422538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:11.937088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:11.938104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:11.939063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:11.939063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:11.939063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:11.939063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:11.941575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 300/588] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:11.947315 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ef4ae-5d83-405b-b25f-ad20f9422538 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:11.951724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:11.966646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48405a8d-682f-40a4-b0cb-e014c36c16cf None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:12.004222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d130edf-3464-4bdf-ad1b-3f5b9d51551a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:12.004817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d130edf-3464-4bdf-ad1b-3f5b9d51551a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:12.005098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d130edf-3464-4bdf-ad1b-3f5b9d51551a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:12.005370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d130edf-3464-4bdf-ad1b-3f5b9d51551a None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:12.006113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d130edf-3464-4bdf-ad1b-3f5b9d51551a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:12.006453 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d130edf-3464-4bdf-ad1b-3f5b9d51551a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:12.008293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d130edf-3464-4bdf-ad1b-3f5b9d51551a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:12.025478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 289/589] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:12.025478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d130edf-3464-4bdf-ad1b-3f5b9d51551a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:12.056688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:12.073999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ef4ae-5d83-405b-b25f-ad20f9422538 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:12.114468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01027b1b-0b7b-4e02-9a7b-87e82255a470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:12.115620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01027b1b-0b7b-4e02-9a7b-87e82255a470 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:12.116210 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01027b1b-0b7b-4e02-9a7b-87e82255a470 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:12.116718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01027b1b-0b7b-4e02-9a7b-87e82255a470 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:12.126169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01027b1b-0b7b-4e02-9a7b-87e82255a470 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:12.128138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01027b1b-0b7b-4e02-9a7b-87e82255a470 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:12.138100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d130edf-3464-4bdf-ad1b-3f5b9d51551a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-01027b1b-0b7b-4e02-9a7b-87e82255a470 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:12.142652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:12.143736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:12.144688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:12.144688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:12.144688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:12.144688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:12.144688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:12.144688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:12.144688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:12.144688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:12.144688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:19:12.144688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:12.147074 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 301/590] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:12.148254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01027b1b-0b7b-4e02-9a7b-87e82255a470 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:12.183369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef735f-dd5f-46d9-b559-b3ee208376da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:12.184072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef735f-dd5f-46d9-b559-b3ee208376da None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:12.184357 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef735f-dd5f-46d9-b559-b3ee208376da None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:12.184679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef735f-dd5f-46d9-b559-b3ee208376da None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:12.185777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef735f-dd5f-46d9-b559-b3ee208376da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:12.185956 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef735f-dd5f-46d9-b559-b3ee208376da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:12.187335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef735f-dd5f-46d9-b559-b3ee208376da None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:12.200285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 290/591] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:12.204828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef735f-dd5f-46d9-b559-b3ee208376da None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:12.247044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:12.266588 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01027b1b-0b7b-4e02-9a7b-87e82255a470 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:12.294378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:12.306331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611dc9-a224-4cab-971d-665745f1e818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:12.308377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611dc9-a224-4cab-971d-665745f1e818 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:12.308377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611dc9-a224-4cab-971d-665745f1e818 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:12.308377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21611dc9-a224-4cab-971d-665745f1e818 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:12.309318 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef735f-dd5f-46d9-b559-b3ee208376da None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:12.317081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21611dc9-a224-4cab-971d-665745f1e818 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:12.318905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21611dc9-a224-4cab-971d-665745f1e818 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-21611dc9-a224-4cab-971d-665745f1e818 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:12.333548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:12.334590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:12.336200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:12.336200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:12.336200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:12.336200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:12.336200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:12.336200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:12.336200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:12.336200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:12.336200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 02:19:12.336200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:12.343749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 302/592] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:12.344914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611dc9-a224-4cab-971d-665745f1e818 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:12.348243 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45b941-05e7-467b-9e41-c96b823ce936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:12.348849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45b941-05e7-467b-9e41-c96b823ce936 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:12.349137 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45b941-05e7-467b-9e41-c96b823ce936 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:12.349416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45b941-05e7-467b-9e41-c96b823ce936 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:12.350721 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45b941-05e7-467b-9e41-c96b823ce936 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:12.350721 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45b941-05e7-467b-9e41-c96b823ce936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:12.353149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45b941-05e7-467b-9e41-c96b823ce936 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:12.376869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 291/593] 10.222.0.60 () {56 vars in 1137 bytes} [Thu Aug 4 02:19:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:12.377891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45b941-05e7-467b-9e41-c96b823ce936 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:12.478684 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21611dc9-a224-4cab-971d-665745f1e818 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:12.494968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45b941-05e7-467b-9e41-c96b823ce936 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:12.511715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:12.522465 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312b496-1caf-48b8-a0ce-c4eed77755cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:12.523263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312b496-1caf-48b8-a0ce-c4eed77755cf None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:12.523641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312b496-1caf-48b8-a0ce-c4eed77755cf None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:12.524051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312b496-1caf-48b8-a0ce-c4eed77755cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:12.531356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312b496-1caf-48b8-a0ce-c4eed77755cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:12.532910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312b496-1caf-48b8-a0ce-c4eed77755cf None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:12.542229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22ff09-e6ba-428b-b596-cdaaf1e6b100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:12.542954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22ff09-e6ba-428b-b596-cdaaf1e6b100 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:12.543246 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22ff09-e6ba-428b-b596-cdaaf1e6b100 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:12.543522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22ff09-e6ba-428b-b596-cdaaf1e6b100 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:12.544339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22ff09-e6ba-428b-b596-cdaaf1e6b100 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:12.544652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22ff09-e6ba-428b-b596-cdaaf1e6b100 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-b312b496-1caf-48b8-a0ce-c4eed77755cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:12.545634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:12.546472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:12.547407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:12.547407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:12.547407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:12.547407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:12.547407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:12.547407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:12.547407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:12.547407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:12.547828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22ff09-e6ba-428b-b596-cdaaf1e6b100 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:12.552304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 303/594] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:12.553310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312b496-1caf-48b8-a0ce-c4eed77755cf None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:12.579083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 292/595] 10.222.0.60 () {56 vars in 1139 bytes} [Thu Aug 4 02:19:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:12.580340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22ff09-e6ba-428b-b596-cdaaf1e6b100 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:12.587645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:12.693094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312b496-1caf-48b8-a0ce-c4eed77755cf None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:12.708680 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22ff09-e6ba-428b-b596-cdaaf1e6b100 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:12.732712 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99db14-fcb7-4b58-bfb3-6db04a3e47ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:12.733356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99db14-fcb7-4b58-bfb3-6db04a3e47ac None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:12.733642 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99db14-fcb7-4b58-bfb3-6db04a3e47ac None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:12.733983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99db14-fcb7-4b58-bfb3-6db04a3e47ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:12.747749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99db14-fcb7-4b58-bfb3-6db04a3e47ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:12.750073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99db14-fcb7-4b58-bfb3-6db04a3e47ac None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:12.752487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11732bdc-1d16-4bfb-80a8-a2439f298c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:12.753956 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11732bdc-1d16-4bfb-80a8-a2439f298c65 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:12.754385 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11732bdc-1d16-4bfb-80a8-a2439f298c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:12.754820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11732bdc-1d16-4bfb-80a8-a2439f298c65 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:12.755677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11732bdc-1d16-4bfb-80a8-a2439f298c65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:12.756090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11732bdc-1d16-4bfb-80a8-a2439f298c65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:12.757633 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11732bdc-1d16-4bfb-80a8-a2439f298c65 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-3a99db14-fcb7-4b58-bfb3-6db04a3e47ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:12.768946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:12.784022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:12.784954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:12.784954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:12.784954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:12.784954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:12.785179 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 293/596] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:12.785267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 304/597] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:12.785344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11732bdc-1d16-4bfb-80a8-a2439f298c65 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:12.785416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99db14-fcb7-4b58-bfb3-6db04a3e47ac None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:12.828105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:12.865793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:12.906842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99db14-fcb7-4b58-bfb3-6db04a3e47ac None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:12.909975 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11732bdc-1d16-4bfb-80a8-a2439f298c65 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:12.943561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea06b4d-1b89-49d0-9735-a2354923ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:12.944294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea06b4d-1b89-49d0-9735-a2354923ea65 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:12.944654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea06b4d-1b89-49d0-9735-a2354923ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:12.945015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea06b4d-1b89-49d0-9735-a2354923ea65 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:12.945869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea06b4d-1b89-49d0-9735-a2354923ea65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:12.946251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea06b4d-1b89-49d0-9735-a2354923ea65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:12.947837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea06b4d-1b89-49d0-9735-a2354923ea65 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:12.951288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220e91d-8704-4105-8cc5-8ea0b9226b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:12.952144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220e91d-8704-4105-8cc5-8ea0b9226b5c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:12.952628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220e91d-8704-4105-8cc5-8ea0b9226b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:12.953175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220e91d-8704-4105-8cc5-8ea0b9226b5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:12.965159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 305/598] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:12.965159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea06b4d-1b89-49d0-9735-a2354923ea65 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:12.971853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220e91d-8704-4105-8cc5-8ea0b9226b5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:12.974256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220e91d-8704-4105-8cc5-8ea0b9226b5c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-a220e91d-8704-4105-8cc5-8ea0b9226b5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:12.993772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:12.994959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:12.996092 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:12.996092 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:12.996092 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:12.996092 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:12.997339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 294/599] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:12.999309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220e91d-8704-4105-8cc5-8ea0b9226b5c None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:13.105467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:13.114906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea06b4d-1b89-49d0-9735-a2354923ea65 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:13.116385 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220e91d-8704-4105-8cc5-8ea0b9226b5c None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:13.135271 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:13.156228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1639b5-56ea-45ef-b917-82522df6e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:13.157150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1639b5-56ea-45ef-b917-82522df6e102 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:13.157586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1639b5-56ea-45ef-b917-82522df6e102 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:13.158094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1639b5-56ea-45ef-b917-82522df6e102 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:13.161299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939c364-89f3-44aa-8257-3f8c80c53a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:13.162264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c364-89f3-44aa-8257-3f8c80c53a33 None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:13.162579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c364-89f3-44aa-8257-3f8c80c53a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:13.162861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c364-89f3-44aa-8257-3f8c80c53a33 None admin] PATH_INFO: `/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/10bd2ed69b324e85b8166135f045b840/roles/f71c9be92ae0492884ac931960b85e94` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:13.167657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1639b5-56ea-45ef-b917-82522df6e102 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:13.169359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1639b5-56ea-45ef-b917-82522df6e102 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:13.181949 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939c364-89f3-44aa-8257-3f8c80c53a33 None admin] RBAC: Authorizing `identity:create_grant(project_id=fae65363f2fb415b834ac367a6c4b7ad, user_id=10bd2ed69b324e85b8166135f045b840, role_id=f71c9be92ae0492884ac931960b85e94)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-ef1639b5-56ea-45ef-b917-82522df6e102 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:13.182390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:13.183296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:13.184245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:13.184245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:13.184245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:13.184245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:13.184245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:13.184245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:13.184245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:13.184245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:13.184698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939c364-89f3-44aa-8257-3f8c80c53a33 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:13.191346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 295/600] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:13.191981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1639b5-56ea-45ef-b917-82522df6e102 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:13.262610 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 306/601] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:19:12 2022] PUT /identity/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/10bd2ed69b324e85b8166135f045b840/roles/f71c9be92ae0492884ac931960b85e94 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:19:13.264073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939c364-89f3-44aa-8257-3f8c80c53a33 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:13.347749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1639b5-56ea-45ef-b917-82522df6e102 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:13.415119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75738bcb-744f-4de9-8652-65a82aa85f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:13.416262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75738bcb-744f-4de9-8652-65a82aa85f1b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:13.416774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75738bcb-744f-4de9-8652-65a82aa85f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:13.417288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75738bcb-744f-4de9-8652-65a82aa85f1b None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:13.418213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75738bcb-744f-4de9-8652-65a82aa85f1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:13.418779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75738bcb-744f-4de9-8652-65a82aa85f1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:13.420407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75738bcb-744f-4de9-8652-65a82aa85f1b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:13.447585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 296/602] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:13.454399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75738bcb-744f-4de9-8652-65a82aa85f1b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:13.477966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939c364-89f3-44aa-8257-3f8c80c53a33 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:13.503864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:13.527130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd6876-41ab-4fa3-8a4f-f7b0b33d8dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:13.528229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd6876-41ab-4fa3-8a4f-f7b0b33d8dcc None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:13.528879 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd6876-41ab-4fa3-8a4f-f7b0b33d8dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:13.529450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd6876-41ab-4fa3-8a4f-f7b0b33d8dcc None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:13.530561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd6876-41ab-4fa3-8a4f-f7b0b33d8dcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:13.531262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd6876-41ab-4fa3-8a4f-f7b0b33d8dcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:13.533654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd6876-41ab-4fa3-8a4f-f7b0b33d8dcc None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:13.550441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 307/603] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:13.557271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd6876-41ab-4fa3-8a4f-f7b0b33d8dcc None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:13.569702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:13.586705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75738bcb-744f-4de9-8652-65a82aa85f1b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:13.627997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc055532-8997-4359-8e0e-075aa0fdc3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:13.628940 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc055532-8997-4359-8e0e-075aa0fdc3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:13.629438 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc055532-8997-4359-8e0e-075aa0fdc3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:13.629811 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc055532-8997-4359-8e0e-075aa0fdc3d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:13.637928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc055532-8997-4359-8e0e-075aa0fdc3d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:13.639591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc055532-8997-4359-8e0e-075aa0fdc3d8 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-cc055532-8997-4359-8e0e-075aa0fdc3d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:13.652300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:13.653420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:13.654533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:13.654533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:13.654533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:13.654533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:13.654533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:13.654533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:13.654533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:13.654533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:13.660959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 297/604] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:13.662392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762891a0-1e9a-4def-bc10-8ff18d108906 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:13.662769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762891a0-1e9a-4def-bc10-8ff18d108906 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:13.663124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762891a0-1e9a-4def-bc10-8ff18d108906 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:13.668698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 298/605] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:13.668698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762891a0-1e9a-4def-bc10-8ff18d108906 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:13.702771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd6876-41ab-4fa3-8a4f-f7b0b33d8dcc None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:13.751641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fd262-4ef7-40af-bb9b-0f2964f341ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:13.754246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fd262-4ef7-40af-bb9b-0f2964f341ce None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:13.755299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fd262-4ef7-40af-bb9b-0f2964f341ce None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:13.756583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fd262-4ef7-40af-bb9b-0f2964f341ce None admin] PATH_INFO: `/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/3ffc2cd3c6a84eef894edae6e9b38210/roles/f71c9be92ae0492884ac931960b85e94` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:13.780153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fd262-4ef7-40af-bb9b-0f2964f341ce None admin] RBAC: Authorizing `identity:create_grant(project_id=fae65363f2fb415b834ac367a6c4b7ad, user_id=3ffc2cd3c6a84eef894edae6e9b38210, role_id=f71c9be92ae0492884ac931960b85e94)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:13.781886 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fd262-4ef7-40af-bb9b-0f2964f341ce None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:13.800478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:13.808029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762891a0-1e9a-4def-bc10-8ff18d108906 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:13.844197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1b147-a06d-4b10-8504-e1f93843609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:13.844814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1b147-a06d-4b10-8504-e1f93843609a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:13.845097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1b147-a06d-4b10-8504-e1f93843609a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:13.845370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1b147-a06d-4b10-8504-e1f93843609a None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:13.846113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1b147-a06d-4b10-8504-e1f93843609a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:13.846420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1b147-a06d-4b10-8504-e1f93843609a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:13.847923 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1b147-a06d-4b10-8504-e1f93843609a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:13.864256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 299/606] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:13.864256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5a1f6-d0cd-44c0-884d-f96b844ca7e6 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:13.864256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5a1f6-d0cd-44c0-884d-f96b844ca7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:13.864256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5a1f6-d0cd-44c0-884d-f96b844ca7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:13.881149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e6b5a1f6-d0cd-44c0-884d-f96b844ca7e6 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:13.883574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e6b5a1f6-d0cd-44c0-884d-f96b844ca7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:13.938838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 308/607] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:19:13 2022] PUT /identity/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/3ffc2cd3c6a84eef894edae6e9b38210/roles/f71c9be92ae0492884ac931960b85e94 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:19:13.939900 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fd262-4ef7-40af-bb9b-0f2964f341ce None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:13.987844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 300/608] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:14.014859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5a1f6-d0cd-44c0-884d-f96b844ca7e6 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:14.067170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:14.131445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fd262-4ef7-40af-bb9b-0f2964f341ce None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:14.135908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:14.159540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5a1f6-d0cd-44c0-884d-f96b844ca7e6 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:14.176342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfbfd7-c14c-4bc5-9c12-656681bb9bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:14.177021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfbfd7-c14c-4bc5-9c12-656681bb9bdf None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:14.177305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfbfd7-c14c-4bc5-9c12-656681bb9bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:14.177581 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfbfd7-c14c-4bc5-9c12-656681bb9bdf None admin] PATH_INFO: `/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/1ac08ad57a8e442d89ba1881abf43cff/roles/f71c9be92ae0492884ac931960b85e94` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:14.195392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfbfd7-c14c-4bc5-9c12-656681bb9bdf None admin] RBAC: Authorizing `identity:create_grant(project_id=fae65363f2fb415b834ac367a6c4b7ad, user_id=1ac08ad57a8e442d89ba1881abf43cff, role_id=f71c9be92ae0492884ac931960b85e94)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:14.197219 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfbfd7-c14c-4bc5-9c12-656681bb9bdf None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:14.203813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6bf53-4974-49c0-b976-0407e6d41166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:14.204498 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6bf53-4974-49c0-b976-0407e6d41166 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:14.204758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6bf53-4974-49c0-b976-0407e6d41166 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:14.205034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6bf53-4974-49c0-b976-0407e6d41166 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:14.216622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6bf53-4974-49c0-b976-0407e6d41166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-27a6bf53-4974-49c0-b976-0407e6d41166 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:14.221736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:14.223001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:14.223895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 301/609] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:14.225016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a57f42-0bf7-4ff6-84b4-262c53a0c793 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:14.225016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a57f42-0bf7-4ff6-84b4-262c53a0c793 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:14.225268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a57f42-0bf7-4ff6-84b4-262c53a0c793 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:14.230542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 302/610] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:14.230542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a57f42-0bf7-4ff6-84b4-262c53a0c793 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:14.281585 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 309/611] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:19:13 2022] PUT /identity/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/1ac08ad57a8e442d89ba1881abf43cff/roles/f71c9be92ae0492884ac931960b85e94 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:19:14.290515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ce18c-735b-42b3-9944-7052089ac923 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:14.290515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ce18c-735b-42b3-9944-7052089ac923 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:14.290515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ce18c-735b-42b3-9944-7052089ac923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:14.307248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-178ce18c-735b-42b3-9944-7052089ac923 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:14.309144 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-178ce18c-735b-42b3-9944-7052089ac923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:14.396786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 310/612] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:14.423794 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ce18c-735b-42b3-9944-7052089ac923 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:14.468482 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a57f42-0bf7-4ff6-84b4-262c53a0c793 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:14.494663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:14.524450 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d28f3-c106-4902-a2ac-b07c8429a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:14.525080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d28f3-c106-4902-a2ac-b07c8429a006 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:14.525365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d28f3-c106-4902-a2ac-b07c8429a006 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:14.525644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d28f3-c106-4902-a2ac-b07c8429a006 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:14.526373 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d28f3-c106-4902-a2ac-b07c8429a006 None admin] RBAC: Adding query filter params (name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:14.526723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d28f3-c106-4902-a2ac-b07c8429a006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:14.528111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d28f3-c106-4902-a2ac-b07c8429a006 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:14.537448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 303/613] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:14.545080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d28f3-c106-4902-a2ac-b07c8429a006 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:14.558919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:14.585151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ce18c-735b-42b3-9944-7052089ac923 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:14.624461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b37b51-1e54-4ed1-9aae-3ea350cea9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:14.625441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b37b51-1e54-4ed1-9aae-3ea350cea9dc None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:14.625874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b37b51-1e54-4ed1-9aae-3ea350cea9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:14.626298 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b37b51-1e54-4ed1-9aae-3ea350cea9dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:14.638178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b37b51-1e54-4ed1-9aae-3ea350cea9dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-e2b37b51-1e54-4ed1-9aae-3ea350cea9dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:14.643867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:14.644992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:14.645982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:14.645982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:14.645982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:14.645982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:14.645982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:14.645982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:14.645982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:14.645982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:14.645982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:14.645982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:14.645982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:14.645982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:14.649161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 311/614] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:14.655549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b37b51-1e54-4ed1-9aae-3ea350cea9dc None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:14.663517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d28f3-c106-4902-a2ac-b07c8429a006 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:14.702285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78c747-f0b1-45ad-8a4a-af21a40e2e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:14.703251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78c747-f0b1-45ad-8a4a-af21a40e2e6f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:14.703642 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78c747-f0b1-45ad-8a4a-af21a40e2e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:14.704022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78c747-f0b1-45ad-8a4a-af21a40e2e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:14.719416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78c747-f0b1-45ad-8a4a-af21a40e2e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:14.721075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78c747-f0b1-45ad-8a4a-af21a40e2e6f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-7a78c747-f0b1-45ad-8a4a-af21a40e2e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:14.737598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:14.738777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:14.739892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:14.739892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:14.739892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:14.739892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:14.745842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 304/615] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:14.747214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78c747-f0b1-45ad-8a4a-af21a40e2e6f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:14.776869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b37b51-1e54-4ed1-9aae-3ea350cea9dc None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:14.790869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:14.813313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:14.816072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77e590-f7a9-418b-b3cd-1f5c573bfa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:14.816902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77e590-f7a9-418b-b3cd-1f5c573bfa80 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:14.817339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77e590-f7a9-418b-b3cd-1f5c573bfa80 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:14.823033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77e590-f7a9-418b-b3cd-1f5c573bfa80 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:14.823033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77e590-f7a9-418b-b3cd-1f5c573bfa80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:14.823033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77e590-f7a9-418b-b3cd-1f5c573bfa80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:14.823033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77e590-f7a9-418b-b3cd-1f5c573bfa80 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:14.829683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 312/616] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:14.835151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77e590-f7a9-418b-b3cd-1f5c573bfa80 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:14.861137 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78c747-f0b1-45ad-8a4a-af21a40e2e6f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:14.899066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c84dcc-ee72-4b22-9ce7-d59c3e2e2ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:14.900001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c84dcc-ee72-4b22-9ce7-d59c3e2e2ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:14.900329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c84dcc-ee72-4b22-9ce7-d59c3e2e2ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:14.900708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c84dcc-ee72-4b22-9ce7-d59c3e2e2ef9 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:14.901516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c84dcc-ee72-4b22-9ce7-d59c3e2e2ef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:14.901929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c84dcc-ee72-4b22-9ce7-d59c3e2e2ef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:14.903500 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c84dcc-ee72-4b22-9ce7-d59c3e2e2ef9 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:14.922646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 305/617] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:14.924558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c84dcc-ee72-4b22-9ce7-d59c3e2e2ef9 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:14.952281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77e590-f7a9-418b-b3cd-1f5c573bfa80 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:14.990226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31c84-de1e-4be0-87e8-c4cf5b360645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:14.991128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31c84-de1e-4be0-87e8-c4cf5b360645 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:14.992339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31c84-de1e-4be0-87e8-c4cf5b360645 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:14.992486 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31c84-de1e-4be0-87e8-c4cf5b360645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:15.038155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c84dcc-ee72-4b22-9ce7-d59c3e2e2ef9 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:15.063374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:15.081101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3388509-3d54-464e-b459-18ac069a1c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:15.081990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3388509-3d54-464e-b459-18ac069a1c39 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:15.082393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3388509-3d54-464e-b459-18ac069a1c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:15.082824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3388509-3d54-464e-b459-18ac069a1c39 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:15.091663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3388509-3d54-464e-b459-18ac069a1c39 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:15.093409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3388509-3d54-464e-b459-18ac069a1c39 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-c3388509-3d54-464e-b459-18ac069a1c39 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:15.108356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:15.109560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:15.110892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:15.110892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:15.110892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:15.110892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:15.110892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:15.110892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:15.110892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:15.110892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:15.110892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:19:15.110892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:15.118273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 306/618] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:19:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:15.119694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3388509-3d54-464e-b459-18ac069a1c39 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:15.145669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31c84-de1e-4be0-87e8-c4cf5b360645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:15.151711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31c84-de1e-4be0-87e8-c4cf5b360645 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-43c31c84-de1e-4be0-87e8-c4cf5b360645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:15.180042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:15.181176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:15.182280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:15.182280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:15.182280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:15.182280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:15.190986 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 313/619] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:15.196916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31c84-de1e-4be0-87e8-c4cf5b360645 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:15.222891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:15.230153 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3388509-3d54-464e-b459-18ac069a1c39 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:15.265061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdc4e6-0d71-472f-b77b-42a0321cb21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:15.265918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdc4e6-0d71-472f-b77b-42a0321cb21f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:15.266316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdc4e6-0d71-472f-b77b-42a0321cb21f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:15.266822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdc4e6-0d71-472f-b77b-42a0321cb21f None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:15.267746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdc4e6-0d71-472f-b77b-42a0321cb21f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:15.268165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdc4e6-0d71-472f-b77b-42a0321cb21f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:15.269713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdc4e6-0d71-472f-b77b-42a0321cb21f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:15.293210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 307/620] 10.222.0.60 () {56 vars in 1135 bytes} [Thu Aug 4 02:19:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:15.294649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdc4e6-0d71-472f-b77b-42a0321cb21f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:15.351694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:15.400838 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdc4e6-0d71-472f-b77b-42a0321cb21f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:15.438298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f8a82-4bc7-4cd6-8ae0-03515aaffd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:15.439056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f8a82-4bc7-4cd6-8ae0-03515aaffd5d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:15.439556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f8a82-4bc7-4cd6-8ae0-03515aaffd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:15.439947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f8a82-4bc7-4cd6-8ae0-03515aaffd5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:15.451310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f8a82-4bc7-4cd6-8ae0-03515aaffd5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:15.453062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f8a82-4bc7-4cd6-8ae0-03515aaffd5d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:15.456551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31c84-de1e-4be0-87e8-c4cf5b360645 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-e83f8a82-4bc7-4cd6-8ae0-03515aaffd5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:15.470738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:15.471856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:15.472945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:15.472945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:15.472945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:15.472945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:15.478703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 308/621] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:15.480947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f8a82-4bc7-4cd6-8ae0-03515aaffd5d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:15.493723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c5d34-4b0f-404a-aea3-93cfd1e47a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:15.494352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c5d34-4b0f-404a-aea3-93cfd1e47a3b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:15.494683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c5d34-4b0f-404a-aea3-93cfd1e47a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:15.494964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c5d34-4b0f-404a-aea3-93cfd1e47a3b None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:15.495665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c5d34-4b0f-404a-aea3-93cfd1e47a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:15.495971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c5d34-4b0f-404a-aea3-93cfd1e47a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:15.497369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c5d34-4b0f-404a-aea3-93cfd1e47a3b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:15.509557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 314/622] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:15.515492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c5d34-4b0f-404a-aea3-93cfd1e47a3b None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:15.583108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:15.592463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f8a82-4bc7-4cd6-8ae0-03515aaffd5d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:15.635514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af79ad-6980-4e5e-b0fb-b08864d6ea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:15.636144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af79ad-6980-4e5e-b0fb-b08864d6ea94 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:15.636426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af79ad-6980-4e5e-b0fb-b08864d6ea94 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:15.636701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af79ad-6980-4e5e-b0fb-b08864d6ea94 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:15.637395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af79ad-6980-4e5e-b0fb-b08864d6ea94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:15.637700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af79ad-6980-4e5e-b0fb-b08864d6ea94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:15.639160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af79ad-6980-4e5e-b0fb-b08864d6ea94 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:15.655826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 309/623] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:15.657618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af79ad-6980-4e5e-b0fb-b08864d6ea94 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:15.756135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:15.765392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af79ad-6980-4e5e-b0fb-b08864d6ea94 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:15.801458 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4cb46-d09d-401a-980f-ea2d1c5df1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:15.802338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4cb46-d09d-401a-980f-ea2d1c5df1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:15.802799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4cb46-d09d-401a-980f-ea2d1c5df1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:15.803226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4cb46-d09d-401a-980f-ea2d1c5df1a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:15.812162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4cb46-d09d-401a-980f-ea2d1c5df1a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:15.814341 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4cb46-d09d-401a-980f-ea2d1c5df1a5 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:15.824449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c5d34-4b0f-404a-aea3-93cfd1e47a3b None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-9aa4cb46-d09d-401a-980f-ea2d1c5df1a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:15.828407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:15.829488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:15.831474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:15.831474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:15.831474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:15.831474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:15.831474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:15.831474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:15.831474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:15.831474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:15.838189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 310/624] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:15.840483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4cb46-d09d-401a-980f-ea2d1c5df1a5 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:15.859071 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:15.885811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655f0ca-0177-455c-88c4-7c50a2c493da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:15.886469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655f0ca-0177-455c-88c4-7c50a2c493da None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:15.886943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655f0ca-0177-455c-88c4-7c50a2c493da None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:15.887227 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655f0ca-0177-455c-88c4-7c50a2c493da None admin] PATH_INFO: `/v3/users/nova` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:15.896705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655f0ca-0177-455c-88c4-7c50a2c493da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:15.899049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655f0ca-0177-455c-88c4-7c50a2c493da None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-8655f0ca-0177-455c-88c4-7c50a2c493da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:15.910927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:15.912103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:15.913249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:15.913249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:15.913249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:15.913249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:15.913249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:15.913249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:15.913249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:15.913249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:15.913249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:19:15.913249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:15.917142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 315/625] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Aug 4 02:19:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:15.918513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddc965-2ad8-4203-ba85-19a2494ce7b1 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:15.918881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddc965-2ad8-4203-ba85-19a2494ce7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:15.919166 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddc965-2ad8-4203-ba85-19a2494ce7b1 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:15.920718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 316/626] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:15.921424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddc965-2ad8-4203-ba85-19a2494ce7b1 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:15.970876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4cb46-d09d-401a-980f-ea2d1c5df1a5 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:16.010221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12187b27-d125-46f7-a692-e1d802d37c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:16.011124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12187b27-d125-46f7-a692-e1d802d37c8d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:16.011560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12187b27-d125-46f7-a692-e1d802d37c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:16.011988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12187b27-d125-46f7-a692-e1d802d37c8d None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:16.012891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12187b27-d125-46f7-a692-e1d802d37c8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:16.013382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12187b27-d125-46f7-a692-e1d802d37c8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:16.015004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12187b27-d125-46f7-a692-e1d802d37c8d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:16.029010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 311/627] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:16.030612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83ff21-bd1b-4288-aa07-cba29dea5238 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:16.031140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83ff21-bd1b-4288-aa07-cba29dea5238 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:16.031630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83ff21-bd1b-4288-aa07-cba29dea5238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:16.051831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddc965-2ad8-4203-ba85-19a2494ce7b1 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:16.054610 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-7d83ff21-bd1b-4288-aa07-cba29dea5238 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:16.056189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-7d83ff21-bd1b-4288-aa07-cba29dea5238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:16.093087 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:16.102069 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9c7c2-0de2-471a-8002-15cbc37a23e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:16.102994 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9c7c2-0de2-471a-8002-15cbc37a23e8 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:16.104891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9c7c2-0de2-471a-8002-15cbc37a23e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:16.104891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9c7c2-0de2-471a-8002-15cbc37a23e8 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:16.105758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9c7c2-0de2-471a-8002-15cbc37a23e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:16.106473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9c7c2-0de2-471a-8002-15cbc37a23e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:16.108149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9c7c2-0de2-471a-8002-15cbc37a23e8 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:16.129410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 317/628] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Aug 4 02:19:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:16.130555 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9c7c2-0de2-471a-8002-15cbc37a23e8 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:16.142814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:16.154779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 312/629] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:16.156047 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83ff21-bd1b-4288-aa07-cba29dea5238 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:16.266252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9c7c2-0de2-471a-8002-15cbc37a23e8 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:16.293224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83ff21-bd1b-4288-aa07-cba29dea5238 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:16.302823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15ce3-bce5-4583-a522-81fa8c418d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:16.303758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15ce3-bce5-4583-a522-81fa8c418d0c None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:16.304283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15ce3-bce5-4583-a522-81fa8c418d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:16.304750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef15ce3-bce5-4583-a522-81fa8c418d0c None admin] PATH_INFO: `/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/6414c895c6d642a2affb36013b71df34/roles/f71c9be92ae0492884ac931960b85e94` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:16.321693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef15ce3-bce5-4583-a522-81fa8c418d0c None admin] RBAC: Authorizing `identity:create_grant(project_id=fae65363f2fb415b834ac367a6c4b7ad, user_id=6414c895c6d642a2affb36013b71df34, role_id=f71c9be92ae0492884ac931960b85e94)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:16.323506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef15ce3-bce5-4583-a522-81fa8c418d0c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:16.339904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b2215-f399-470d-b8b9-89917b7325b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:16.340536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b2215-f399-470d-b8b9-89917b7325b4 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:16.340820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b2215-f399-470d-b8b9-89917b7325b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:16.341097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b2215-f399-470d-b8b9-89917b7325b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:16.395854 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 318/630] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:19:16 2022] PUT /identity/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/6414c895c6d642a2affb36013b71df34/roles/f71c9be92ae0492884ac931960b85e94 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:19:16.397207 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15ce3-bce5-4583-a522-81fa8c418d0c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:16.437296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:16.441510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b2215-f399-470d-b8b9-89917b7325b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:16.443360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b2215-f399-470d-b8b9-89917b7325b4 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:16.455681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:16.535525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef15ce3-bce5-4583-a522-81fa8c418d0c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:16.589614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a3a1-f8e1-40e1-b00c-cf0fa6b53686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:16.590274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a3a1-f8e1-40e1-b00c-cf0fa6b53686 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:16.590590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a3a1-f8e1-40e1-b00c-cf0fa6b53686 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:16.590867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a3a1-f8e1-40e1-b00c-cf0fa6b53686 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:16.603179 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42a3a1-f8e1-40e1-b00c-cf0fa6b53686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-9e42a3a1-f8e1-40e1-b00c-cf0fa6b53686 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:16.608175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:16.609094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:16.610123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 319/631] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:16.615712 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a3a1-f8e1-40e1-b00c-cf0fa6b53686 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:16.618100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 313/632] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:16.625260 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b2215-f399-470d-b8b9-89917b7325b4 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:16.732640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:16.736627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a3a1-f8e1-40e1-b00c-cf0fa6b53686 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:16.760750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:16.764639 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b2215-f399-470d-b8b9-89917b7325b4 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:16.774091 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88bd78-caa0-4dbc-8100-3bddad8c0930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:16.774837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88bd78-caa0-4dbc-8100-3bddad8c0930 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:16.775188 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88bd78-caa0-4dbc-8100-3bddad8c0930 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:16.775471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88bd78-caa0-4dbc-8100-3bddad8c0930 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:16.776246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88bd78-caa0-4dbc-8100-3bddad8c0930 None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:16.776562 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88bd78-caa0-4dbc-8100-3bddad8c0930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:16.778023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88bd78-caa0-4dbc-8100-3bddad8c0930 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:16.788081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 320/633] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:16.789313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951848c-3ee0-475a-b523-88d7e6a7ca88 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:16.789602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951848c-3ee0-475a-b523-88d7e6a7ca88 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:16.789881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951848c-3ee0-475a-b523-88d7e6a7ca88 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:16.801107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 321/634] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:16 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:16.801945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951848c-3ee0-475a-b523-88d7e6a7ca88 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:16.829382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90606c9-99d3-41f2-9efa-f7ef953599e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:16.830206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90606c9-99d3-41f2-9efa-f7ef953599e4 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:16.830513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90606c9-99d3-41f2-9efa-f7ef953599e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:16.830806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90606c9-99d3-41f2-9efa-f7ef953599e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:16.850956 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90606c9-99d3-41f2-9efa-f7ef953599e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:16.852482 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90606c9-99d3-41f2-9efa-f7ef953599e4 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-d90606c9-99d3-41f2-9efa-f7ef953599e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:16.873359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:16.874313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:16.876572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:16.876572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:16.876572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:16.876572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:16.876572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 314/635] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:16.877238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6264f-c87c-4c8b-b1dd-5ded3a1cda07 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:16.878339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6264f-c87c-4c8b-b1dd-5ded3a1cda07 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:16.878339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6264f-c87c-4c8b-b1dd-5ded3a1cda07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:16.902027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-aca6264f-c87c-4c8b-b1dd-5ded3a1cda07 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:16.904049 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-aca6264f-c87c-4c8b-b1dd-5ded3a1cda07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:16.923957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951848c-3ee0-475a-b523-88d7e6a7ca88 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:16.962738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca1562-4674-49e2-b698-f0e8e8b740a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:16.963440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca1562-4674-49e2-b698-f0e8e8b740a4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:16.963729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca1562-4674-49e2-b698-f0e8e8b740a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:16.964046 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca1562-4674-49e2-b698-f0e8e8b740a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:16.976608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca1562-4674-49e2-b698-f0e8e8b740a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:16.978223 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca1562-4674-49e2-b698-f0e8e8b740a4 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:16.995362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 315/636] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:16.996257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6264f-c87c-4c8b-b1dd-5ded3a1cda07 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-5cca1562-4674-49e2-b698-f0e8e8b740a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:17.003608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:17.005769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:17.008661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:17.008661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:17.008661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:17.008661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:17.008661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 322/637] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:17.014597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca1562-4674-49e2-b698-f0e8e8b740a4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:17.037973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:17.100076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:17.122050 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6264f-c87c-4c8b-b1dd-5ded3a1cda07 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:17.152251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca1562-4674-49e2-b698-f0e8e8b740a4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:17.158540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a28fa4-63c1-49a0-8c87-b82754eb042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:17.159171 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a28fa4-63c1-49a0-8c87-b82754eb042d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:17.159459 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a28fa4-63c1-49a0-8c87-b82754eb042d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:17.160183 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a28fa4-63c1-49a0-8c87-b82754eb042d None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:17.160898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a28fa4-63c1-49a0-8c87-b82754eb042d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:17.161214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a28fa4-63c1-49a0-8c87-b82754eb042d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:17.163835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a28fa4-63c1-49a0-8c87-b82754eb042d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:17.176177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 316/638] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:17.176998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a28fa4-63c1-49a0-8c87-b82754eb042d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:17.192470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24884b75-3403-4a05-96b8-6d1e3479e9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:17.193095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24884b75-3403-4a05-96b8-6d1e3479e9dc None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:17.193383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24884b75-3403-4a05-96b8-6d1e3479e9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:17.193657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24884b75-3403-4a05-96b8-6d1e3479e9dc None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:17.194357 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24884b75-3403-4a05-96b8-6d1e3479e9dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:17.194878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24884b75-3403-4a05-96b8-6d1e3479e9dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:17.197186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24884b75-3403-4a05-96b8-6d1e3479e9dc None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:17.213509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 323/639] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:17.213509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3f8f3-7952-41ec-a40d-bf66f0f5348d None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:17.213509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3f8f3-7952-41ec-a40d-bf66f0f5348d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:17.213509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3f8f3-7952-41ec-a40d-bf66f0f5348d None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:17.213509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 324/640] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:17.213509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3f8f3-7952-41ec-a40d-bf66f0f5348d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:17.289700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:17.301856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a28fa4-63c1-49a0-8c87-b82754eb042d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:17.326736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3f8f3-7952-41ec-a40d-bf66f0f5348d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:17.339273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd9703-f7f5-4794-bf59-ed8d4f77bc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:17.339928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd9703-f7f5-4794-bf59-ed8d4f77bc74 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:17.340496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd9703-f7f5-4794-bf59-ed8d4f77bc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:17.340779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd9703-f7f5-4794-bf59-ed8d4f77bc74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:17.352534 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd9703-f7f5-4794-bf59-ed8d4f77bc74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-0cdd9703-f7f5-4794-bf59-ed8d4f77bc74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:17.358010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:17.359055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 317/641] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:17.359952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd9703-f7f5-4794-bf59-ed8d4f77bc74 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:17.365998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:17.369994 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67e24b-8c4e-408f-917b-e20972944ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:17.370754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67e24b-8c4e-408f-917b-e20972944ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:17.375917 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67e24b-8c4e-408f-917b-e20972944ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:17.375917 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67e24b-8c4e-408f-917b-e20972944ed4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:17.379276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67e24b-8c4e-408f-917b-e20972944ed4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:17.380850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67e24b-8c4e-408f-917b-e20972944ed4 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-7c67e24b-8c4e-408f-917b-e20972944ed4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:17.394115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:17.396156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:17.397106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:17.397106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:17.397106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:17.397106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:17.397106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:17.397106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:17.397106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:17.397106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:17.397106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 325/642] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:17.399130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b407721-2d6d-41ee-aea1-5812afca0eea None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:17.399130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b407721-2d6d-41ee-aea1-5812afca0eea None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:17.399823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b407721-2d6d-41ee-aea1-5812afca0eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:17.419789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-1b407721-2d6d-41ee-aea1-5812afca0eea None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:17.420991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1b407721-2d6d-41ee-aea1-5812afca0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:17.488451 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd9703-f7f5-4794-bf59-ed8d4f77bc74 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:17.491277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 326/643] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:17.492145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b407721-2d6d-41ee-aea1-5812afca0eea None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:17.528898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914e83a-231f-4921-8cb2-19d2466b407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:17.529535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914e83a-231f-4921-8cb2-19d2466b407a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:17.529822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914e83a-231f-4921-8cb2-19d2466b407a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:17.530123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914e83a-231f-4921-8cb2-19d2466b407a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:17.538076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914e83a-231f-4921-8cb2-19d2466b407a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:17.540123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914e83a-231f-4921-8cb2-19d2466b407a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-d914e83a-231f-4921-8cb2-19d2466b407a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:17.552177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:17.553204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:17.554286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:17.554286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:17.554286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:17.554286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:17.554286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:17.554286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:17.554286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:17.554286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:17.554286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 02:19:17.554286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:17.554286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 318/644] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:17.555695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914e83a-231f-4921-8cb2-19d2466b407a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:17.574982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:17.616514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b407721-2d6d-41ee-aea1-5812afca0eea None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:17.623667 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:17.655247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91671e-1b57-42bf-8a8e-adc09022d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:17.655877 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91671e-1b57-42bf-8a8e-adc09022d5fd None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:17.656165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91671e-1b57-42bf-8a8e-adc09022d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:17.656446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91671e-1b57-42bf-8a8e-adc09022d5fd None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:17.657170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91671e-1b57-42bf-8a8e-adc09022d5fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:17.657483 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91671e-1b57-42bf-8a8e-adc09022d5fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:17.658943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91671e-1b57-42bf-8a8e-adc09022d5fd None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:17.668243 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914e83a-231f-4921-8cb2-19d2466b407a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:17.673974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 327/645] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:17.673974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91671e-1b57-42bf-8a8e-adc09022d5fd None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:17.709812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d918-583f-4bf9-87f0-5e3bdc860db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:17.710471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d918-583f-4bf9-87f0-5e3bdc860db0 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:17.710779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d918-583f-4bf9-87f0-5e3bdc860db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:17.711063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d918-583f-4bf9-87f0-5e3bdc860db0 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:17.711826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030d918-583f-4bf9-87f0-5e3bdc860db0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:17.712141 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030d918-583f-4bf9-87f0-5e3bdc860db0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:17.713587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030d918-583f-4bf9-87f0-5e3bdc860db0 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:17.725653 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 319/646] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:17.731085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d918-583f-4bf9-87f0-5e3bdc860db0 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:17.782625 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91671e-1b57-42bf-8a8e-adc09022d5fd None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:17.807169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:17.818603 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb89dfd-e939-4bf2-a8f8-fba42c78ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:17.819205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb89dfd-e939-4bf2-a8f8-fba42c78ee3d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:17.819544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb89dfd-e939-4bf2-a8f8-fba42c78ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:17.820315 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb89dfd-e939-4bf2-a8f8-fba42c78ee3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:17.830670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb89dfd-e939-4bf2-a8f8-fba42c78ee3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-4bb89dfd-e939-4bf2-a8f8-fba42c78ee3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:17.836504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:17.837491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:17.838353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:17.838353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:17.838353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:17.838353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:17.838353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:17.838353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:17.838353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:17.838353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:17.838353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:17.838353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:17.838353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:17.838353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:17.845413 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 328/647] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:17.845413 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb89dfd-e939-4bf2-a8f8-fba42c78ee3d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:17.845657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d918-583f-4bf9-87f0-5e3bdc860db0 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:17.871934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:17.884942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a338ae-d8ae-4e6f-8354-ebc7073fcd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:17.885561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a338ae-d8ae-4e6f-8354-ebc7073fcd48 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:17.885844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a338ae-d8ae-4e6f-8354-ebc7073fcd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:17.887135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a338ae-d8ae-4e6f-8354-ebc7073fcd48 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:17.887135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a338ae-d8ae-4e6f-8354-ebc7073fcd48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:17.887302 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a338ae-d8ae-4e6f-8354-ebc7073fcd48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:17.888716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a338ae-d8ae-4e6f-8354-ebc7073fcd48 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:17.906583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 320/648] 10.222.0.60 () {56 vars in 1137 bytes} [Thu Aug 4 02:19:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:17.907317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a338ae-d8ae-4e6f-8354-ebc7073fcd48 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:17.956924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb89dfd-e939-4bf2-a8f8-fba42c78ee3d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:17.992698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fd84a-aa9c-4d3e-a751-12784c34d42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:17.993349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fd84a-aa9c-4d3e-a751-12784c34d42e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:17.993632 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fd84a-aa9c-4d3e-a751-12784c34d42e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:17.993906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fd84a-aa9c-4d3e-a751-12784c34d42e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:18.004658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fd84a-aa9c-4d3e-a751-12784c34d42e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:18.006106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fd84a-aa9c-4d3e-a751-12784c34d42e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:18.010952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a338ae-d8ae-4e6f-8354-ebc7073fcd48 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-af3fd84a-aa9c-4d3e-a751-12784c34d42e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:18.024165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:18.025119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:18.026053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:18.026053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:18.026053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:18.026053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:18.026053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 329/649] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:18.026359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fd84a-aa9c-4d3e-a751-12784c34d42e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:18.061056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3441ac-0daf-4e8f-97e7-9044d6d9f6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:18.061615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3441ac-0daf-4e8f-97e7-9044d6d9f6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:18.061895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3441ac-0daf-4e8f-97e7-9044d6d9f6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:18.062176 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3441ac-0daf-4e8f-97e7-9044d6d9f6c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:18.063002 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3441ac-0daf-4e8f-97e7-9044d6d9f6c8 None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=c6d95db1228f48669e1985eb74306a25) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:18.063320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3441ac-0daf-4e8f-97e7-9044d6d9f6c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:18.064773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3441ac-0daf-4e8f-97e7-9044d6d9f6c8 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:18.069138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:18.078508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 321/650] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:17 2022] GET /identity/v3/role_assignments?user.id=c6d95db1228f48669e1985eb74306a25&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:18.078508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3441ac-0daf-4e8f-97e7-9044d6d9f6c8 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:18.150894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:18.183959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fd84a-aa9c-4d3e-a751-12784c34d42e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:18.227510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287b27d-ee61-4bd1-b380-53d3f38850b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:18.228248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287b27d-ee61-4bd1-b380-53d3f38850b5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:18.228627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287b27d-ee61-4bd1-b380-53d3f38850b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:18.228978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287b27d-ee61-4bd1-b380-53d3f38850b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:18.229973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287b27d-ee61-4bd1-b380-53d3f38850b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:18.230398 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287b27d-ee61-4bd1-b380-53d3f38850b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:18.232206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287b27d-ee61-4bd1-b380-53d3f38850b5 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:18.237166 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3441ac-0daf-4e8f-97e7-9044d6d9f6c8 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:18.243861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 330/651] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:18.244063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287b27d-ee61-4bd1-b380-53d3f38850b5 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:18.281256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f0a0-f208-41b7-97f0-7a1aed5d70bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:18.281938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f0a0-f208-41b7-97f0-7a1aed5d70bd None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:18.282321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f0a0-f208-41b7-97f0-7a1aed5d70bd None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:18.282713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f0a0-f208-41b7-97f0-7a1aed5d70bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:18.386533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272f0a0-f208-41b7-97f0-7a1aed5d70bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:18.388167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272f0a0-f208-41b7-97f0-7a1aed5d70bd None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:18.395666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:18.402088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287b27d-ee61-4bd1-b380-53d3f38850b5 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:18.449054 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:18.460807 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54821faa-5c2e-4f87-8297-5fee1f260316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:18.461448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54821faa-5c2e-4f87-8297-5fee1f260316 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:18.461736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54821faa-5c2e-4f87-8297-5fee1f260316 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:18.462014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54821faa-5c2e-4f87-8297-5fee1f260316 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:18.463026 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54821faa-5c2e-4f87-8297-5fee1f260316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:18.463343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54821faa-5c2e-4f87-8297-5fee1f260316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:18.465231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54821faa-5c2e-4f87-8297-5fee1f260316 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:18.480925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 331/652] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:18.482367 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54821faa-5c2e-4f87-8297-5fee1f260316 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:18.509544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 322/653] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:18.510819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f0a0-f208-41b7-97f0-7a1aed5d70bd None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:18.618680 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54821faa-5c2e-4f87-8297-5fee1f260316 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:18.626629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f0a0-f208-41b7-97f0-7a1aed5d70bd None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:18.657019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f30c8-3aba-4c1f-8681-42513f80bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:18.658080 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f30c8-3aba-4c1f-8681-42513f80bd0d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:18.658624 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f30c8-3aba-4c1f-8681-42513f80bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:18.659170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f30c8-3aba-4c1f-8681-42513f80bd0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:18.672014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e841c-a325-4828-a6a0-a0953ab790ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:18.672685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e841c-a325-4828-a6a0-a0953ab790ff None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:18.672971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e841c-a325-4828-a6a0-a0953ab790ff None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:18.673248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e841c-a325-4828-a6a0-a0953ab790ff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:18.673640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f30c8-3aba-4c1f-8681-42513f80bd0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:18.675586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f30c8-3aba-4c1f-8681-42513f80bd0d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:18.682620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e841c-a325-4828-a6a0-a0953ab790ff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:18.684527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e841c-a325-4828-a6a0-a0953ab790ff None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-b90f30c8-3aba-4c1f-8681-42513f80bd0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:18.692013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:18.693157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:18.694225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:18.694225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:18.694225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:18.694225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:18.698218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 332/654] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:18.699101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f30c8-3aba-4c1f-8681-42513f80bd0d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-ff0e841c-a325-4828-a6a0-a0953ab790ff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:18.700845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:18.701769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:18.703562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:18.703562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:18.703562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:18.703562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:18.703562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:18.703562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:18.703562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:18.703562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:18.703562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:19:18.703562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:18.703562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 323/655] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:18.703562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecace7ee-d204-4035-966e-1dac221e46cc None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:18.704239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecace7ee-d204-4035-966e-1dac221e46cc None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:18.704239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecace7ee-d204-4035-966e-1dac221e46cc None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:18.705222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 324/656] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:18.709625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecace7ee-d204-4035-966e-1dac221e46cc None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:18.714280 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:18.718230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:18.816595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecace7ee-d204-4035-966e-1dac221e46cc None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:18.825826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f30c8-3aba-4c1f-8681-42513f80bd0d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:18.854191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2441e5f-b090-41c3-a3a4-ef0528934d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:18.854968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2441e5f-b090-41c3-a3a4-ef0528934d55 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:18.855161 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2441e5f-b090-41c3-a3a4-ef0528934d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:18.855437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2441e5f-b090-41c3-a3a4-ef0528934d55 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:18.856134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2441e5f-b090-41c3-a3a4-ef0528934d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:18.856438 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2441e5f-b090-41c3-a3a4-ef0528934d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:18.857899 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2441e5f-b090-41c3-a3a4-ef0528934d55 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:18.866167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babaa0c-2092-49da-b092-98e910189926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:18.867176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babaa0c-2092-49da-b092-98e910189926 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:18.867954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babaa0c-2092-49da-b092-98e910189926 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:18.868238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babaa0c-2092-49da-b092-98e910189926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:18.875755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 325/657] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:18.876947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2441e5f-b090-41c3-a3a4-ef0528934d55 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:18.883115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babaa0c-2092-49da-b092-98e910189926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:18.884662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babaa0c-2092-49da-b092-98e910189926 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-8babaa0c-2092-49da-b092-98e910189926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:18.901814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:18.902787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:18.903706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:18.903706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:18.903706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:18.903706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:18.903706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 333/658] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:18.904526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c6ab2-b8cb-411d-8aa1-d0c50876610c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:18.904640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c6ab2-b8cb-411d-8aa1-d0c50876610c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:18.904842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c6ab2-b8cb-411d-8aa1-d0c50876610c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:18.923692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-ca1c6ab2-b8cb-411d-8aa1-d0c50876610c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:18.924841 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-ca1c6ab2-b8cb-411d-8aa1-d0c50876610c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:18.989891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:19.010541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 334/659] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:19.010541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c6ab2-b8cb-411d-8aa1-d0c50876610c None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:19.073822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:19.114161 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2441e5f-b090-41c3-a3a4-ef0528934d55 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:19.127981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c6ab2-b8cb-411d-8aa1-d0c50876610c None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:19.151088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b997b-2b97-4c8e-8189-27fc3bb02e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:19.151702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b997b-2b97-4c8e-8189-27fc3bb02e91 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:19.152009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b997b-2b97-4c8e-8189-27fc3bb02e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:19.152249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b997b-2b97-4c8e-8189-27fc3bb02e91 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:19.153033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b997b-2b97-4c8e-8189-27fc3bb02e91 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:19.153336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b997b-2b97-4c8e-8189-27fc3bb02e91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:19.154807 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b997b-2b97-4c8e-8189-27fc3bb02e91 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:19.163819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e06ce1-6241-4c66-bf8c-efc39f3a8e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:19.164647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e06ce1-6241-4c66-bf8c-efc39f3a8e1c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:19.164999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e06ce1-6241-4c66-bf8c-efc39f3a8e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:19.165289 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e06ce1-6241-4c66-bf8c-efc39f3a8e1c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:19.177088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 326/660] 10.222.0.60 () {56 vars in 1137 bytes} [Thu Aug 4 02:19:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:19.177238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e06ce1-6241-4c66-bf8c-efc39f3a8e1c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:19.177345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b997b-2b97-4c8e-8189-27fc3bb02e91 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:19.177440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e06ce1-6241-4c66-bf8c-efc39f3a8e1c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-b2e06ce1-6241-4c66-bf8c-efc39f3a8e1c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:19.190666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:19.191653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:19.192605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:19.192605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:19.192605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:19.192605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:19.192605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:19.192605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:19.192605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:19.192605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:19.192605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 02:19:19.192605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:19.192605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 335/661] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:19.193218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e06ce1-6241-4c66-bf8c-efc39f3a8e1c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:19.248683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:19.285317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b997b-2b97-4c8e-8189-27fc3bb02e91 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:19.300969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e06ce1-6241-4c66-bf8c-efc39f3a8e1c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:19.309029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:19.327204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ad6da-84e0-4c66-ab9c-8456fa15b746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:19.328352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ad6da-84e0-4c66-ab9c-8456fa15b746 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:19.329216 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ad6da-84e0-4c66-ab9c-8456fa15b746 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:19.329680 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ad6da-84e0-4c66-ab9c-8456fa15b746 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:19.330618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ad6da-84e0-4c66-ab9c-8456fa15b746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:19.331232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ad6da-84e0-4c66-ab9c-8456fa15b746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:19.332908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ad6da-84e0-4c66-ab9c-8456fa15b746 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:19.337178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886113d-910c-42e8-9867-a92524c7df8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:19.337925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886113d-910c-42e8-9867-a92524c7df8c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:19.338214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886113d-910c-42e8-9867-a92524c7df8c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:19.338511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886113d-910c-42e8-9867-a92524c7df8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:19.346283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 327/662] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:19.347145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ad6da-84e0-4c66-ab9c-8456fa15b746 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:19.358016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886113d-910c-42e8-9867-a92524c7df8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-b886113d-910c-42e8-9867-a92524c7df8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:19.367168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:19.368120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:19.369095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 336/663] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:19.369840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886113d-910c-42e8-9867-a92524c7df8c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:19.466337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ad6da-84e0-4c66-ab9c-8456fa15b746 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:19.499230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886113d-910c-42e8-9867-a92524c7df8c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:19.504238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cb716-99fb-43ea-bf88-96c8cf59529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:19.504867 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb716-99fb-43ea-bf88-96c8cf59529b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:19.505147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb716-99fb-43ea-bf88-96c8cf59529b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:19.505419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb716-99fb-43ea-bf88-96c8cf59529b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:19.514142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:19.535360 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c777b-6ea3-44be-959c-c4562af9354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:19.535890 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c777b-6ea3-44be-959c-c4562af9354a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:19.536173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c777b-6ea3-44be-959c-c4562af9354a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:19.537376 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c777b-6ea3-44be-959c-c4562af9354a None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:19.537376 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c777b-6ea3-44be-959c-c4562af9354a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:19.537555 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c777b-6ea3-44be-959c-c4562af9354a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:19.539547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c777b-6ea3-44be-959c-c4562af9354a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:19.560122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:19.562380 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 337/664] 10.222.0.60 () {56 vars in 1139 bytes} [Thu Aug 4 02:19:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:19.563429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c777b-6ea3-44be-959c-c4562af9354a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:19.579309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cb716-99fb-43ea-bf88-96c8cf59529b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:19.580799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cb716-99fb-43ea-bf88-96c8cf59529b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:19.672377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c777b-6ea3-44be-959c-c4562af9354a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:19.684213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 328/665] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:19.685222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cb716-99fb-43ea-bf88-96c8cf59529b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:19.715636 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680bdbd-8920-4933-bacb-ba2a2ac918eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:19.716609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680bdbd-8920-4933-bacb-ba2a2ac918eb None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:19.717042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680bdbd-8920-4933-bacb-ba2a2ac918eb None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:19.717467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680bdbd-8920-4933-bacb-ba2a2ac918eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:19.724552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680bdbd-8920-4933-bacb-ba2a2ac918eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:19.727194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680bdbd-8920-4933-bacb-ba2a2ac918eb None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-f680bdbd-8920-4933-bacb-ba2a2ac918eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:19.739073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:19.740177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:19.741353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:19.741353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:19.741353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:19.741353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:19.741353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:19.741353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:19.741353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:19.741353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:19.743656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 338/666] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:19.744450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680bdbd-8920-4933-bacb-ba2a2ac918eb None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:19.777660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:19.778575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:19.797442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cb716-99fb-43ea-bf88-96c8cf59529b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:19.831928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103124-16d8-4d39-b738-f66f2096a5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:19.832550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103124-16d8-4d39-b738-f66f2096a5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:19.832851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103124-16d8-4d39-b738-f66f2096a5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:19.833171 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103124-16d8-4d39-b738-f66f2096a5a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:19.833917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0103124-16d8-4d39-b738-f66f2096a5a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:19.834230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0103124-16d8-4d39-b738-f66f2096a5a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:19.836425 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0103124-16d8-4d39-b738-f66f2096a5a6 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:19.844536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 329/667] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:19.845327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103124-16d8-4d39-b738-f66f2096a5a6 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:19.858242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680bdbd-8920-4933-bacb-ba2a2ac918eb None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:19.900272 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b87d4-0634-42bd-867b-956f54f63d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:19.901037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b87d4-0634-42bd-867b-956f54f63d18 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:19.901327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b87d4-0634-42bd-867b-956f54f63d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:19.901616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b87d4-0634-42bd-867b-956f54f63d18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:19.952612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103124-16d8-4d39-b738-f66f2096a5a6 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:19.973162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b87d4-0634-42bd-867b-956f54f63d18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:19.974671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b87d4-0634-42bd-867b-956f54f63d18 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:19.990063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221a009-33cc-4215-8c99-452d40a24668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:19.990991 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221a009-33cc-4215-8c99-452d40a24668 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:19.991986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221a009-33cc-4215-8c99-452d40a24668 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:19.992564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221a009-33cc-4215-8c99-452d40a24668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:20.004051 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221a009-33cc-4215-8c99-452d40a24668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:20.004666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:20.007571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221a009-33cc-4215-8c99-452d40a24668 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:20.010937 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-9221a009-33cc-4215-8c99-452d40a24668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:20.023870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:20.024970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:20.025895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:20.025895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:20.025895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:20.025895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:20.025895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 330/668] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:20.025895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221a009-33cc-4215-8c99-452d40a24668 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:20.098575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 339/669] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:20.099726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b87d4-0634-42bd-867b-956f54f63d18 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:20.141264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221a009-33cc-4215-8c99-452d40a24668 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:20.177102 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47500f23-f691-4661-af7f-b74340b83bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:20.177726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47500f23-f691-4661-af7f-b74340b83bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:20.178011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47500f23-f691-4661-af7f-b74340b83bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:20.178290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47500f23-f691-4661-af7f-b74340b83bd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:20.179900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47500f23-f691-4661-af7f-b74340b83bd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:20.180249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47500f23-f691-4661-af7f-b74340b83bd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:20.181715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47500f23-f691-4661-af7f-b74340b83bd2 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:20.196438 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 331/670] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:20.197270 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47500f23-f691-4661-af7f-b74340b83bd2 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:20.213253 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b87d4-0634-42bd-867b-956f54f63d18 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:20.247136 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:20.252543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8225b47-548e-4c08-adee-40a8edff3254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:20.253180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8225b47-548e-4c08-adee-40a8edff3254 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:20.253464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8225b47-548e-4c08-adee-40a8edff3254 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:20.253737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8225b47-548e-4c08-adee-40a8edff3254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:20.255315 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:20.265264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8225b47-548e-4c08-adee-40a8edff3254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:20.267629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8225b47-548e-4c08-adee-40a8edff3254 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-f8225b47-548e-4c08-adee-40a8edff3254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:20.286094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:20.290704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:20.291638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:20.291638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:20.291638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:20.291638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:20.291638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 340/671] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:20.291638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8225b47-548e-4c08-adee-40a8edff3254 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:20.302251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47500f23-f691-4661-af7f-b74340b83bd2 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:20.340485 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1e133-0413-401c-8ece-b6076beb7d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:20.341203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1e133-0413-401c-8ece-b6076beb7d11 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:20.341563 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1e133-0413-401c-8ece-b6076beb7d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:20.341915 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1e133-0413-401c-8ece-b6076beb7d11 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:20.342717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1e133-0413-401c-8ece-b6076beb7d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:20.343141 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1e133-0413-401c-8ece-b6076beb7d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:20.344527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1e133-0413-401c-8ece-b6076beb7d11 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:20.360170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 332/672] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:20.360170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1e133-0413-401c-8ece-b6076beb7d11 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:20.406798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8225b47-548e-4c08-adee-40a8edff3254 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:20.443231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2da865-fa5e-45c9-9130-45a5d44722b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:20.444030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2da865-fa5e-45c9-9130-45a5d44722b3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:20.444961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2da865-fa5e-45c9-9130-45a5d44722b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:20.445266 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2da865-fa5e-45c9-9130-45a5d44722b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:20.456041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2da865-fa5e-45c9-9130-45a5d44722b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:20.457499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2da865-fa5e-45c9-9130-45a5d44722b3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:20.459203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1e133-0413-401c-8ece-b6076beb7d11 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-bf2da865-fa5e-45c9-9130-45a5d44722b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:20.472892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:20.473840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:20.474777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:20.474777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:20.474777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:20.474777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:20.474777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 341/673] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:20.475083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2da865-fa5e-45c9-9130-45a5d44722b3 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:20.481573 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:20.501601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f24953-c448-4bd3-8bd8-8ca1dd8eece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:20.502144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f24953-c448-4bd3-8bd8-8ca1dd8eece0 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:20.502431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f24953-c448-4bd3-8bd8-8ca1dd8eece0 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:20.502738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f24953-c448-4bd3-8bd8-8ca1dd8eece0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:20.503563 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f24953-c448-4bd3-8bd8-8ca1dd8eece0 None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=10bd2ed69b324e85b8166135f045b840) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:20.503856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f24953-c448-4bd3-8bd8-8ca1dd8eece0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:20.505326 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f24953-c448-4bd3-8bd8-8ca1dd8eece0 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:20.511243 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:20.511726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 333/674] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:20 2022] GET /identity/v3/role_assignments?user.id=10bd2ed69b324e85b8166135f045b840&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:20.512427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f24953-c448-4bd3-8bd8-8ca1dd8eece0 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:20.602165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2da865-fa5e-45c9-9130-45a5d44722b3 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:20.641034 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40188c-4cee-4907-af82-73be7ebe2ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:20.641671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40188c-4cee-4907-af82-73be7ebe2ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:20.642024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40188c-4cee-4907-af82-73be7ebe2ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:20.642335 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40188c-4cee-4907-af82-73be7ebe2ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:20.643179 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40188c-4cee-4907-af82-73be7ebe2ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:20.643310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f24953-c448-4bd3-8bd8-8ca1dd8eece0 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:20.643495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40188c-4cee-4907-af82-73be7ebe2ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:20.645008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40188c-4cee-4907-af82-73be7ebe2ad7 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:20.658968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 342/675] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:20.659916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40188c-4cee-4907-af82-73be7ebe2ad7 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:20.685641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827dd22-cb43-434d-9ce5-96dd6f20a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:20.686688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827dd22-cb43-434d-9ce5-96dd6f20a57a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:20.687249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827dd22-cb43-434d-9ce5-96dd6f20a57a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:20.687727 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827dd22-cb43-434d-9ce5-96dd6f20a57a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:20.696395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827dd22-cb43-434d-9ce5-96dd6f20a57a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:20.698275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1827dd22-cb43-434d-9ce5-96dd6f20a57a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-1827dd22-cb43-434d-9ce5-96dd6f20a57a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:20.714504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:20.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:20.716367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:20.716367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:20.716367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:20.716367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:20.716367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:20.716367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:20.716367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:20.716367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:20.718532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 334/676] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:20.718532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827dd22-cb43-434d-9ce5-96dd6f20a57a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:20.768900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:20.778788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:20.785283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40188c-4cee-4907-af82-73be7ebe2ad7 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:20.831099 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e5090-f4d7-402e-a110-50c086c43fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:20.831701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e5090-f4d7-402e-a110-50c086c43fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:20.831987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e5090-f4d7-402e-a110-50c086c43fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:20.832268 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e5090-f4d7-402e-a110-50c086c43fb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:20.832997 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e5090-f4d7-402e-a110-50c086c43fb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:20.833309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e5090-f4d7-402e-a110-50c086c43fb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:20.834721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e5090-f4d7-402e-a110-50c086c43fb9 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:20.836019 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827dd22-cb43-434d-9ce5-96dd6f20a57a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:20.852602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 343/677] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:20.852602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa67c9-81cf-44e4-a2ed-c8fb56b9d90e None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:20.852602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa67c9-81cf-44e4-a2ed-c8fb56b9d90e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:20.852602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa67c9-81cf-44e4-a2ed-c8fb56b9d90e None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:20.854639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 344/678] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:20.855877 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa67c9-81cf-44e4-a2ed-c8fb56b9d90e None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:20.881142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ec94c-8b2a-46ae-8619-b9d0a9b50bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:20.882335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ec94c-8b2a-46ae-8619-b9d0a9b50bec None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:20.882653 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ec94c-8b2a-46ae-8619-b9d0a9b50bec None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:20.883114 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ec94c-8b2a-46ae-8619-b9d0a9b50bec None admin] PATH_INFO: `/v3/users/swift` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:20.892089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ec94c-8b2a-46ae-8619-b9d0a9b50bec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:20.893547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ec94c-8b2a-46ae-8619-b9d0a9b50bec None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-d01ec94c-8b2a-46ae-8619-b9d0a9b50bec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:20.907060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:20.908221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:20.909637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:20.909637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:20.909637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:20.909637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:20.909637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:20.909637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:20.909637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:20.909637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:20.909637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:19:20.909637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:20.909637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 335/679] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:19:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:20.909637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ec94c-8b2a-46ae-8619-b9d0a9b50bec None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:20.974167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa67c9-81cf-44e4-a2ed-c8fb56b9d90e None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:21.011368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac3b43-38e3-4e8b-b501-c0e3830bf770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:21.012016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac3b43-38e3-4e8b-b501-c0e3830bf770 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:21.012292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac3b43-38e3-4e8b-b501-c0e3830bf770 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:21.012537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac3b43-38e3-4e8b-b501-c0e3830bf770 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:21.013275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac3b43-38e3-4e8b-b501-c0e3830bf770 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:21.013587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac3b43-38e3-4e8b-b501-c0e3830bf770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:21.015065 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac3b43-38e3-4e8b-b501-c0e3830bf770 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:21.018024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:21.021143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ec94c-8b2a-46ae-8619-b9d0a9b50bec None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:21.033941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 345/680] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:21.035292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbdabe-76cd-4a20-aca1-64b39327bb4e None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:21.035586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbdabe-76cd-4a20-aca1-64b39327bb4e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:21.035863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbdabe-76cd-4a20-aca1-64b39327bb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:21.056015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-cddbdabe-76cd-4a20-aca1-64b39327bb4e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:21.057229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cddbdabe-76cd-4a20-aca1-64b39327bb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:21.068469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:21.069639 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0746bf2-6967-4f4b-a8b3-aa9c9986b49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:21.070299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0746bf2-6967-4f4b-a8b3-aa9c9986b49f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:21.070602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0746bf2-6967-4f4b-a8b3-aa9c9986b49f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:21.070885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0746bf2-6967-4f4b-a8b3-aa9c9986b49f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:21.078681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0746bf2-6967-4f4b-a8b3-aa9c9986b49f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:21.080548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0746bf2-6967-4f4b-a8b3-aa9c9986b49f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-d0746bf2-6967-4f4b-a8b3-aa9c9986b49f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:21.098416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:21.099436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:21.100948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:21.100948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:21.100948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:21.100948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:21.100948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:21.100948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:21.100948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:21.100948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:21.102782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 336/681] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:21.103968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0746bf2-6967-4f4b-a8b3-aa9c9986b49f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:21.134200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 346/682] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:21.134913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbdabe-76cd-4a20-aca1-64b39327bb4e None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:21.216570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0746bf2-6967-4f4b-a8b3-aa9c9986b49f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:21.253845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34158393-bebc-474d-a00a-7e62df86d76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:21.254596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34158393-bebc-474d-a00a-7e62df86d76d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:21.254885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34158393-bebc-474d-a00a-7e62df86d76d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:21.255162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34158393-bebc-474d-a00a-7e62df86d76d None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:21.255966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34158393-bebc-474d-a00a-7e62df86d76d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:21.256277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34158393-bebc-474d-a00a-7e62df86d76d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:21.257847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbdabe-76cd-4a20-aca1-64b39327bb4e None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:21.258284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34158393-bebc-474d-a00a-7e62df86d76d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:21.280418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 337/683] 10.222.0.60 () {56 vars in 1135 bytes} [Thu Aug 4 02:19:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:21.280418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34158393-bebc-474d-a00a-7e62df86d76d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:21.297386 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:21.299637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a96579-60a6-45d5-8140-225e690025e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:21.300690 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a96579-60a6-45d5-8140-225e690025e4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:21.300975 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a96579-60a6-45d5-8140-225e690025e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:21.301409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a96579-60a6-45d5-8140-225e690025e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:21.302207 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a96579-60a6-45d5-8140-225e690025e4 None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=3ffc2cd3c6a84eef894edae6e9b38210) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:21.302545 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a96579-60a6-45d5-8140-225e690025e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:21.304531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a96579-60a6-45d5-8140-225e690025e4 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:21.311477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 347/684] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:21 2022] GET /identity/v3/role_assignments?user.id=3ffc2cd3c6a84eef894edae6e9b38210&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:21.312304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a96579-60a6-45d5-8140-225e690025e4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:21.332195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:21.403317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34158393-bebc-474d-a00a-7e62df86d76d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:21.444059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84acd5e-fde7-4e71-94af-687a1ee3a759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:21.445257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84acd5e-fde7-4e71-94af-687a1ee3a759 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:21.445544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84acd5e-fde7-4e71-94af-687a1ee3a759 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:21.445820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84acd5e-fde7-4e71-94af-687a1ee3a759 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:21.446641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84acd5e-fde7-4e71-94af-687a1ee3a759 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:21.446959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84acd5e-fde7-4e71-94af-687a1ee3a759 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:21.448432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84acd5e-fde7-4e71-94af-687a1ee3a759 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:21.466397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 338/685] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:21.466397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84acd5e-fde7-4e71-94af-687a1ee3a759 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:21.467270 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a96579-60a6-45d5-8140-225e690025e4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:21.522832 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df2b06-9ee6-4e4c-bb45-c6056c3fdb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:21.523857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df2b06-9ee6-4e4c-bb45-c6056c3fdb50 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:21.524345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df2b06-9ee6-4e4c-bb45-c6056c3fdb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:21.524851 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df2b06-9ee6-4e4c-bb45-c6056c3fdb50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:21.535539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df2b06-9ee6-4e4c-bb45-c6056c3fdb50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-41df2b06-9ee6-4e4c-bb45-c6056c3fdb50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:21.541288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:21.542248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:21.543226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 348/686] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:19:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:21.547283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df2b06-9ee6-4e4c-bb45-c6056c3fdb50 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:21.564380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:21.594701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84acd5e-fde7-4e71-94af-687a1ee3a759 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:21.634685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7408e1-0b18-4e50-8eef-c94ab29e9428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:21.635322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7408e1-0b18-4e50-8eef-c94ab29e9428 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:21.635607 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7408e1-0b18-4e50-8eef-c94ab29e9428 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:21.635886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7408e1-0b18-4e50-8eef-c94ab29e9428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:21.651225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:21.705948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df2b06-9ee6-4e4c-bb45-c6056c3fdb50 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:21.713487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7408e1-0b18-4e50-8eef-c94ab29e9428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:21.715035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7408e1-0b18-4e50-8eef-c94ab29e9428 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:21.745102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bee03-ae50-479c-acb6-2f11bec73592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:21.745750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bee03-ae50-479c-acb6-2f11bec73592 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:21.746101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bee03-ae50-479c-acb6-2f11bec73592 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:21.746429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bee03-ae50-479c-acb6-2f11bec73592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:21.747291 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bee03-ae50-479c-acb6-2f11bec73592 None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=1ac08ad57a8e442d89ba1881abf43cff) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:21.747614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bee03-ae50-479c-acb6-2f11bec73592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:21.749130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bee03-ae50-479c-acb6-2f11bec73592 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:21.756060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 349/687] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:21 2022] GET /identity/v3/role_assignments?user.id=1ac08ad57a8e442d89ba1881abf43cff&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:21.757506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bee03-ae50-479c-acb6-2f11bec73592 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:21.877359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:21.915359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 339/688] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:21.920226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7408e1-0b18-4e50-8eef-c94ab29e9428 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:21.979896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bee03-ae50-479c-acb6-2f11bec73592 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:22.021939 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:22.028487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff1d57-0e39-4975-8b88-baf35d8384a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:22.029129 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff1d57-0e39-4975-8b88-baf35d8384a9 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:22.029416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff1d57-0e39-4975-8b88-baf35d8384a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:22.029694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff1d57-0e39-4975-8b88-baf35d8384a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:22.030743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff1d57-0e39-4975-8b88-baf35d8384a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:22.031059 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff1d57-0e39-4975-8b88-baf35d8384a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:22.033151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff1d57-0e39-4975-8b88-baf35d8384a9 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:22.043769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7408e1-0b18-4e50-8eef-c94ab29e9428 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:22.049065 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 350/689] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:22.057745 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff1d57-0e39-4975-8b88-baf35d8384a9 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:22.097832 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd06b0-947f-4dbf-b63b-2e26d1035449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:22.098673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd06b0-947f-4dbf-b63b-2e26d1035449 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:22.099286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd06b0-947f-4dbf-b63b-2e26d1035449 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:22.099566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd06b0-947f-4dbf-b63b-2e26d1035449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:22.113033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd06b0-947f-4dbf-b63b-2e26d1035449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:22.114992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd06b0-947f-4dbf-b63b-2e26d1035449 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-42dd06b0-947f-4dbf-b63b-2e26d1035449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:22.137120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:22.138057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:22.139005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:22.139005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:22.139005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:22.139005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:22.139227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 340/690] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:22.144514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd06b0-947f-4dbf-b63b-2e26d1035449 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:22.180463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:22.194461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff1d57-0e39-4975-8b88-baf35d8384a9 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:22.239413 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0428ba7-970d-4a20-9b2d-e9256f67aeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:22.240446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0428ba7-970d-4a20-9b2d-e9256f67aeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:22.240797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0428ba7-970d-4a20-9b2d-e9256f67aeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:22.241828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0428ba7-970d-4a20-9b2d-e9256f67aeb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:22.256266 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0428ba7-970d-4a20-9b2d-e9256f67aeb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:22.258670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0428ba7-970d-4a20-9b2d-e9256f67aeb5 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:22.269182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd06b0-947f-4dbf-b63b-2e26d1035449 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-a0428ba7-970d-4a20-9b2d-e9256f67aeb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:22.277452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:22.278604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:22.279589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:22.279589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:22.279589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:22.279589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:22.279589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 351/691] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:22.285609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0428ba7-970d-4a20-9b2d-e9256f67aeb5 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:22.325595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec4961-6d65-41dd-9783-31abeeae5c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:22.326653 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec4961-6d65-41dd-9783-31abeeae5c8f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:22.328197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec4961-6d65-41dd-9783-31abeeae5c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:22.328735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec4961-6d65-41dd-9783-31abeeae5c8f None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:22.329661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec4961-6d65-41dd-9783-31abeeae5c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:22.331149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec4961-6d65-41dd-9783-31abeeae5c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:22.335712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec4961-6d65-41dd-9783-31abeeae5c8f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:22.357259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 341/692] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:22.365693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec4961-6d65-41dd-9783-31abeeae5c8f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:22.404961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:22.565365 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0428ba7-970d-4a20-9b2d-e9256f67aeb5 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:22.661508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:22.682405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec4961-6d65-41dd-9783-31abeeae5c8f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:22.695852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776949d-8c9b-45dd-b768-b603c7fc109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:22.698038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776949d-8c9b-45dd-b768-b603c7fc109d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:22.705480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776949d-8c9b-45dd-b768-b603c7fc109d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:22.706357 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776949d-8c9b-45dd-b768-b603c7fc109d None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:22.708017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776949d-8c9b-45dd-b768-b603c7fc109d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:22.708957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776949d-8c9b-45dd-b768-b603c7fc109d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:22.712559 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776949d-8c9b-45dd-b768-b603c7fc109d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:22.761728 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 352/693] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:22.768252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776949d-8c9b-45dd-b768-b603c7fc109d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:22.807095 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5b4cd-29b0-4cd8-81b6-cdde28c5f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:22.809213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5b4cd-29b0-4cd8-81b6-cdde28c5f129 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:22.810219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5b4cd-29b0-4cd8-81b6-cdde28c5f129 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:22.811007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5b4cd-29b0-4cd8-81b6-cdde28c5f129 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:22.830081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5b4cd-29b0-4cd8-81b6-cdde28c5f129 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:22.833222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5b4cd-29b0-4cd8-81b6-cdde28c5f129 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-04e5b4cd-29b0-4cd8-81b6-cdde28c5f129 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:22.864100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:22.866569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:22.868596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:22.868596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:22.868596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:22.868596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:22.868596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:22.868596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:22.868596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:22.868596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:22.874154 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 342/694] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 511 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:22.879903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28ed1b-d0dd-422e-8303-4d4775ed7aea None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:22.880229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28ed1b-d0dd-422e-8303-4d4775ed7aea None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:22.882605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28ed1b-d0dd-422e-8303-4d4775ed7aea None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:22.884797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 343/695] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:22.885263 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28ed1b-d0dd-422e-8303-4d4775ed7aea None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:22.924207 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776949d-8c9b-45dd-b768-b603c7fc109d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:22.934045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:22.965477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522046d5-4919-4fc8-aa18-8399645ebdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:22.966128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522046d5-4919-4fc8-aa18-8399645ebdea None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:22.967542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522046d5-4919-4fc8-aa18-8399645ebdea None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:22.967843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522046d5-4919-4fc8-aa18-8399645ebdea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:22.977009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522046d5-4919-4fc8-aa18-8399645ebdea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:22.978583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522046d5-4919-4fc8-aa18-8399645ebdea None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-522046d5-4919-4fc8-aa18-8399645ebdea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:22.993197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:22.994208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:22.995198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:22.995198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:22.995198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:22.995198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:22.995198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:22.995198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:22.995198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:22.995198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:22.995198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:19:22.995198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:22.995198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 353/696] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Aug 4 02:19:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:22.995787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e852d54-8bd5-4cbc-bb2b-a8dde9a81401 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:22.996361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e852d54-8bd5-4cbc-bb2b-a8dde9a81401 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:22.996361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e852d54-8bd5-4cbc-bb2b-a8dde9a81401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:23.016670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-7e852d54-8bd5-4cbc-bb2b-a8dde9a81401 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:23.018031 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7e852d54-8bd5-4cbc-bb2b-a8dde9a81401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:23.038255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28ed1b-d0dd-422e-8303-4d4775ed7aea None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:23.082206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e15a1-c3a1-42ca-84d0-720522f61283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:23.083620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e15a1-c3a1-42ca-84d0-720522f61283 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:23.084534 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e15a1-c3a1-42ca-84d0-720522f61283 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:23.085063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e15a1-c3a1-42ca-84d0-720522f61283 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:23.086325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e15a1-c3a1-42ca-84d0-720522f61283 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:23.086865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e15a1-c3a1-42ca-84d0-720522f61283 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:23.089261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e15a1-c3a1-42ca-84d0-720522f61283 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:23.108937 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 344/698] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:23.109267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 354/698] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:23.109785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e15a1-c3a1-42ca-84d0-720522f61283 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:23.111716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e852d54-8bd5-4cbc-bb2b-a8dde9a81401 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:23.133783 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:23.230232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:23.237947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e852d54-8bd5-4cbc-bb2b-a8dde9a81401 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:23.238665 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e15a1-c3a1-42ca-84d0-720522f61283 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:23.280193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc2d70-2c80-4ca1-8d13-ae01c8bdfa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:23.280864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc2d70-2c80-4ca1-8d13-ae01c8bdfa85 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:23.281183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc2d70-2c80-4ca1-8d13-ae01c8bdfa85 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:23.281439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc2d70-2c80-4ca1-8d13-ae01c8bdfa85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:23.282247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc2d70-2c80-4ca1-8d13-ae01c8bdfa85 None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=6414c895c6d642a2affb36013b71df34) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:23.282599 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc2d70-2c80-4ca1-8d13-ae01c8bdfa85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:23.284054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc2d70-2c80-4ca1-8d13-ae01c8bdfa85 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:23.286272 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfc1f5-d104-4a82-bb34-7242f46f1c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:23.287673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfc1f5-d104-4a82-bb34-7242f46f1c7b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:23.288892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfc1f5-d104-4a82-bb34-7242f46f1c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:23.289565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfc1f5-d104-4a82-bb34-7242f46f1c7b None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:23.290616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfc1f5-d104-4a82-bb34-7242f46f1c7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:23.291150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfc1f5-d104-4a82-bb34-7242f46f1c7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:23.292805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfc1f5-d104-4a82-bb34-7242f46f1c7b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:23.298845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 355/699] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:23 2022] GET /identity/v3/role_assignments?user.id=6414c895c6d642a2affb36013b71df34&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:23.299885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc2d70-2c80-4ca1-8d13-ae01c8bdfa85 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:23.316860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 345/700] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Aug 4 02:19:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:23.325454 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfc1f5-d104-4a82-bb34-7242f46f1c7b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:23.402163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:23.433841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfc1f5-d104-4a82-bb34-7242f46f1c7b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:23.472887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da64598-a8ff-4cca-8a7d-ac5bdac42e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:23.473538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da64598-a8ff-4cca-8a7d-ac5bdac42e64 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:23.473830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da64598-a8ff-4cca-8a7d-ac5bdac42e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:23.474118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da64598-a8ff-4cca-8a7d-ac5bdac42e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:23.531602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc2d70-2c80-4ca1-8d13-ae01c8bdfa85 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:23.551189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da64598-a8ff-4cca-8a7d-ac5bdac42e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:23.552666 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da64598-a8ff-4cca-8a7d-ac5bdac42e64 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:23.591374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84241b-f5a5-4baa-83db-1520d132485c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:23.592056 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84241b-f5a5-4baa-83db-1520d132485c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:23.592343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84241b-f5a5-4baa-83db-1520d132485c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:23.592617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84241b-f5a5-4baa-83db-1520d132485c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:23.604965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84241b-f5a5-4baa-83db-1520d132485c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:23.606430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84241b-f5a5-4baa-83db-1520d132485c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-6d84241b-f5a5-4baa-83db-1520d132485c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:23.621549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:23.622475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:23.623415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:23.623415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:23.623415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:23.623415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:23.623415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 356/701] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:23.624389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e7084-604c-4e5c-9338-fc973dda6c14 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:23.624620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e7084-604c-4e5c-9338-fc973dda6c14 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:23.624877 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e7084-604c-4e5c-9338-fc973dda6c14 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:23.630189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 357/702] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:23.631024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e7084-604c-4e5c-9338-fc973dda6c14 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:23.635480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:23.649730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:23.681256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 346/703] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:23.682988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0be89-8e7c-4a59-9332-d2de0686d8b8 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:23.683487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0be89-8e7c-4a59-9332-d2de0686d8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:23.684035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0be89-8e7c-4a59-9332-d2de0686d8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:23.705482 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-eaa0be89-8e7c-4a59-9332-d2de0686d8b8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:23.707267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-eaa0be89-8e7c-4a59-9332-d2de0686d8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:23.763981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e7084-604c-4e5c-9338-fc973dda6c14 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:23.795984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 347/704] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:23.797801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0be89-8e7c-4a59-9332-d2de0686d8b8 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:23.812795 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687a624-fd23-4a92-875d-8e3b2f7d5e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:23.813942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687a624-fd23-4a92-875d-8e3b2f7d5e7f None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:23.814242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687a624-fd23-4a92-875d-8e3b2f7d5e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:23.814550 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687a624-fd23-4a92-875d-8e3b2f7d5e7f None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:23.815271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687a624-fd23-4a92-875d-8e3b2f7d5e7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:23.815872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687a624-fd23-4a92-875d-8e3b2f7d5e7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:23.817543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687a624-fd23-4a92-875d-8e3b2f7d5e7f None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:23.838512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 358/705] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:23.838512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687a624-fd23-4a92-875d-8e3b2f7d5e7f None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:23.925287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:23.930751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:23.935895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0be89-8e7c-4a59-9332-d2de0686d8b8 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:23.957586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687a624-fd23-4a92-875d-8e3b2f7d5e7f None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:23.972972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ecff2-1f90-4a14-a617-d9f2662aea1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:23.974146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ecff2-1f90-4a14-a617-d9f2662aea1a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:23.974697 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ecff2-1f90-4a14-a617-d9f2662aea1a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:23.975200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ecff2-1f90-4a14-a617-d9f2662aea1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:23.987400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ecff2-1f90-4a14-a617-d9f2662aea1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:23.989213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ecff2-1f90-4a14-a617-d9f2662aea1a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:23.994007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d77f96-d6d6-4032-9f1c-fb29d204bba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:23.994748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d77f96-d6d6-4032-9f1c-fb29d204bba1 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:23.995036 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d77f96-d6d6-4032-9f1c-fb29d204bba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:23.995314 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d77f96-d6d6-4032-9f1c-fb29d204bba1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:23.995956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d77f96-d6d6-4032-9f1c-fb29d204bba1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:23.997411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d77f96-d6d6-4032-9f1c-fb29d204bba1 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-764ecff2-1f90-4a14-a617-d9f2662aea1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:24.010371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:24.011353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:24.012314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:24.012314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:24.012314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:24.012314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-74d77f96-d6d6-4032-9f1c-fb29d204bba1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:24.012551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:24.014214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:24.015606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 359/706] 10.222.0.60 () {56 vars in 1129 bytes} [Thu Aug 4 02:19:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:24.017283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d77f96-d6d6-4032-9f1c-fb29d204bba1 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:24.019259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 348/707] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:24.021311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ecff2-1f90-4a14-a617-d9f2662aea1a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:24.129357 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d77f96-d6d6-4032-9f1c-fb29d204bba1 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:24.147875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ecff2-1f90-4a14-a617-d9f2662aea1a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:24.165383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c851f3a-f219-4552-bd39-cff487e4df25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:24.166001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c851f3a-f219-4552-bd39-cff487e4df25 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:24.166289 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c851f3a-f219-4552-bd39-cff487e4df25 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:24.166594 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c851f3a-f219-4552-bd39-cff487e4df25 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:24.167305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c851f3a-f219-4552-bd39-cff487e4df25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:24.168907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c851f3a-f219-4552-bd39-cff487e4df25 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:24.179264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:24.189977 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9152a-22e7-4727-825a-4555caf6daf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:24.190744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9152a-22e7-4727-825a-4555caf6daf0 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:24.191088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9152a-22e7-4727-825a-4555caf6daf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:24.192866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9152a-22e7-4727-825a-4555caf6daf0 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:24.192866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9152a-22e7-4727-825a-4555caf6daf0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:24.192866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9152a-22e7-4727-825a-4555caf6daf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:24.193919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9152a-22e7-4727-825a-4555caf6daf0 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:24.199312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 349/708] 10.222.0.60 () {56 vars in 1124 bytes} [Thu Aug 4 02:19:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:24.200279 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9152a-22e7-4727-825a-4555caf6daf0 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:24.221617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:24.265710 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 360/709] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:19:24 2022] POST /identity/v3/users => generated 254 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:19:24.266791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c851f3a-f219-4552-bd39-cff487e4df25 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:24.360699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9152a-22e7-4727-825a-4555caf6daf0 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:24.411854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce44b8-6426-4c01-a019-291259723f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:24.412804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce44b8-6426-4c01-a019-291259723f2e None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:24.413247 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce44b8-6426-4c01-a019-291259723f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:24.413673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce44b8-6426-4c01-a019-291259723f2e None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:24.413787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c851f3a-f219-4552-bd39-cff487e4df25 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:24.414684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce44b8-6426-4c01-a019-291259723f2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:24.415145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce44b8-6426-4c01-a019-291259723f2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:24.418029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce44b8-6426-4c01-a019-291259723f2e None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:24.434536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 350/710] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:24.436191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d33f4c-7629-4953-b9d1-0a3d6bb15307 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:24.436553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d33f4c-7629-4953-b9d1-0a3d6bb15307 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:24.436915 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d33f4c-7629-4953-b9d1-0a3d6bb15307 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:24.442535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 351/711] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:24.443568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d33f4c-7629-4953-b9d1-0a3d6bb15307 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:24.460842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ccea3-9b97-4cf5-be61-03b19e7c17a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:24.461957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ccea3-9b97-4cf5-be61-03b19e7c17a3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:24.462817 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ccea3-9b97-4cf5-be61-03b19e7c17a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:24.463391 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ccea3-9b97-4cf5-be61-03b19e7c17a3 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:24.464333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ccea3-9b97-4cf5-be61-03b19e7c17a3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:24.464948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ccea3-9b97-4cf5-be61-03b19e7c17a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:24.466853 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ccea3-9b97-4cf5-be61-03b19e7c17a3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:24.474735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 361/712] 10.222.0.60 () {56 vars in 1124 bytes} [Thu Aug 4 02:19:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:24.476571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389d05-33dc-447c-8b4d-a70bbcf285e4 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:24.477457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389d05-33dc-447c-8b4d-a70bbcf285e4 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:24.477891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389d05-33dc-447c-8b4d-a70bbcf285e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:24.504204 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-d5389d05-33dc-447c-8b4d-a70bbcf285e4 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:24.506094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d5389d05-33dc-447c-8b4d-a70bbcf285e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:24.572238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d33f4c-7629-4953-b9d1-0a3d6bb15307 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:24.609681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 362/713] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:24.623556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d3320-f99c-4e32-bdac-2a2fbc5fccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:24.624501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d3320-f99c-4e32-bdac-2a2fbc5fccb2 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:24.624994 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d3320-f99c-4e32-bdac-2a2fbc5fccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:24.625457 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d3320-f99c-4e32-bdac-2a2fbc5fccb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:24.638047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5389d05-33dc-447c-8b4d-a70bbcf285e4 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:24.639632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d3320-f99c-4e32-bdac-2a2fbc5fccb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:24.641478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d3320-f99c-4e32-bdac-2a2fbc5fccb2 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-a31d3320-f99c-4e32-bdac-2a2fbc5fccb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:24.655429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:24.656405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:24.657376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:24.657376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:24.657376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:24.657376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:24.657376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:24.657376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:24.657376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:24.657376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:24.659890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 352/714] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:24.665755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d3320-f99c-4e32-bdac-2a2fbc5fccb2 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:24.773208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5389d05-33dc-447c-8b4d-a70bbcf285e4 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:24.785255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d3320-f99c-4e32-bdac-2a2fbc5fccb2 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:24.819593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ca9f6-55e7-404b-8e80-c3a8b7272785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:24.822535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ca9f6-55e7-404b-8e80-c3a8b7272785 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:24.822535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ca9f6-55e7-404b-8e80-c3a8b7272785 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:24.822535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ca9f6-55e7-404b-8e80-c3a8b7272785 None admin] PATH_INFO: `/v3/services/network` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:24.822535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ca9f6-55e7-404b-8e80-c3a8b7272785 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:24.822821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:24.823259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ca9f6-55e7-404b-8e80-c3a8b7272785 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:24.827215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022d640-d2ba-4652-988d-ee6172fd4591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:24.827844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022d640-d2ba-4652-988d-ee6172fd4591 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:24.828128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022d640-d2ba-4652-988d-ee6172fd4591 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:24.828404 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022d640-d2ba-4652-988d-ee6172fd4591 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:24.829291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022d640-d2ba-4652-988d-ee6172fd4591 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:24.829605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022d640-d2ba-4652-988d-ee6172fd4591 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:24.831091 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022d640-d2ba-4652-988d-ee6172fd4591 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-f80ca9f6-55e7-404b-8e80-c3a8b7272785 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:24.849469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:24.852978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:24.853824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 363/715] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:24 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:24.854644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:24.862402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ca9f6-55e7-404b-8e80-c3a8b7272785 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:24.862888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 353/716] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:24.871598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022d640-d2ba-4652-988d-ee6172fd4591 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:24.879176 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:24.988383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:25.035625 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ca9f6-55e7-404b-8e80-c3a8b7272785 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:25.076736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022d640-d2ba-4652-988d-ee6172fd4591 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:25.114439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc0375-9d03-4808-a67d-5ee7caced287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:25.115095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc0375-9d03-4808-a67d-5ee7caced287 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:25.115381 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc0375-9d03-4808-a67d-5ee7caced287 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:25.115663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc0375-9d03-4808-a67d-5ee7caced287 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:25.116881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc0375-9d03-4808-a67d-5ee7caced287 None admin] RBAC: Adding query filter params (name=network) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:25.117945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc0375-9d03-4808-a67d-5ee7caced287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:25.119380 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc0375-9d03-4808-a67d-5ee7caced287 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:25.121651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368142fd-15b4-4cc0-9517-5ffd70f9434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:25.122279 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368142fd-15b4-4cc0-9517-5ffd70f9434e None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:25.122584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368142fd-15b4-4cc0-9517-5ffd70f9434e None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:25.122861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368142fd-15b4-4cc0-9517-5ffd70f9434e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:25.123661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368142fd-15b4-4cc0-9517-5ffd70f9434e None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=c6d95db1228f48669e1985eb74306a25) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:25.123973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368142fd-15b4-4cc0-9517-5ffd70f9434e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:25.125404 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368142fd-15b4-4cc0-9517-5ffd70f9434e None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:25.130772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 364/717] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:19:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:25.132354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 354/718] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:24 2022] GET /identity/v3/role_assignments?user.id=c6d95db1228f48669e1985eb74306a25&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:25.137345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc0375-9d03-4808-a67d-5ee7caced287 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:25.296816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc0375-9d03-4808-a67d-5ee7caced287 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:25.314899 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:25.342876 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289a311-d173-475d-b22a-de69323e4f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:25.343522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289a311-d173-475d-b22a-de69323e4f52 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:25.343808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289a311-d173-475d-b22a-de69323e4f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:25.344085 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289a311-d173-475d-b22a-de69323e4f52 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:25.344779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289a311-d173-475d-b22a-de69323e4f52 None admin] RBAC: Adding query filter params (type=network) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:25.345084 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289a311-d173-475d-b22a-de69323e4f52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:25.346467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289a311-d173-475d-b22a-de69323e4f52 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:25.352423 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 365/719] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:19:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:25.938192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811b93b-c646-4052-9daa-1b0043a2e444 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:25.938732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811b93b-c646-4052-9daa-1b0043a2e444 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:25.938810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811b93b-c646-4052-9daa-1b0043a2e444 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:25.940573 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 355/720] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:25.950225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ddc21-e22f-4db1-9a40-66af3de69a0e None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:25.950552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ddc21-e22f-4db1-9a40-66af3de69a0e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:25.950842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ddc21-e22f-4db1-9a40-66af3de69a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:25.976100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-771ddc21-e22f-4db1-9a40-66af3de69a0e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:25.977557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-771ddc21-e22f-4db1-9a40-66af3de69a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:26.106497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 366/721] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:26.143600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811b93b-c646-4052-9daa-1b0043a2e444 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:26.282090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:26.351703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811b93b-c646-4052-9daa-1b0043a2e444 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:26.392908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc800c82-f09a-48c5-96bf-202486663d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:26.393553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc800c82-f09a-48c5-96bf-202486663d00 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:26.393839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc800c82-f09a-48c5-96bf-202486663d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:26.394120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc800c82-f09a-48c5-96bf-202486663d00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:26.411215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc800c82-f09a-48c5-96bf-202486663d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-bc800c82-f09a-48c5-96bf-202486663d00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:26.416663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:26.418198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:26.419712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 356/722] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:26.426511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ddc21-e22f-4db1-9a40-66af3de69a0e None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:26.537130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ddc21-e22f-4db1-9a40-66af3de69a0e None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:26.546752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:26.578041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd213f67-4621-4918-a682-9b6521062316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:26.579249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213f67-4621-4918-a682-9b6521062316 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:26.579940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213f67-4621-4918-a682-9b6521062316 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:26.580508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213f67-4621-4918-a682-9b6521062316 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:26.581722 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd213f67-4621-4918-a682-9b6521062316 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:26.582034 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd213f67-4621-4918-a682-9b6521062316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:26.583436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd213f67-4621-4918-a682-9b6521062316 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:26.592536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 367/723] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:26.597990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc800c82-f09a-48c5-96bf-202486663d00 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:26.741136 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc800c82-f09a-48c5-96bf-202486663d00 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:26.770998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:26.801957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eea6d8-7faa-49dd-aea2-da27d800b3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:26.803872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eea6d8-7faa-49dd-aea2-da27d800b3cf None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:26.804922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eea6d8-7faa-49dd-aea2-da27d800b3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:26.816903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eea6d8-7faa-49dd-aea2-da27d800b3cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:26.825148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eea6d8-7faa-49dd-aea2-da27d800b3cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:26.827885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eea6d8-7faa-49dd-aea2-da27d800b3cf None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-81eea6d8-7faa-49dd-aea2-da27d800b3cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:26.855413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:26.857160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:26.859085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:26.859085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:26.859085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:26.859085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:26.859085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 357/724] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:26.863435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd213f67-4621-4918-a682-9b6521062316 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:26.981058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd213f67-4621-4918-a682-9b6521062316 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:27.019244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec5c87-8abe-47b1-86e8-63d50b44a6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:27.019865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec5c87-8abe-47b1-86e8-63d50b44a6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.020146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec5c87-8abe-47b1-86e8-63d50b44a6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.020419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec5c87-8abe-47b1-86e8-63d50b44a6b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:27.021114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec5c87-8abe-47b1-86e8-63d50b44a6b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:27.021419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec5c87-8abe-47b1-86e8-63d50b44a6b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:27.022907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec5c87-8abe-47b1-86e8-63d50b44a6b5 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:27.039271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 368/725] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:27.054987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eea6d8-7faa-49dd-aea2-da27d800b3cf None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:27.190614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eea6d8-7faa-49dd-aea2-da27d800b3cf None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:27.223180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c5dae-240b-4865-b41d-cb57d1a291e5 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.223471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c5dae-240b-4865-b41d-cb57d1a291e5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.223751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c5dae-240b-4865-b41d-cb57d1a291e5 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:27.225431 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 369/726] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:19:27.235730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189c66f-7556-49e2-abf9-bbecbec9dbc9 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.236013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189c66f-7556-49e2-abf9-bbecbec9dbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.236321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189c66f-7556-49e2-abf9-bbecbec9dbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:27.240613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1bd6d-e857-4740-9831-e2f2d768ddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:27.242192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1bd6d-e857-4740-9831-e2f2d768ddbb None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.242853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1bd6d-e857-4740-9831-e2f2d768ddbb None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.243336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1bd6d-e857-4740-9831-e2f2d768ddbb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:27.253010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1bd6d-e857-4740-9831-e2f2d768ddbb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:27.254614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1bd6d-e857-4740-9831-e2f2d768ddbb None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:27.265589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-9189c66f-7556-49e2-abf9-bbecbec9dbc9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:27.267096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9189c66f-7556-49e2-abf9-bbecbec9dbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-f9d1bd6d-e857-4740-9831-e2f2d768ddbb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:27.275634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:27.276647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:27.277615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:27.277615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:27.277615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:27.277615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:27.277615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:27.277615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:27.277615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:27.277615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:27.277615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:19:27.277615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:27.277615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 358/727] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:19:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:27.288421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1bd6d-e857-4740-9831-e2f2d768ddbb None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:27.325148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:27.349716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:27.401777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 370/728] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:19:27.456899 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189c66f-7556-49e2-abf9-bbecbec9dbc9 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:27.460847 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1bd6d-e857-4740-9831-e2f2d768ddbb None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:27.499341 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223840d-e133-4faa-ad5e-39de3141024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:27.501336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223840d-e133-4faa-ad5e-39de3141024e None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.502018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223840d-e133-4faa-ad5e-39de3141024e None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.502886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223840d-e133-4faa-ad5e-39de3141024e None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:27.503717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223840d-e133-4faa-ad5e-39de3141024e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:27.504028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223840d-e133-4faa-ad5e-39de3141024e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:27.505465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223840d-e133-4faa-ad5e-39de3141024e None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:27.529102 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 359/729] 10.222.0.60 () {56 vars in 1135 bytes} [Thu Aug 4 02:19:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:27.530367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261037a-82eb-4c4b-b52d-5618f70fb5c7 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.530698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261037a-82eb-4c4b-b52d-5618f70fb5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.530973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261037a-82eb-4c4b-b52d-5618f70fb5c7 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:27.532428 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 360/730] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:27.538517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261037a-82eb-4c4b-b52d-5618f70fb5c7 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:27.612316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189c66f-7556-49e2-abf9-bbecbec9dbc9 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:27.644844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:27.663036 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810812c-6288-4eee-8dd4-08cc7f213587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:27.663441 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261037a-82eb-4c4b-b52d-5618f70fb5c7 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:27.663730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810812c-6288-4eee-8dd4-08cc7f213587 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.664018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810812c-6288-4eee-8dd4-08cc7f213587 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.664300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810812c-6288-4eee-8dd4-08cc7f213587 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:27.665060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810812c-6288-4eee-8dd4-08cc7f213587 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:27.667496 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810812c-6288-4eee-8dd4-08cc7f213587 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:27.704633 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0228b-46c6-4b5f-a8e1-5e69b217fa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:27.705516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0228b-46c6-4b5f-a8e1-5e69b217fa1d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.706004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0228b-46c6-4b5f-a8e1-5e69b217fa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.706424 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0228b-46c6-4b5f-a8e1-5e69b217fa1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:27.763115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 371/731] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:19:27 2022] POST /identity/v3/services => generated 251 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:19:27.764917 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d88a3b-e113-44e6-a843-95c97373f1a8 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.765319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d88a3b-e113-44e6-a843-95c97373f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.765703 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d88a3b-e113-44e6-a843-95c97373f1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:27.809674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-49d88a3b-e113-44e6-a843-95c97373f1a8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:27.811867 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0228b-46c6-4b5f-a8e1-5e69b217fa1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:27.812979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-49d88a3b-e113-44e6-a843-95c97373f1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:27.816385 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0228b-46c6-4b5f-a8e1-5e69b217fa1d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:27.844556 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:27.937165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 372/732] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:27.938406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561ee60-a8db-40d8-982b-f17aa325340f None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.938747 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561ee60-a8db-40d8-982b-f17aa325340f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.939026 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561ee60-a8db-40d8-982b-f17aa325340f None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:27.945309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 373/733] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:27.946660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b04c7-d78b-4085-ba8c-25ed2b79889f None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.946956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b04c7-d78b-4085-ba8c-25ed2b79889f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.947220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b04c7-d78b-4085-ba8c-25ed2b79889f None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:27.954999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 374/734] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:27.954999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5d2bf-a639-4dde-ae51-da7c263a965d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.954999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5d2bf-a639-4dde-ae51-da7c263a965d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.954999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5d2bf-a639-4dde-ae51-da7c263a965d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:27.956316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:27.969969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-6cf5d2bf-a639-4dde-ae51-da7c263a965d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:27.971515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-6cf5d2bf-a639-4dde-ae51-da7c263a965d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:27.975513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 361/735] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:19:27.976793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8f202-fd67-49e2-b61f-a7a6f9fa02be None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:27.977102 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8f202-fd67-49e2-b61f-a7a6f9fa02be None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:27.977383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8f202-fd67-49e2-b61f-a7a6f9fa02be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:28.003748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8dc8f202-fd67-49e2-b61f-a7a6f9fa02be None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:28.005219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8dc8f202-fd67-49e2-b61f-a7a6f9fa02be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:28.049345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 375/736] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:28.050403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5d2bf-a639-4dde-ae51-da7c263a965d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:28.084969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 362/737] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:19:28.086503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8f202-fd67-49e2-b61f-a7a6f9fa02be None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:28.144828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:28.168973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5d2bf-a639-4dde-ae51-da7c263a965d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:28.207196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8f202-fd67-49e2-b61f-a7a6f9fa02be None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:28.210278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad642ee1-d2da-41ff-98c2-05069cebf0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:28.210955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad642ee1-d2da-41ff-98c2-05069cebf0ac None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:28.211240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad642ee1-d2da-41ff-98c2-05069cebf0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:28.211516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad642ee1-d2da-41ff-98c2-05069cebf0ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:28.223318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad642ee1-d2da-41ff-98c2-05069cebf0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:28.226182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-ad642ee1-d2da-41ff-98c2-05069cebf0ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:28.228323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:28.229309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:28.230173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 376/738] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:28.231975 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad642ee1-d2da-41ff-98c2-05069cebf0ac None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:28.249261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec78ea8-9dfc-406a-9f4b-9649da37ac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:28.250063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec78ea8-9dfc-406a-9f4b-9649da37ac87 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:28.250299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec78ea8-9dfc-406a-9f4b-9649da37ac87 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:28.250604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec78ea8-9dfc-406a-9f4b-9649da37ac87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:28.263341 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec78ea8-9dfc-406a-9f4b-9649da37ac87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:28.264782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec78ea8-9dfc-406a-9f4b-9649da37ac87 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-eec78ea8-9dfc-406a-9f4b-9649da37ac87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:28.281077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:28.282143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:28.283117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:28.283117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:28.283117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:28.283117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:28.283117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 363/739] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:28.283117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec78ea8-9dfc-406a-9f4b-9649da37ac87 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:28.351669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad642ee1-d2da-41ff-98c2-05069cebf0ac None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:28.388480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec78ea8-9dfc-406a-9f4b-9649da37ac87 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:28.390304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946103-4c4d-48b0-8a21-96ea1f551bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:28.391446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946103-4c4d-48b0-8a21-96ea1f551bed None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:28.391446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946103-4c4d-48b0-8a21-96ea1f551bed None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:28.391652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946103-4c4d-48b0-8a21-96ea1f551bed None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:28.392160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b946103-4c4d-48b0-8a21-96ea1f551bed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:28.393535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b946103-4c4d-48b0-8a21-96ea1f551bed None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:28.398586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:28.422659 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3aecd-a284-43db-9b80-3702b6c49be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:28.423298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3aecd-a284-43db-9b80-3702b6c49be6 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:28.423583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3aecd-a284-43db-9b80-3702b6c49be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:28.423859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3aecd-a284-43db-9b80-3702b6c49be6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:28.435020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3aecd-a284-43db-9b80-3702b6c49be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-5fd3aecd-a284-43db-9b80-3702b6c49be6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:28.440371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:28.447069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 364/740] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:19:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:28.447917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3aecd-a284-43db-9b80-3702b6c49be6 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:28.466762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 377/741] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:19:28 2022] POST /identity/v3/services => generated 240 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:19:28.467679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946103-4c4d-48b0-8a21-96ea1f551bed None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:28.488574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:28.586447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3aecd-a284-43db-9b80-3702b6c49be6 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:28.595886 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946103-4c4d-48b0-8a21-96ea1f551bed None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:28.628641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065d3f2-149a-45cd-aa96-9458a6f34749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:28.629444 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065d3f2-149a-45cd-aa96-9458a6f34749 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:28.629826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065d3f2-149a-45cd-aa96-9458a6f34749 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:28.630208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065d3f2-149a-45cd-aa96-9458a6f34749 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:28.631700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065d3f2-149a-45cd-aa96-9458a6f34749 None admin] RBAC: Adding query filter params (name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:28.632212 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065d3f2-149a-45cd-aa96-9458a6f34749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:28.633930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065d3f2-149a-45cd-aa96-9458a6f34749 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:28.644194 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 365/742] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:28.644846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2783f9-7ea9-4416-99a2-e83ae8cd56eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:28.644996 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065d3f2-149a-45cd-aa96-9458a6f34749 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:28.645709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2783f9-7ea9-4416-99a2-e83ae8cd56eb None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:28.646015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2783f9-7ea9-4416-99a2-e83ae8cd56eb None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:28.646297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2783f9-7ea9-4416-99a2-e83ae8cd56eb None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:28.647101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2783f9-7ea9-4416-99a2-e83ae8cd56eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:28.647917 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2783f9-7ea9-4416-99a2-e83ae8cd56eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:28.649639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2783f9-7ea9-4416-99a2-e83ae8cd56eb None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:28.664736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 378/743] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:28.665583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2783f9-7ea9-4416-99a2-e83ae8cd56eb None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:28.740183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:28.765747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065d3f2-149a-45cd-aa96-9458a6f34749 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:28.775368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:28.786440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2783f9-7ea9-4416-99a2-e83ae8cd56eb None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:28.809048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a895366-d352-43ac-895b-e03cc77191df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:28.810172 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a895366-d352-43ac-895b-e03cc77191df None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:28.810960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a895366-d352-43ac-895b-e03cc77191df None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:28.811391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a895366-d352-43ac-895b-e03cc77191df None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:28.812422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a895366-d352-43ac-895b-e03cc77191df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:28.812880 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a895366-d352-43ac-895b-e03cc77191df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:28.815074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a895366-d352-43ac-895b-e03cc77191df None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:28.825325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19faa08-a268-4a37-b8db-74a83d6520d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:28.827641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19faa08-a268-4a37-b8db-74a83d6520d2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:28.827641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19faa08-a268-4a37-b8db-74a83d6520d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:28.827641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19faa08-a268-4a37-b8db-74a83d6520d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:28.828291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 366/744] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:28.829291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a895366-d352-43ac-895b-e03cc77191df None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:28.839838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19faa08-a268-4a37-b8db-74a83d6520d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:28.841501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19faa08-a268-4a37-b8db-74a83d6520d2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-c19faa08-a268-4a37-b8db-74a83d6520d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:28.857237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:28.858341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:28.859477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:28.859477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:28.859477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:28.859477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:28.861271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 379/745] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:28.862201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19faa08-a268-4a37-b8db-74a83d6520d2 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:28.969182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a895366-d352-43ac-895b-e03cc77191df None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:28.977093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19faa08-a268-4a37-b8db-74a83d6520d2 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:28.980075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:29.008294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e59944-913d-4a90-95f6-a72a116104ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:29.009269 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e59944-913d-4a90-95f6-a72a116104ff None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:29.009760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e59944-913d-4a90-95f6-a72a116104ff None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:29.010240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e59944-913d-4a90-95f6-a72a116104ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:29.014622 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713591a-698b-4434-b797-3a3549585584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:29.015275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713591a-698b-4434-b797-3a3549585584 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:29.015559 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713591a-698b-4434-b797-3a3549585584 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:29.015841 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713591a-698b-4434-b797-3a3549585584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:29.020375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e59944-913d-4a90-95f6-a72a116104ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:29.022120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e59944-913d-4a90-95f6-a72a116104ff None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:29.027590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713591a-698b-4434-b797-3a3549585584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:29.029049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713591a-698b-4434-b797-3a3549585584 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-d8e59944-913d-4a90-95f6-a72a116104ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:29.035240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:29.036146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:29.037044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:29.037044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:29.037044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:29.037044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:29.037044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:29.037044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:29.037044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:29.037044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-9713591a-698b-4434-b797-3a3549585584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:29.047452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:29.048438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:29.049863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:29.049863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:29.049863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:29.049863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:29.049863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 380/746] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:29.050154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713591a-698b-4434-b797-3a3549585584 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:29.051262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 367/747] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:29.054728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e59944-913d-4a90-95f6-a72a116104ff None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:29.078967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:29.161412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713591a-698b-4434-b797-3a3549585584 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:29.165801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e59944-913d-4a90-95f6-a72a116104ff None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:29.197146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294f1b8-df53-4f2d-99e3-92c70b66fdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:29.197771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294f1b8-df53-4f2d-99e3-92c70b66fdbd None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:29.198055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294f1b8-df53-4f2d-99e3-92c70b66fdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:29.198333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294f1b8-df53-4f2d-99e3-92c70b66fdbd None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:29.199213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294f1b8-df53-4f2d-99e3-92c70b66fdbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:29.199401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294f1b8-df53-4f2d-99e3-92c70b66fdbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:29.200777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294f1b8-df53-4f2d-99e3-92c70b66fdbd None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:29.205492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae6fb7-78bb-40c3-af88-6c5d8ef87d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:29.206362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae6fb7-78bb-40c3-af88-6c5d8ef87d73 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:29.206976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae6fb7-78bb-40c3-af88-6c5d8ef87d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:29.207552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae6fb7-78bb-40c3-af88-6c5d8ef87d73 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:29.208444 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae6fb7-78bb-40c3-af88-6c5d8ef87d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:29.208971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae6fb7-78bb-40c3-af88-6c5d8ef87d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:29.211552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae6fb7-78bb-40c3-af88-6c5d8ef87d73 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:29.213570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 381/748] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:29.214689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294f1b8-df53-4f2d-99e3-92c70b66fdbd None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:29.225749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 368/749] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:29.227097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae6fb7-78bb-40c3-af88-6c5d8ef87d73 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:29.232481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:29.319553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:29.321260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294f1b8-df53-4f2d-99e3-92c70b66fdbd None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:29.338279 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae6fb7-78bb-40c3-af88-6c5d8ef87d73 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:29.364616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab6ca6-fc14-44c3-ad69-f09cc2bf3263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:29.365237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab6ca6-fc14-44c3-ad69-f09cc2bf3263 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:29.365648 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab6ca6-fc14-44c3-ad69-f09cc2bf3263 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:29.365928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab6ca6-fc14-44c3-ad69-f09cc2bf3263 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:29.366703 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab6ca6-fc14-44c3-ad69-f09cc2bf3263 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:29.367010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab6ca6-fc14-44c3-ad69-f09cc2bf3263 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:29.368563 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab6ca6-fc14-44c3-ad69-f09cc2bf3263 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:29.377318 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593da22-912a-43eb-bd94-cead900ea338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:29.378276 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593da22-912a-43eb-bd94-cead900ea338 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:29.378797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593da22-912a-43eb-bd94-cead900ea338 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:29.379314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593da22-912a-43eb-bd94-cead900ea338 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:29.382552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 382/750] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:29.383773 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab6ca6-fc14-44c3-ad69-f09cc2bf3263 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:29.388693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593da22-912a-43eb-bd94-cead900ea338 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:29.390460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593da22-912a-43eb-bd94-cead900ea338 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-f593da22-912a-43eb-bd94-cead900ea338 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:29.404602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:29.405570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:29.406549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:29.406549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:29.406549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:29.406549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:29.406549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:29.406549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:29.406549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:29.406549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:29.406549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:19:29.406549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:29.409110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 369/751] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Aug 4 02:19:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:29.410148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593da22-912a-43eb-bd94-cead900ea338 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:29.472368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:29.497310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab6ca6-fc14-44c3-ad69-f09cc2bf3263 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:29.516701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593da22-912a-43eb-bd94-cead900ea338 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:29.534615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96667a58-d7bd-48c2-9801-d1daeedabc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:29.535411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96667a58-d7bd-48c2-9801-d1daeedabc3c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:29.535636 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96667a58-d7bd-48c2-9801-d1daeedabc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:29.535911 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96667a58-d7bd-48c2-9801-d1daeedabc3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:29.544314 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96667a58-d7bd-48c2-9801-d1daeedabc3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:29.546079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96667a58-d7bd-48c2-9801-d1daeedabc3c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:29.554823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c051e1-89f6-4d8c-b935-9c00765a37c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:29.555718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c051e1-89f6-4d8c-b935-9c00765a37c0 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:29.556208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c051e1-89f6-4d8c-b935-9c00765a37c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:29.556709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c051e1-89f6-4d8c-b935-9c00765a37c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:29.557756 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c051e1-89f6-4d8c-b935-9c00765a37c0 None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=6414c895c6d642a2affb36013b71df34) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:29.558274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c051e1-89f6-4d8c-b935-9c00765a37c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-96667a58-d7bd-48c2-9801-d1daeedabc3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:29.558801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:29.559978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:29.560923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:29.560923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:29.560923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:29.560923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:29.560923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:29.560923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:29.560923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:29.560923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:29.560923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:19:29.560923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:29.563502 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c051e1-89f6-4d8c-b935-9c00765a37c0 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:29.564845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 383/752] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Aug 4 02:19:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:29.565683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96667a58-d7bd-48c2-9801-d1daeedabc3c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:29.566364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:29.572099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 370/753] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:29 2022] GET /identity/v3/role_assignments?user.id=6414c895c6d642a2affb36013b71df34&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:29.573214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c051e1-89f6-4d8c-b935-9c00765a37c0 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:29.684695 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96667a58-d7bd-48c2-9801-d1daeedabc3c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:29.698839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c051e1-89f6-4d8c-b935-9c00765a37c0 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:29.732184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381f519-0389-4f68-896a-668fb418cfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:29.732823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381f519-0389-4f68-896a-668fb418cfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:29.733104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381f519-0389-4f68-896a-668fb418cfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:29.733375 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381f519-0389-4f68-896a-668fb418cfc4 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:29.734185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381f519-0389-4f68-896a-668fb418cfc4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:29.734508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381f519-0389-4f68-896a-668fb418cfc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:29.735998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381f519-0389-4f68-896a-668fb418cfc4 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:29.745686 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:29.773062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03231f71-9a79-412f-b3ee-0c5e9ad15783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:29.773699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03231f71-9a79-412f-b3ee-0c5e9ad15783 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:29.773980 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03231f71-9a79-412f-b3ee-0c5e9ad15783 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:29.774255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03231f71-9a79-412f-b3ee-0c5e9ad15783 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:29.775096 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03231f71-9a79-412f-b3ee-0c5e9ad15783 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:29.775404 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03231f71-9a79-412f-b3ee-0c5e9ad15783 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:29.776881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03231f71-9a79-412f-b3ee-0c5e9ad15783 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:29.782067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 384/754] 10.222.0.60 () {56 vars in 1149 bytes} [Thu Aug 4 02:19:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:29.791609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381f519-0389-4f68-896a-668fb418cfc4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:29.807283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 371/755] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Aug 4 02:19:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:29.812663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03231f71-9a79-412f-b3ee-0c5e9ad15783 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:29.888496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:29.938077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381f519-0389-4f68-896a-668fb418cfc4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:29.953015 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03231f71-9a79-412f-b3ee-0c5e9ad15783 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:29.977340 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eda72-a941-4f9f-8b59-792267651eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:29.978392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eda72-a941-4f9f-8b59-792267651eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:29.979443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eda72-a941-4f9f-8b59-792267651eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:29.979929 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eda72-a941-4f9f-8b59-792267651eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:29.995548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2918676-d4ba-43fc-a6c4-914e7d77fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:29.996175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2918676-d4ba-43fc-a6c4-914e7d77fc26 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:29.996460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2918676-d4ba-43fc-a6c4-914e7d77fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:29.996741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2918676-d4ba-43fc-a6c4-914e7d77fc26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:30.010166 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2918676-d4ba-43fc-a6c4-914e7d77fc26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:30.011853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2918676-d4ba-43fc-a6c4-914e7d77fc26 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-f2918676-d4ba-43fc-a6c4-914e7d77fc26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:30.030853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:30.031901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:30.032824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:30.032824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:30.032824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:30.032824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:30.032824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 372/756] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:30.033578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6062a-3171-447a-9c76-5c35ace31127 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:30.033823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6062a-3171-447a-9c76-5c35ace31127 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:30.034104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6062a-3171-447a-9c76-5c35ace31127 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:30.046513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 373/757] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:30.046513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6062a-3171-447a-9c76-5c35ace31127 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:30.070330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:30.079408 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1eda72-a941-4f9f-8b59-792267651eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:30.081585 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1eda72-a941-4f9f-8b59-792267651eb3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:30.194594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6062a-3171-447a-9c76-5c35ace31127 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:30.199856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:30.201705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 385/758] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:19:30.203169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c60b2-4679-4686-98bd-7c1a68760b95 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:30.203463 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c60b2-4679-4686-98bd-7c1a68760b95 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:30.203743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c60b2-4679-4686-98bd-7c1a68760b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:30.223760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-5b5c60b2-4679-4686-98bd-7c1a68760b95 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:30.225014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5b5c60b2-4679-4686-98bd-7c1a68760b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:30.232099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099ec00-9c5c-48a7-9e70-6693933b1cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:30.233033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099ec00-9c5c-48a7-9e70-6693933b1cca None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:30.234048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099ec00-9c5c-48a7-9e70-6693933b1cca None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:30.235542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099ec00-9c5c-48a7-9e70-6693933b1cca None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:30.236953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099ec00-9c5c-48a7-9e70-6693933b1cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:30.237890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099ec00-9c5c-48a7-9e70-6693933b1cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:30.239824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099ec00-9c5c-48a7-9e70-6693933b1cca None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:30.258516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 374/759] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:30.260424 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099ec00-9c5c-48a7-9e70-6693933b1cca None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:30.304891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 386/760] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:30.305883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c60b2-4679-4686-98bd-7c1a68760b95 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:30.334835 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:30.406930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099ec00-9c5c-48a7-9e70-6693933b1cca None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:30.427074 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c60b2-4679-4686-98bd-7c1a68760b95 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:30.444849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557ce4b-3d8d-465b-9247-6a3741ed36c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:30.445475 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557ce4b-3d8d-465b-9247-6a3741ed36c4 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:30.445803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557ce4b-3d8d-465b-9247-6a3741ed36c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:30.446081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557ce4b-3d8d-465b-9247-6a3741ed36c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:30.457107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557ce4b-3d8d-465b-9247-6a3741ed36c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:30.458693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557ce4b-3d8d-465b-9247-6a3741ed36c4 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-a557ce4b-3d8d-465b-9247-6a3741ed36c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:30.474352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:30.475651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:30.477006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:30.477006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:30.477006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:30.477006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:30.478564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 375/761] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:30.479627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557ce4b-3d8d-465b-9247-6a3741ed36c4 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:30.483265 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58329a-98e8-463b-82e5-6fc1263956af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:30.483934 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58329a-98e8-463b-82e5-6fc1263956af None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:30.484223 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58329a-98e8-463b-82e5-6fc1263956af None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:30.484504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58329a-98e8-463b-82e5-6fc1263956af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:30.492910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58329a-98e8-463b-82e5-6fc1263956af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:30.494379 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58329a-98e8-463b-82e5-6fc1263956af None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-5b58329a-98e8-463b-82e5-6fc1263956af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:30.507174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:30.508115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:30.509609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:30.509609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:30.509609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:30.509609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:30.509609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:30.509609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:30.509609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:30.509609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:30.509609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 387/762] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:30.510119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58329a-98e8-463b-82e5-6fc1263956af None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:30.512132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:30.603870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:30.620482 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557ce4b-3d8d-465b-9247-6a3741ed36c4 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:30.627105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58329a-98e8-463b-82e5-6fc1263956af None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:30.656196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388edfe-d0c6-4adf-85b9-cd3da77c40c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:30.657018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388edfe-d0c6-4adf-85b9-cd3da77c40c5 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:30.657277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388edfe-d0c6-4adf-85b9-cd3da77c40c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:30.657624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388edfe-d0c6-4adf-85b9-cd3da77c40c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:30.658332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388edfe-d0c6-4adf-85b9-cd3da77c40c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:30.659795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388edfe-d0c6-4adf-85b9-cd3da77c40c5 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-b388edfe-d0c6-4adf-85b9-cd3da77c40c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:30.672335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:30.673299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:30.674677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 376/763] 10.222.0.60 () {56 vars in 1129 bytes} [Thu Aug 4 02:19:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:30.676246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd316b3-aa32-49c0-89fc-5e41d1a6fe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:30.676463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388edfe-d0c6-4adf-85b9-cd3da77c40c5 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:30.677183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd316b3-aa32-49c0-89fc-5e41d1a6fe1e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:30.677613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd316b3-aa32-49c0-89fc-5e41d1a6fe1e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:30.678690 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd316b3-aa32-49c0-89fc-5e41d1a6fe1e None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:30.679591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd316b3-aa32-49c0-89fc-5e41d1a6fe1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:30.680066 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd316b3-aa32-49c0-89fc-5e41d1a6fe1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:30.682889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd316b3-aa32-49c0-89fc-5e41d1a6fe1e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:30.702148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 388/764] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:30.703309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd316b3-aa32-49c0-89fc-5e41d1a6fe1e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:30.778918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:30.796211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388edfe-d0c6-4adf-85b9-cd3da77c40c5 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:30.826991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd316b3-aa32-49c0-89fc-5e41d1a6fe1e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:30.833385 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02dfee-0b90-4ee4-9de8-3b90003e33db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:30.834017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02dfee-0b90-4ee4-9de8-3b90003e33db None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:30.834334 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02dfee-0b90-4ee4-9de8-3b90003e33db None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:30.834982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02dfee-0b90-4ee4-9de8-3b90003e33db None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:30.835397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02dfee-0b90-4ee4-9de8-3b90003e33db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:30.835705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02dfee-0b90-4ee4-9de8-3b90003e33db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:30.837168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02dfee-0b90-4ee4-9de8-3b90003e33db None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:30.850265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 377/765] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:30.851642 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02dfee-0b90-4ee4-9de8-3b90003e33db None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:30.869864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba764aa-705d-42da-8959-03c26e3a3c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:30.870735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba764aa-705d-42da-8959-03c26e3a3c41 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:30.871122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba764aa-705d-42da-8959-03c26e3a3c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:30.871466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba764aa-705d-42da-8959-03c26e3a3c41 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:30.872175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba764aa-705d-42da-8959-03c26e3a3c41 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:30.872488 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba764aa-705d-42da-8959-03c26e3a3c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:30.873906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba764aa-705d-42da-8959-03c26e3a3c41 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:30.884304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 389/766] 10.222.0.60 () {56 vars in 1124 bytes} [Thu Aug 4 02:19:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:30.884304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03acde-b4f4-42d8-8abc-3a89fb938aaa None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:30.884304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03acde-b4f4-42d8-8abc-3a89fb938aaa None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:30.884304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03acde-b4f4-42d8-8abc-3a89fb938aaa None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:30.884304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 390/767] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:30.884304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03acde-b4f4-42d8-8abc-3a89fb938aaa None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:30.898772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:30.966851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02dfee-0b90-4ee4-9de8-3b90003e33db None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:30.991902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03acde-b4f4-42d8-8abc-3a89fb938aaa None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:31.004269 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f8b48-d17b-4390-8657-92523c8ae0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:31.004918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f8b48-d17b-4390-8657-92523c8ae0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:31.005206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f8b48-d17b-4390-8657-92523c8ae0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:31.005492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f8b48-d17b-4390-8657-92523c8ae0f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:31.012932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f8b48-d17b-4390-8657-92523c8ae0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:31.014388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f8b48-d17b-4390-8657-92523c8ae0f5 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:31.026097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53003c-0fa2-42a7-832c-585403cabda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-7d3f8b48-d17b-4390-8657-92523c8ae0f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:31.026705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:31.027598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:31.028520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:31.028520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:31.028520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:31.028520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:31.028520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:31.028520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:31.028520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:31.028520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:31.028959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53003c-0fa2-42a7-832c-585403cabda0 None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:31.028959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53003c-0fa2-42a7-832c-585403cabda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:31.028959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53003c-0fa2-42a7-832c-585403cabda0 None admin] PATH_INFO: `/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/c6d95db1228f48669e1985eb74306a25/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:31.030865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53003c-0fa2-42a7-832c-585403cabda0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fae65363f2fb415b834ac367a6c4b7ad, user_id=c6d95db1228f48669e1985eb74306a25, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:31.032543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53003c-0fa2-42a7-832c-585403cabda0 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:31.032712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 378/768] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:31.033524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f8b48-d17b-4390-8657-92523c8ae0f5 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:31.037085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:31.104639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 391/769] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:19:30 2022] PUT /identity/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/c6d95db1228f48669e1985eb74306a25/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:19:31.105928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089262ff-69b3-4e6e-a21c-95655c961dcf None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:31.106219 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089262ff-69b3-4e6e-a21c-95655c961dcf None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:31.106527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089262ff-69b3-4e6e-a21c-95655c961dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:31.141212 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-089262ff-69b3-4e6e-a21c-95655c961dcf None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:31.142596 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-089262ff-69b3-4e6e-a21c-95655c961dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:31.143036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f8b48-d17b-4390-8657-92523c8ae0f5 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:31.192549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8e45f-5681-4ee4-ae6e-3f8dcdca58db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:31.194187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8e45f-5681-4ee4-ae6e-3f8dcdca58db None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:31.194766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8e45f-5681-4ee4-ae6e-3f8dcdca58db None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:31.195304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8e45f-5681-4ee4-ae6e-3f8dcdca58db None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:31.197051 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8e45f-5681-4ee4-ae6e-3f8dcdca58db None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:31.197377 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8e45f-5681-4ee4-ae6e-3f8dcdca58db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:31.198843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8e45f-5681-4ee4-ae6e-3f8dcdca58db None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:31.210669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 379/770] 10.222.0.60 () {56 vars in 1124 bytes} [Thu Aug 4 02:19:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:31.211972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8e45f-5681-4ee4-ae6e-3f8dcdca58db None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:31.234121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:31.240935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 392/771] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:31.242151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089262ff-69b3-4e6e-a21c-95655c961dcf None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:31.311096 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:31.342982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8e45f-5681-4ee4-ae6e-3f8dcdca58db None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:31.374073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089262ff-69b3-4e6e-a21c-95655c961dcf None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:31.380894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf14b87-31e7-4daa-b9c6-9d21abe43ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:31.381856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf14b87-31e7-4daa-b9c6-9d21abe43ebc None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:31.382374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf14b87-31e7-4daa-b9c6-9d21abe43ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:31.382951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf14b87-31e7-4daa-b9c6-9d21abe43ebc None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:31.384016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf14b87-31e7-4daa-b9c6-9d21abe43ebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:31.384576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf14b87-31e7-4daa-b9c6-9d21abe43ebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:31.386315 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf14b87-31e7-4daa-b9c6-9d21abe43ebc None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:31.400198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 380/772] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:31.401417 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf14b87-31e7-4daa-b9c6-9d21abe43ebc None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:31.414694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a3a6-536a-420c-a729-5bc9548df9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:31.415648 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a3a6-536a-420c-a729-5bc9548df9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:31.416127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a3a6-536a-420c-a729-5bc9548df9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:31.416618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a3a6-536a-420c-a729-5bc9548df9d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:31.417638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a3a6-536a-420c-a729-5bc9548df9d4 None admin] RBAC: Adding query filter params (interface=public, service_id=19091383d7f74092a3976e439cf1cd0e, region_id=RegionOne) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:31.418145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a3a6-536a-420c-a729-5bc9548df9d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:31.419772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a3a6-536a-420c-a729-5bc9548df9d4 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:31.429285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 393/773] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Aug 4 02:19:31 2022] GET /identity/v3/endpoints?service_id=19091383d7f74092a3976e439cf1cd0e&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:31.430466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a3a6-536a-420c-a729-5bc9548df9d4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:31.498718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:31.520994 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf14b87-31e7-4daa-b9c6-9d21abe43ebc None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:31.540633 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a3a6-536a-420c-a729-5bc9548df9d4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:31.549717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:31.559798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d76131-c0ac-40d6-9df7-ba5420a822eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:31.560592 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d76131-c0ac-40d6-9df7-ba5420a822eb None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:31.561062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d76131-c0ac-40d6-9df7-ba5420a822eb None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:31.561453 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d76131-c0ac-40d6-9df7-ba5420a822eb None admin] PATH_INFO: `/v3/services/network` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:31.562319 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d76131-c0ac-40d6-9df7-ba5420a822eb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:31.563816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d76131-c0ac-40d6-9df7-ba5420a822eb None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-e9d76131-c0ac-40d6-9df7-ba5420a822eb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:31.575045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:31.576241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:19:31.577278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:31.585854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 381/774] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:31 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:31.585854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d76131-c0ac-40d6-9df7-ba5420a822eb None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:31.594426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a61140-5386-49ca-82d7-d41d573ce056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:31.595482 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a61140-5386-49ca-82d7-d41d573ce056 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:31.596156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a61140-5386-49ca-82d7-d41d573ce056 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:31.596644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a61140-5386-49ca-82d7-d41d573ce056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:31.597738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a61140-5386-49ca-82d7-d41d573ce056 None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=fb334753d1f34e41a450961dfb5f2075) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:31.598281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a61140-5386-49ca-82d7-d41d573ce056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:31.600338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a61140-5386-49ca-82d7-d41d573ce056 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:31.607054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 394/775] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:31 2022] GET /identity/v3/role_assignments?user.id=fb334753d1f34e41a450961dfb5f2075&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:31.608146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a61140-5386-49ca-82d7-d41d573ce056 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:31.741848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a61140-5386-49ca-82d7-d41d573ce056 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:31.774949 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:31.786729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443796fd-cdbe-43ba-b1bb-632b11d4dccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:31.788007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443796fd-cdbe-43ba-b1bb-632b11d4dccb None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:31.788304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443796fd-cdbe-43ba-b1bb-632b11d4dccb None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:31.788586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443796fd-cdbe-43ba-b1bb-632b11d4dccb None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:31.789290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443796fd-cdbe-43ba-b1bb-632b11d4dccb None admin] RBAC: Adding query filter params (name=network) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:31.789602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443796fd-cdbe-43ba-b1bb-632b11d4dccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:31.791053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443796fd-cdbe-43ba-b1bb-632b11d4dccb None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:31.802507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 395/776] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:19:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:31.809790 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443796fd-cdbe-43ba-b1bb-632b11d4dccb None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:31.831074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d76131-c0ac-40d6-9df7-ba5420a822eb None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:31.876990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535a864-e66e-4c44-8616-284c348850b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:31.877628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535a864-e66e-4c44-8616-284c348850b5 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:31.877915 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535a864-e66e-4c44-8616-284c348850b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:31.878197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535a864-e66e-4c44-8616-284c348850b5 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:31.879056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535a864-e66e-4c44-8616-284c348850b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:31.881875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535a864-e66e-4c44-8616-284c348850b5 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:31.889349 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 382/777] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Aug 4 02:19:31 2022] GET /identity/v3/services => generated 772 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:31.890886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ee54-716d-4e8d-9572-f316e69a3f0d None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:31.891184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ee54-716d-4e8d-9572-f316e69a3f0d None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:31.891621 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ee54-716d-4e8d-9572-f316e69a3f0d None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:31.898876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 383/778] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:31.905097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28481b73-eda5-4df3-a4c0-d826bbe6fed8 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:31.905419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28481b73-eda5-4df3-a4c0-d826bbe6fed8 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:31.905681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28481b73-eda5-4df3-a4c0-d826bbe6fed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:31.930553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-28481b73-eda5-4df3-a4c0-d826bbe6fed8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:31.931161 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-28481b73-eda5-4df3-a4c0-d826bbe6fed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:31.945965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443796fd-cdbe-43ba-b1bb-632b11d4dccb None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:31.998938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:32.015805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 384/779] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:32.054144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28481b73-eda5-4df3-a4c0-d826bbe6fed8 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:32.054621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9222e-ade6-49c3-a1df-18c55861930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:32.055484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9222e-ade6-49c3-a1df-18c55861930d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:32.055915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9222e-ade6-49c3-a1df-18c55861930d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:32.056443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9222e-ade6-49c3-a1df-18c55861930d None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:32.057276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9222e-ade6-49c3-a1df-18c55861930d None admin] RBAC: Adding query filter params (type=network) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:32.057778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9222e-ade6-49c3-a1df-18c55861930d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:32.059576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9222e-ade6-49c3-a1df-18c55861930d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:32.078450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 396/780] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:19:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:32.097596 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9222e-ade6-49c3-a1df-18c55861930d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:32.181317 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:32.190318 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28481b73-eda5-4df3-a4c0-d826bbe6fed8 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:32.230797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457a733-c8f9-4bce-865a-10c7900525bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:32.232106 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a733-c8f9-4bce-865a-10c7900525bb None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:32.232565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a733-c8f9-4bce-865a-10c7900525bb None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:32.232999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a733-c8f9-4bce-865a-10c7900525bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:32.241426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9222e-ade6-49c3-a1df-18c55861930d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:32.245984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457a733-c8f9-4bce-865a-10c7900525bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-4457a733-c8f9-4bce-865a-10c7900525bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:32.251206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:32.252273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:32.253130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:32.253130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:32.253130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:32.253130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:32.253130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:32.253130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:32.253130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:32.253130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:32.253130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:32.253130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:32.253130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:19:32.253130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:32.256560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 385/781] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:19:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:32.262645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457a733-c8f9-4bce-865a-10c7900525bb None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:32.281598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23074f8d-caef-482c-b6f7-d1852ee6aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:32.282237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23074f8d-caef-482c-b6f7-d1852ee6aa79 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:32.282570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23074f8d-caef-482c-b6f7-d1852ee6aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:32.282859 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23074f8d-caef-482c-b6f7-d1852ee6aa79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:32.284230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23074f8d-caef-482c-b6f7-d1852ee6aa79 None admin] RBAC: Adding query filter params (interface=public, service_id=a2437ed606f748119616e2610b89c252, region_id=RegionOne) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:32.284557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23074f8d-caef-482c-b6f7-d1852ee6aa79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:32.285943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23074f8d-caef-482c-b6f7-d1852ee6aa79 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:32.294692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 397/782] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Aug 4 02:19:32 2022] GET /identity/v3/endpoints?service_id=a2437ed606f748119616e2610b89c252&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:32.297933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23074f8d-caef-482c-b6f7-d1852ee6aa79 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:32.318336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:32.415982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457a733-c8f9-4bce-865a-10c7900525bb None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:32.477951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23074f8d-caef-482c-b6f7-d1852ee6aa79 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:32.484166 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf1647-fe27-4b5d-9193-c6a3854c29c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:32.485083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1647-fe27-4b5d-9193-c6a3854c29c0 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:32.485569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1647-fe27-4b5d-9193-c6a3854c29c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:32.486042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1647-fe27-4b5d-9193-c6a3854c29c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:32.486994 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf1647-fe27-4b5d-9193-c6a3854c29c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:32.487609 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf1647-fe27-4b5d-9193-c6a3854c29c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:32.489214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf1647-fe27-4b5d-9193-c6a3854c29c0 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:32.505380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 386/783] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:32.511291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf1647-fe27-4b5d-9193-c6a3854c29c0 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:32.523052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:32.554386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b5df-4906-4d87-856d-2fd584260708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:32.558994 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b5df-4906-4d87-856d-2fd584260708 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:32.559532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b5df-4906-4d87-856d-2fd584260708 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:32.559811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b5df-4906-4d87-856d-2fd584260708 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:32.560469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245b5df-4906-4d87-856d-2fd584260708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:32.562132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245b5df-4906-4d87-856d-2fd584260708 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:32.570203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 398/784] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Aug 4 02:19:32 2022] GET /identity/v3/services => generated 772 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:32.644066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf1647-fe27-4b5d-9193-c6a3854c29c0 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:32.659213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:32.697038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b2beb-a188-46f8-8339-8edd5f5e50c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:32.697750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b2beb-a188-46f8-8339-8edd5f5e50c0 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:32.698034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b2beb-a188-46f8-8339-8edd5f5e50c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:32.698307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b2beb-a188-46f8-8339-8edd5f5e50c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:32.717114 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b2beb-a188-46f8-8339-8edd5f5e50c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:32.718636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b2beb-a188-46f8-8339-8edd5f5e50c0 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-7c6b2beb-a188-46f8-8339-8edd5f5e50c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:32.741674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:32.742703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:32.743616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:32.743616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:32.743616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:32.743616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:32.743616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 387/785] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:32.749106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b5df-4906-4d87-856d-2fd584260708 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:32.869723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b5df-4906-4d87-856d-2fd584260708 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:32.908263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a40f3c-29b7-462d-a0f3-562127c9aa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:32.909345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40f3c-29b7-462d-a0f3-562127c9aa92 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:32.909843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40f3c-29b7-462d-a0f3-562127c9aa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:32.910371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40f3c-29b7-462d-a0f3-562127c9aa92 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:32.911298 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a40f3c-29b7-462d-a0f3-562127c9aa92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:32.911821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a40f3c-29b7-462d-a0f3-562127c9aa92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:32.913935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a40f3c-29b7-462d-a0f3-562127c9aa92 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:32.927309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 399/786] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:32.933491 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b2beb-a188-46f8-8339-8edd5f5e50c0 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:33.048696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b2beb-a188-46f8-8339-8edd5f5e50c0 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:33.084568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ffbb1-7731-4d3d-82bc-13b578c18e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:33.085215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ffbb1-7731-4d3d-82bc-13b578c18e15 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:33.085502 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ffbb1-7731-4d3d-82bc-13b578c18e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:33.085778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ffbb1-7731-4d3d-82bc-13b578c18e15 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:33.093591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ffbb1-7731-4d3d-82bc-13b578c18e15 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:33.095221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ffbb1-7731-4d3d-82bc-13b578c18e15 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-a14ffbb1-7731-4d3d-82bc-13b578c18e15 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:33.108039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:33.109023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:33.109990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:33.109990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:33.109990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:33.109990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:33.109990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:33.109990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:33.109990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:33.109990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:33.109990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:19:33.109990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:33.109990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 388/787] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:19:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:33.114842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a40f3c-29b7-462d-a0f3-562127c9aa92 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:33.183992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:33.245087 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a40f3c-29b7-462d-a0f3-562127c9aa92 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:33.286736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af941478-6913-464e-b6bd-c79693cc9939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:33.287819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af941478-6913-464e-b6bd-c79693cc9939 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:33.288343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af941478-6913-464e-b6bd-c79693cc9939 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:33.288892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af941478-6913-464e-b6bd-c79693cc9939 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:33.289965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af941478-6913-464e-b6bd-c79693cc9939 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:33.290512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af941478-6913-464e-b6bd-c79693cc9939 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:33.292312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af941478-6913-464e-b6bd-c79693cc9939 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:33.315538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 400/788] 10.222.0.60 () {56 vars in 1135 bytes} [Thu Aug 4 02:19:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:33.327581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ffbb1-7731-4d3d-82bc-13b578c18e15 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:33.356077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:33.442843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b9f74-20be-4b3e-9857-cc878f24f0f0 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:33.443240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b9f74-20be-4b3e-9857-cc878f24f0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:33.444167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b9f74-20be-4b3e-9857-cc878f24f0f0 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:33.445655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 401/789] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:33.456727 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582ddd6-6e25-4d87-a9e1-028f3a17fd1f None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:33.457011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582ddd6-6e25-4d87-a9e1-028f3a17fd1f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:33.457285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582ddd6-6e25-4d87-a9e1-028f3a17fd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:33.465842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ffbb1-7731-4d3d-82bc-13b578c18e15 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:33.502883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08003fcd-2673-40b5-a514-1ec0bf5535c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:33.503780 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f582ddd6-6e25-4d87-a9e1-028f3a17fd1f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:33.504187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08003fcd-2673-40b5-a514-1ec0bf5535c9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:33.504679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08003fcd-2673-40b5-a514-1ec0bf5535c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:33.505026 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f582ddd6-6e25-4d87-a9e1-028f3a17fd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:33.505489 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08003fcd-2673-40b5-a514-1ec0bf5535c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:33.517818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08003fcd-2673-40b5-a514-1ec0bf5535c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:33.519674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08003fcd-2673-40b5-a514-1ec0bf5535c9 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-08003fcd-2673-40b5-a514-1ec0bf5535c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:33.548186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:33.549142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:33.550022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:33.550022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:33.550022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:33.550022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:33.560342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 389/790] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:33.566521 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08003fcd-2673-40b5-a514-1ec0bf5535c9 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:33.586319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 402/791] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:33.610426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582ddd6-6e25-4d87-a9e1-028f3a17fd1f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:33.644288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:33.668448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:33.703155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08003fcd-2673-40b5-a514-1ec0bf5535c9 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:33.741726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2b333-6d92-42d6-8c76-6ae4d5279e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:33.742852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2b333-6d92-42d6-8c76-6ae4d5279e87 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:33.743366 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2b333-6d92-42d6-8c76-6ae4d5279e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:33.744103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2b333-6d92-42d6-8c76-6ae4d5279e87 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:33.745013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2b333-6d92-42d6-8c76-6ae4d5279e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:33.745538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2b333-6d92-42d6-8c76-6ae4d5279e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:33.747156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2b333-6d92-42d6-8c76-6ae4d5279e87 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:33.762197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 390/792] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:33.767978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2b333-6d92-42d6-8c76-6ae4d5279e87 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:33.820096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582ddd6-6e25-4d87-a9e1-028f3a17fd1f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:33.885574 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a1ecf-b9c7-48ba-bd6e-6848b9ab5c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:33.886478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a1ecf-b9c7-48ba-bd6e-6848b9ab5c21 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:33.886780 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a1ecf-b9c7-48ba-bd6e-6848b9ab5c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:33.887058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a1ecf-b9c7-48ba-bd6e-6848b9ab5c21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:33.908070 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a1ecf-b9c7-48ba-bd6e-6848b9ab5c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-4b9a1ecf-b9c7-48ba-bd6e-6848b9ab5c21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:33.914607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:33.915541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:33.916372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 403/793] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:19:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:33.921814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a1ecf-b9c7-48ba-bd6e-6848b9ab5c21 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:33.962328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2b333-6d92-42d6-8c76-6ae4d5279e87 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:34.015686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:34.024038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17da9d-d3ea-4ce4-bf95-d5cca73c313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:34.025402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17da9d-d3ea-4ce4-bf95-d5cca73c313c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.025693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17da9d-d3ea-4ce4-bf95-d5cca73c313c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.025968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17da9d-d3ea-4ce4-bf95-d5cca73c313c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.035826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17da9d-d3ea-4ce4-bf95-d5cca73c313c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:34.037793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17da9d-d3ea-4ce4-bf95-d5cca73c313c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-cd17da9d-d3ea-4ce4-bf95-d5cca73c313c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:34.050852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:34.051814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:34.053317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:34.053317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:34.053317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:34.053317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:34.053317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:34.053317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:34.053317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:34.053317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:34.053317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 391/794] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:34.060601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9d467-5827-4198-8baf-248c80e7b07b None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.060601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9d467-5827-4198-8baf-248c80e7b07b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.060601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9d467-5827-4198-8baf-248c80e7b07b None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.060601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 392/795] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:34.060601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9d467-5827-4198-8baf-248c80e7b07b None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:34.091290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:34.102262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a1ecf-b9c7-48ba-bd6e-6848b9ab5c21 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:34.149496 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618ad37-751b-4e2f-a226-fda77b21694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:34.150416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618ad37-751b-4e2f-a226-fda77b21694d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.150900 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618ad37-751b-4e2f-a226-fda77b21694d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.151372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618ad37-751b-4e2f-a226-fda77b21694d None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.152311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618ad37-751b-4e2f-a226-fda77b21694d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:34.152856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618ad37-751b-4e2f-a226-fda77b21694d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:34.154401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618ad37-751b-4e2f-a226-fda77b21694d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:34.164818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 404/796] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:34.166451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857936db-95a7-4fa2-85c9-29e9e80ca7bc None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.166982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857936db-95a7-4fa2-85c9-29e9e80ca7bc None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.167454 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857936db-95a7-4fa2-85c9-29e9e80ca7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.188261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-857936db-95a7-4fa2-85c9-29e9e80ca7bc None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:34.189843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-857936db-95a7-4fa2-85c9-29e9e80ca7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:34.195723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9d467-5827-4198-8baf-248c80e7b07b None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:34.245967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141fb56-b2b9-4acb-bc10-c33ba83b6688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:34.247222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141fb56-b2b9-4acb-bc10-c33ba83b6688 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.247222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141fb56-b2b9-4acb-bc10-c33ba83b6688 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.254530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141fb56-b2b9-4acb-bc10-c33ba83b6688 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.254530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141fb56-b2b9-4acb-bc10-c33ba83b6688 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:34.254530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141fb56-b2b9-4acb-bc10-c33ba83b6688 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:34.254530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141fb56-b2b9-4acb-bc10-c33ba83b6688 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:34.267889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 393/797] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:34.268845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141fb56-b2b9-4acb-bc10-c33ba83b6688 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:34.274799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 405/798] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:34.275777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857936db-95a7-4fa2-85c9-29e9e80ca7bc None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:34.337415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:34.392607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:34.405169 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141fb56-b2b9-4acb-bc10-c33ba83b6688 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:34.412944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857936db-95a7-4fa2-85c9-29e9e80ca7bc None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:34.451244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd13660-496c-4d12-ace3-0e15b060a531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:34.452075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd13660-496c-4d12-ace3-0e15b060a531 None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.452362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd13660-496c-4d12-ace3-0e15b060a531 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.452554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63e493-6c7b-4b02-80ef-3b89053392d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:34.452739 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd13660-496c-4d12-ace3-0e15b060a531 None admin] PATH_INFO: `/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/6414c895c6d642a2affb36013b71df34/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.453202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63e493-6c7b-4b02-80ef-3b89053392d7 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.453583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63e493-6c7b-4b02-80ef-3b89053392d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.453902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63e493-6c7b-4b02-80ef-3b89053392d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.454824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd13660-496c-4d12-ace3-0e15b060a531 None admin] RBAC: Authorizing `identity:create_grant(project_id=fae65363f2fb415b834ac367a6c4b7ad, user_id=6414c895c6d642a2affb36013b71df34, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:34.456358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd13660-496c-4d12-ace3-0e15b060a531 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:34.465952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63e493-6c7b-4b02-80ef-3b89053392d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:34.467417 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63e493-6c7b-4b02-80ef-3b89053392d7 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-3b63e493-6c7b-4b02-80ef-3b89053392d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:34.483643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:34.484601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:34.485483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:34.485483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:34.485483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:34.485483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:34.485483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 394/799] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:34.485846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63e493-6c7b-4b02-80ef-3b89053392d7 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:34.514548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 406/800] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:19:34 2022] PUT /identity/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/6414c895c6d642a2affb36013b71df34/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:19:34.515885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8faf5-c07d-4b8d-a0cf-2f9ac8fd4a47 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.516179 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8faf5-c07d-4b8d-a0cf-2f9ac8fd4a47 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.516458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8faf5-c07d-4b8d-a0cf-2f9ac8fd4a47 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.517741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 407/801] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:34.518640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8faf5-c07d-4b8d-a0cf-2f9ac8fd4a47 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:34.625895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63e493-6c7b-4b02-80ef-3b89053392d7 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:34.630452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:34.660018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8faf5-c07d-4b8d-a0cf-2f9ac8fd4a47 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:34.671197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12abd6-bbfc-453a-90a4-0e33ae0ee49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:34.672283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12abd6-bbfc-453a-90a4-0e33ae0ee49c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.672398 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12abd6-bbfc-453a-90a4-0e33ae0ee49c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.672630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12abd6-bbfc-453a-90a4-0e33ae0ee49c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.686278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12abd6-bbfc-453a-90a4-0e33ae0ee49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-fa12abd6-bbfc-453a-90a4-0e33ae0ee49c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:34.691615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:34.692539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:34.694119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 395/802] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:34.694955 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3932ff6-b0d1-41f2-8329-b4d46686d2d1 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.695517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3932ff6-b0d1-41f2-8329-b4d46686d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.695517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3932ff6-b0d1-41f2-8329-b4d46686d2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.716918 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacae040-18d1-40f0-b51a-9e19fb452da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:34.717920 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacae040-18d1-40f0-b51a-9e19fb452da3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.718630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacae040-18d1-40f0-b51a-9e19fb452da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.719139 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacae040-18d1-40f0-b51a-9e19fb452da3 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.719362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b3932ff6-b0d1-41f2-8329-b4d46686d2d1 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:34.720261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacae040-18d1-40f0-b51a-9e19fb452da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:34.720631 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b3932ff6-b0d1-41f2-8329-b4d46686d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:34.720999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacae040-18d1-40f0-b51a-9e19fb452da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:34.722847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacae040-18d1-40f0-b51a-9e19fb452da3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:34.738818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 408/803] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:34.740047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacae040-18d1-40f0-b51a-9e19fb452da3 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:34.744857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:34.814586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 396/804] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:34.814586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3932ff6-b0d1-41f2-8329-b4d46686d2d1 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:34.874342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacae040-18d1-40f0-b51a-9e19fb452da3 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:34.912824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c915e9f-fcc7-4a22-9d9a-fa1ec86477ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:34.914288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c915e9f-fcc7-4a22-9d9a-fa1ec86477ca None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.915039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c915e9f-fcc7-4a22-9d9a-fa1ec86477ca None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.915503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c915e9f-fcc7-4a22-9d9a-fa1ec86477ca None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.916593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c915e9f-fcc7-4a22-9d9a-fa1ec86477ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:34.917384 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c915e9f-fcc7-4a22-9d9a-fa1ec86477ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:34.919091 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c915e9f-fcc7-4a22-9d9a-fa1ec86477ca None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:34.927003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:34.931926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 409/805] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:34.933133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c915e9f-fcc7-4a22-9d9a-fa1ec86477ca None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:34.938856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3932ff6-b0d1-41f2-8329-b4d46686d2d1 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:34.978416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23bd1-c287-4db4-9386-8e24e8637b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:34.979541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23bd1-c287-4db4-9386-8e24e8637b30 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:34.980018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23bd1-c287-4db4-9386-8e24e8637b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:34.980533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23bd1-c287-4db4-9386-8e24e8637b30 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:34.989620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c23bd1-c287-4db4-9386-8e24e8637b30 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:34.992190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c23bd1-c287-4db4-9386-8e24e8637b30 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-51c23bd1-c287-4db4-9386-8e24e8637b30 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:35.006671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:35.007712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:35.008681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:35.008681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:35.008681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:35.008681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:35.008681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:35.008681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:35.008681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:35.008681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:35.008681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:19:35.008681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:35.015900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 397/806] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Aug 4 02:19:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:35.017004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23bd1-c287-4db4-9386-8e24e8637b30 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:35.018772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:35.056931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c915e9f-fcc7-4a22-9d9a-fa1ec86477ca None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:35.096300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd591a3-36cc-4759-b5fb-bce3ce8bed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:35.097348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd591a3-36cc-4759-b5fb-bce3ce8bed0c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:35.097785 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd591a3-36cc-4759-b5fb-bce3ce8bed0c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:35.098223 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd591a3-36cc-4759-b5fb-bce3ce8bed0c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:35.099043 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd591a3-36cc-4759-b5fb-bce3ce8bed0c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:35.101644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd591a3-36cc-4759-b5fb-bce3ce8bed0c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-8bd591a3-36cc-4759-b5fb-bce3ce8bed0c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:35.112390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:35.113378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:19:35.114231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:35.119317 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 410/807] 10.222.0.60 () {56 vars in 1129 bytes} [Thu Aug 4 02:19:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:35.120259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd591a3-36cc-4759-b5fb-bce3ce8bed0c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:35.155356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23bd1-c287-4db4-9386-8e24e8637b30 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:35.199203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bda17f-7322-42b1-b6c8-803026aacf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:35.199849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bda17f-7322-42b1-b6c8-803026aacf2d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:35.200137 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bda17f-7322-42b1-b6c8-803026aacf2d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:35.200413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bda17f-7322-42b1-b6c8-803026aacf2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:35.212664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bda17f-7322-42b1-b6c8-803026aacf2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:35.214129 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bda17f-7322-42b1-b6c8-803026aacf2d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-17bda17f-7322-42b1-b6c8-803026aacf2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:35.229499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:35.230456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:35.231370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:35.231370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:35.231370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:35.231370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:35.231370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 398/808] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:35.232081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bda17f-7322-42b1-b6c8-803026aacf2d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:35.237837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd591a3-36cc-4759-b5fb-bce3ce8bed0c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:35.242143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:35.268619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:35.275838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fabd4-cf12-4c56-a950-842531243448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:35.276467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fabd4-cf12-4c56-a950-842531243448 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:35.276755 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fabd4-cf12-4c56-a950-842531243448 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:35.277123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fabd4-cf12-4c56-a950-842531243448 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:35.277832 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fabd4-cf12-4c56-a950-842531243448 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:35.278144 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fabd4-cf12-4c56-a950-842531243448 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:35.279630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fabd4-cf12-4c56-a950-842531243448 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:35.297950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 411/809] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Aug 4 02:19:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:35.298823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fabd4-cf12-4c56-a950-842531243448 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:35.345029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bda17f-7322-42b1-b6c8-803026aacf2d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:35.385680 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc00b9f-ffd6-48fb-8a83-fd131f5722b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:35.386270 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00b9f-ffd6-48fb-8a83-fd131f5722b3 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:35.386518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00b9f-ffd6-48fb-8a83-fd131f5722b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:35.386859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00b9f-ffd6-48fb-8a83-fd131f5722b3 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:35.387547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc00b9f-ffd6-48fb-8a83-fd131f5722b3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:35.387857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc00b9f-ffd6-48fb-8a83-fd131f5722b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:35.389239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc00b9f-ffd6-48fb-8a83-fd131f5722b3 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:35.394515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 399/810] 10.222.0.60 () {56 vars in 1124 bytes} [Thu Aug 4 02:19:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:35.395501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7116da-15cd-41ef-ad47-2a464927b8ab None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:35.395793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7116da-15cd-41ef-ad47-2a464927b8ab None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:35.396075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7116da-15cd-41ef-ad47-2a464927b8ab None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:35.398609 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 400/811] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:35.398609 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7116da-15cd-41ef-ad47-2a464927b8ab None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:35.411443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fabd4-cf12-4c56-a950-842531243448 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:35.450015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275735d-2b75-4a5a-90df-0d3b8a900a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:35.450664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275735d-2b75-4a5a-90df-0d3b8a900a3f None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:35.450953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275735d-2b75-4a5a-90df-0d3b8a900a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:35.451232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275735d-2b75-4a5a-90df-0d3b8a900a3f None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:35.451927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275735d-2b75-4a5a-90df-0d3b8a900a3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:35.452239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275735d-2b75-4a5a-90df-0d3b8a900a3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:35.453646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275735d-2b75-4a5a-90df-0d3b8a900a3f None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:35.470568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 412/812] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:35.470568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275735d-2b75-4a5a-90df-0d3b8a900a3f None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:35.479485 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:35.512924 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7116da-15cd-41ef-ad47-2a464927b8ab None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:35.520799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:35.548750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a518b-3caa-4eaa-b46b-621d577829fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:35.549345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a518b-3caa-4eaa-b46b-621d577829fa None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:35.549632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a518b-3caa-4eaa-b46b-621d577829fa None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:35.549913 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a518b-3caa-4eaa-b46b-621d577829fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:35.582131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275735d-2b75-4a5a-90df-0d3b8a900a3f None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:35.619070 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c595e-999a-429f-a252-e0392c37151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:35.619692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c595e-999a-429f-a252-e0392c37151e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:35.619972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c595e-999a-429f-a252-e0392c37151e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:35.620247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c595e-999a-429f-a252-e0392c37151e None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:35.620913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c595e-999a-429f-a252-e0392c37151e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:35.621213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c595e-999a-429f-a252-e0392c37151e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:35.622605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c595e-999a-429f-a252-e0392c37151e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:35.623073 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a518b-3caa-4eaa-b46b-621d577829fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:35.624631 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a518b-3caa-4eaa-b46b-621d577829fa None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:35.627586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 413/813] 10.222.0.60 () {56 vars in 1124 bytes} [Thu Aug 4 02:19:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:35.628956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc40e-76b5-4c61-ad3a-fb5510f2008b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:35.629439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc40e-76b5-4c61-ad3a-fb5510f2008b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:35.629890 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bc40e-76b5-4c61-ad3a-fb5510f2008b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:35.649469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-a65bc40e-76b5-4c61-ad3a-fb5510f2008b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:35.650887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a65bc40e-76b5-4c61-ad3a-fb5510f2008b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:35.702304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:35.731312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 414/814] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:35.732172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bc40e-76b5-4c61-ad3a-fb5510f2008b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:35.745889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 401/815] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:19:35.746798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a518b-3caa-4eaa-b46b-621d577829fa None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:35.791216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:35.853559 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bc40e-76b5-4c61-ad3a-fb5510f2008b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:35.860618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a518b-3caa-4eaa-b46b-621d577829fa None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:35.889619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a57d8-77f5-43e6-be29-b54dd22fd7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:35.890264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a57d8-77f5-43e6-be29-b54dd22fd7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:35.890580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a57d8-77f5-43e6-be29-b54dd22fd7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:35.890866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a57d8-77f5-43e6-be29-b54dd22fd7a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:35.898372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a57d8-77f5-43e6-be29-b54dd22fd7a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:35.898684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4e45d-91f8-40ff-939b-b3bf526a773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:35.899549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4e45d-91f8-40ff-939b-b3bf526a773c None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:35.899849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a57d8-77f5-43e6-be29-b54dd22fd7a2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:35.900306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4e45d-91f8-40ff-939b-b3bf526a773c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:35.900819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4e45d-91f8-40ff-939b-b3bf526a773c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:35.901709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4e45d-91f8-40ff-939b-b3bf526a773c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:35.903273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4e45d-91f8-40ff-939b-b3bf526a773c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-fd3a57d8-77f5-43e6-be29-b54dd22fd7a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:35.911578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:35.913548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:35.914507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:35.914507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:35.914507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:35.914507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:35.914507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:35.914507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:35.914507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:35.914507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:35.914507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:19:35.914507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:35.914507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 415/816] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Aug 4 02:19:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:35.914507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a57d8-77f5-43e6-be29-b54dd22fd7a2 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:36.013560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 402/817] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:19:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:19:36.014767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4e45d-91f8-40ff-939b-b3bf526a773c None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:36.023815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:36.027622 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a57d8-77f5-43e6-be29-b54dd22fd7a2 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:36.068670 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:36.085340 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef087ff-dee1-458c-ba83-4b6b8ad71e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:36.088904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef087ff-dee1-458c-ba83-4b6b8ad71e5f None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:36.089248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef087ff-dee1-458c-ba83-4b6b8ad71e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:36.089514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef087ff-dee1-458c-ba83-4b6b8ad71e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:36.104135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef087ff-dee1-458c-ba83-4b6b8ad71e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:36.105546 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef087ff-dee1-458c-ba83-4b6b8ad71e5f None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-1ef087ff-dee1-458c-ba83-4b6b8ad71e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:36.123052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:36.124041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:36.124946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:36.124946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:36.124946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:36.124946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:36.129142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 416/818] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:36.130115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef087ff-dee1-458c-ba83-4b6b8ad71e5f None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:36.168528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4e45d-91f8-40ff-939b-b3bf526a773c None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:36.213653 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f296c-c1c3-4975-be4e-a72de4e212ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:36.214299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f296c-c1c3-4975-be4e-a72de4e212ea None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:36.214626 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f296c-c1c3-4975-be4e-a72de4e212ea None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:36.214903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f296c-c1c3-4975-be4e-a72de4e212ea None admin] PATH_INFO: `/v3/services/network` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:36.215530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f296c-c1c3-4975-be4e-a72de4e212ea None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:36.216913 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f296c-c1c3-4975-be4e-a72de4e212ea None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-810f296c-c1c3-4975-be4e-a72de4e212ea None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:36.228675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:36.230238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:36.231115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 403/819] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:36 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:36.231979 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f296c-c1c3-4975-be4e-a72de4e212ea None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:36.265248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef087ff-dee1-458c-ba83-4b6b8ad71e5f None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:36.318968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948104a1-b30e-4d6c-be25-a5522a96d387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:36.320070 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948104a1-b30e-4d6c-be25-a5522a96d387 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:36.320595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948104a1-b30e-4d6c-be25-a5522a96d387 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:36.321051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948104a1-b30e-4d6c-be25-a5522a96d387 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:36.322029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948104a1-b30e-4d6c-be25-a5522a96d387 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:36.322536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948104a1-b30e-4d6c-be25-a5522a96d387 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:36.324746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948104a1-b30e-4d6c-be25-a5522a96d387 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:36.344923 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:36.347304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 417/820] 10.222.0.60 () {56 vars in 1149 bytes} [Thu Aug 4 02:19:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:36.348138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948104a1-b30e-4d6c-be25-a5522a96d387 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:36.357800 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:36.358110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f296c-c1c3-4975-be4e-a72de4e212ea None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:36.399388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9bbc6-e67e-43f9-abaa-483015acf5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:36.399946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9bbc6-e67e-43f9-abaa-483015acf5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:36.400231 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9bbc6-e67e-43f9-abaa-483015acf5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:36.400507 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9bbc6-e67e-43f9-abaa-483015acf5e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:36.401279 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9bbc6-e67e-43f9-abaa-483015acf5e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:36.401590 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9bbc6-e67e-43f9-abaa-483015acf5e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:36.403530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9bbc6-e67e-43f9-abaa-483015acf5e6 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:36.416237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 404/821] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:36.417288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9bbc6-e67e-43f9-abaa-483015acf5e6 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:36.484282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948104a1-b30e-4d6c-be25-a5522a96d387 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:36.526772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9bbc6-e67e-43f9-abaa-483015acf5e6 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:36.531825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea63c14-00ff-429c-a4bd-8347c0e446a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:36.532629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea63c14-00ff-429c-a4bd-8347c0e446a8 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:36.533062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea63c14-00ff-429c-a4bd-8347c0e446a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:36.533482 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea63c14-00ff-429c-a4bd-8347c0e446a8 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:36.534332 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea63c14-00ff-429c-a4bd-8347c0e446a8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:36.534809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea63c14-00ff-429c-a4bd-8347c0e446a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:36.536928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea63c14-00ff-429c-a4bd-8347c0e446a8 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:36.544786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 418/822] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:19:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:36.545837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea63c14-00ff-429c-a4bd-8347c0e446a8 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:36.570722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d53069-7277-479c-ad58-1d9b6ffa68ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:36.571696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d53069-7277-479c-ad58-1d9b6ffa68ea None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:36.572085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d53069-7277-479c-ad58-1d9b6ffa68ea None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:36.572466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d53069-7277-479c-ad58-1d9b6ffa68ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:36.584529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d53069-7277-479c-ad58-1d9b6ffa68ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:36.585883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d53069-7277-479c-ad58-1d9b6ffa68ea None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-87d53069-7277-479c-ad58-1d9b6ffa68ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:36.602789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:36.603901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:36.604993 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:36.604993 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:36.604993 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:36.604993 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:36.610859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 405/823] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:36.611828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d53069-7277-479c-ad58-1d9b6ffa68ea None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:36.617155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:36.634900 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:36.668053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea63c14-00ff-429c-a4bd-8347c0e446a8 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:36.703150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a423165-2d62-4b36-9f44-98b00ff9e3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:36.703732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a423165-2d62-4b36-9f44-98b00ff9e3ff None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:36.704011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a423165-2d62-4b36-9f44-98b00ff9e3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:36.704400 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a423165-2d62-4b36-9f44-98b00ff9e3ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:36.711663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a423165-2d62-4b36-9f44-98b00ff9e3ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:36.713109 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a423165-2d62-4b36-9f44-98b00ff9e3ff None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:36.719943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d53069-7277-479c-ad58-1d9b6ffa68ea None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-1a423165-2d62-4b36-9f44-98b00ff9e3ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:36.725048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:36.725916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:36.726852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:36.726852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:36.726852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:36.726852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:36.726852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:36.726852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:36.726852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:36.726852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:36.726852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 419/824] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:36.727351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a423165-2d62-4b36-9f44-98b00ff9e3ff None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:36.761733 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb56169-3de8-404b-89fe-650833f08abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:36.762510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb56169-3de8-404b-89fe-650833f08abf None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:36.762805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb56169-3de8-404b-89fe-650833f08abf None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:36.763825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb56169-3de8-404b-89fe-650833f08abf None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:36.764530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb56169-3de8-404b-89fe-650833f08abf None admin] RBAC: Adding query filter params (type=network) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:36.764843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb56169-3de8-404b-89fe-650833f08abf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:36.766365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb56169-3de8-404b-89fe-650833f08abf None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:36.772399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 406/825] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:19:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:36.773669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3c018-18b6-4e56-bd2f-0148843d3ca3 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:36.773955 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3c018-18b6-4e56-bd2f-0148843d3ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:36.774235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3c018-18b6-4e56-bd2f-0148843d3ca3 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:36.778520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 407/826] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:36.778520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3c018-18b6-4e56-bd2f-0148843d3ca3 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:36.841583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a423165-2d62-4b36-9f44-98b00ff9e3ff None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:36.848665 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:36.875803 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:36.881767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870d7e2-538a-4047-8979-56804224cfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:36.882383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870d7e2-538a-4047-8979-56804224cfed None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:36.882696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870d7e2-538a-4047-8979-56804224cfed None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:36.882976 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870d7e2-538a-4047-8979-56804224cfed None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:36.883662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870d7e2-538a-4047-8979-56804224cfed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:36.883971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870d7e2-538a-4047-8979-56804224cfed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:36.884843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3c018-18b6-4e56-bd2f-0148843d3ca3 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:36.885398 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870d7e2-538a-4047-8979-56804224cfed None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:36.901849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 420/827] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:36.901849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870d7e2-538a-4047-8979-56804224cfed None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:36.924371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9669fa-7391-4cc1-9433-661e8160148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:36.924987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9669fa-7391-4cc1-9433-661e8160148d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:36.925275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9669fa-7391-4cc1-9433-661e8160148d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:36.925550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9669fa-7391-4cc1-9433-661e8160148d None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:36.926293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9669fa-7391-4cc1-9433-661e8160148d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:36.926636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9669fa-7391-4cc1-9433-661e8160148d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:36.928795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9669fa-7391-4cc1-9433-661e8160148d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:36.941009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 408/828] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:36.942167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d636d-8e2f-4852-935a-75f1cf95a73d None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:36.942452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d636d-8e2f-4852-935a-75f1cf95a73d None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:36.942754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d636d-8e2f-4852-935a-75f1cf95a73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:36.961142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-4d8d636d-8e2f-4852-935a-75f1cf95a73d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:36.962328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4d8d636d-8e2f-4852-935a-75f1cf95a73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:37.013867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870d7e2-538a-4047-8979-56804224cfed None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:37.046387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 409/829] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:37.046387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d636d-8e2f-4852-935a-75f1cf95a73d None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:37.055631 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58bd2a-d04d-4ab2-baac-f154fed7e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:37.056260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58bd2a-d04d-4ab2-baac-f154fed7e67c None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:37.056544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58bd2a-d04d-4ab2-baac-f154fed7e67c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:37.056823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58bd2a-d04d-4ab2-baac-f154fed7e67c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:37.057593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58bd2a-d04d-4ab2-baac-f154fed7e67c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:37.059319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58bd2a-d04d-4ab2-baac-f154fed7e67c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:37.109422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:37.147217 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 421/830] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:19:36 2022] POST /identity/v3/endpoints => generated 337 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:19:37.151178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58bd2a-d04d-4ab2-baac-f154fed7e67c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:37.156957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d636d-8e2f-4852-935a-75f1cf95a73d None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:37.216957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:37.223101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921d9fc-18c9-494b-86c1-ab4508e1a4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:37.223770 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921d9fc-18c9-494b-86c1-ab4508e1a4db None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:37.224060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921d9fc-18c9-494b-86c1-ab4508e1a4db None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:37.224971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921d9fc-18c9-494b-86c1-ab4508e1a4db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:37.233624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921d9fc-18c9-494b-86c1-ab4508e1a4db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:37.235187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921d9fc-18c9-494b-86c1-ab4508e1a4db None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-f921d9fc-18c9-494b-86c1-ab4508e1a4db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:37.248703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:37.249691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:37.250720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:37.250720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:37.250720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:37.250720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:37.250720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:37.250720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:37.250720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:37.250720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:37.250720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 410/831] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:37.251401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921d9fc-18c9-494b-86c1-ab4508e1a4db None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:37.284798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58bd2a-d04d-4ab2-baac-f154fed7e67c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:37.329953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea34ad-c1e4-43a7-b78e-79ab3edd211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:37.330791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea34ad-c1e4-43a7-b78e-79ab3edd211d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:37.331040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea34ad-c1e4-43a7-b78e-79ab3edd211d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:37.331387 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea34ad-c1e4-43a7-b78e-79ab3edd211d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:37.332182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea34ad-c1e4-43a7-b78e-79ab3edd211d None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=c6d95db1228f48669e1985eb74306a25) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:37.332558 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea34ad-c1e4-43a7-b78e-79ab3edd211d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:37.335148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea34ad-c1e4-43a7-b78e-79ab3edd211d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:37.341779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 422/832] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:37 2022] GET /identity/v3/role_assignments?user.id=c6d95db1228f48669e1985eb74306a25&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:37.342838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea34ad-c1e4-43a7-b78e-79ab3edd211d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:37.406794 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921d9fc-18c9-494b-86c1-ab4508e1a4db None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:37.423967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:37.449499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbfe9c-3f5c-48f2-afae-e94f02e0b528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:37.450636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbfe9c-3f5c-48f2-afae-e94f02e0b528 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:37.451124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbfe9c-3f5c-48f2-afae-e94f02e0b528 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:37.451614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbfe9c-3f5c-48f2-afae-e94f02e0b528 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:37.468967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbfe9c-3f5c-48f2-afae-e94f02e0b528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-41dbfe9c-3f5c-48f2-afae-e94f02e0b528 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:37.476465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:37.477298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:37.477298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:37.477298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:37.477298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:37.477298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:37.477298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:37.477298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:37.477298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:37.477298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:37.477298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:37.477298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:19:37.477298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:37.480898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 411/833] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:19:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:37.486672 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbfe9c-3f5c-48f2-afae-e94f02e0b528 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:37.489036 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea34ad-c1e4-43a7-b78e-79ab3edd211d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:37.503190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:37.529709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878b5ae-f362-46d2-acc5-6fdda3112d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:37.530742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878b5ae-f362-46d2-acc5-6fdda3112d06 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:37.531278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878b5ae-f362-46d2-acc5-6fdda3112d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:37.531758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878b5ae-f362-46d2-acc5-6fdda3112d06 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:37.532716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878b5ae-f362-46d2-acc5-6fdda3112d06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:37.532831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878b5ae-f362-46d2-acc5-6fdda3112d06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:37.534231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878b5ae-f362-46d2-acc5-6fdda3112d06 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:37.547989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 423/834] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:37.555811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878b5ae-f362-46d2-acc5-6fdda3112d06 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:37.611635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbfe9c-3f5c-48f2-afae-e94f02e0b528 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:37.651303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea228-b5ff-46c8-b4fb-8cc85559ac0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:37.651936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea228-b5ff-46c8-b4fb-8cc85559ac0b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:37.652228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea228-b5ff-46c8-b4fb-8cc85559ac0b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:37.652505 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea228-b5ff-46c8-b4fb-8cc85559ac0b None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:37.653222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dea228-b5ff-46c8-b4fb-8cc85559ac0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:37.653586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dea228-b5ff-46c8-b4fb-8cc85559ac0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:37.655041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dea228-b5ff-46c8-b4fb-8cc85559ac0b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:37.664372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 412/835] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:37.669426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea228-b5ff-46c8-b4fb-8cc85559ac0b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:37.697098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878b5ae-f362-46d2-acc5-6fdda3112d06 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:37.716284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:37.746922 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d6c11-5eaf-48e1-9f60-1294c8876326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:37.748205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6c11-5eaf-48e1-9f60-1294c8876326 None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:37.748848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6c11-5eaf-48e1-9f60-1294c8876326 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:37.749695 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6c11-5eaf-48e1-9f60-1294c8876326 None admin] PATH_INFO: `/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/fb334753d1f34e41a450961dfb5f2075/roles/f71c9be92ae0492884ac931960b85e94` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:37.770871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d6c11-5eaf-48e1-9f60-1294c8876326 None admin] RBAC: Authorizing `identity:create_grant(project_id=fae65363f2fb415b834ac367a6c4b7ad, user_id=fb334753d1f34e41a450961dfb5f2075, role_id=f71c9be92ae0492884ac931960b85e94)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:37.773319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d6c11-5eaf-48e1-9f60-1294c8876326 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:37.797947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea228-b5ff-46c8-b4fb-8cc85559ac0b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:37.836617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72584913-9425-4cc2-b31f-31a071f0ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:37.837274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72584913-9425-4cc2-b31f-31a071f0ad2d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:37.837558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72584913-9425-4cc2-b31f-31a071f0ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:37.837830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72584913-9425-4cc2-b31f-31a071f0ad2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:37.848582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72584913-9425-4cc2-b31f-31a071f0ad2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:37.850131 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72584913-9425-4cc2-b31f-31a071f0ad2d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-72584913-9425-4cc2-b31f-31a071f0ad2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:37.866356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:37.867332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:37.868647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:37.868647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:37.868647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:37.868647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:37.872539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 413/836] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:37.873536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72584913-9425-4cc2-b31f-31a071f0ad2d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:37.879724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 424/837] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:19:37 2022] PUT /identity/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/fb334753d1f34e41a450961dfb5f2075/roles/f71c9be92ae0492884ac931960b85e94 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:19:37.981568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:37.999944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72584913-9425-4cc2-b31f-31a071f0ad2d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:38.047571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79198b-f177-4bfa-a95f-af54b09f97fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:38.047571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79198b-f177-4bfa-a95f-af54b09f97fe None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:38.047571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79198b-f177-4bfa-a95f-af54b09f97fe None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:38.047571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79198b-f177-4bfa-a95f-af54b09f97fe None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:38.050509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79198b-f177-4bfa-a95f-af54b09f97fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:38.050509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79198b-f177-4bfa-a95f-af54b09f97fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:38.050509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79198b-f177-4bfa-a95f-af54b09f97fe None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:38.065041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 414/838] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:38.071406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d6c11-5eaf-48e1-9f60-1294c8876326 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:38.095958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:38.185352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d6c11-5eaf-48e1-9f60-1294c8876326 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:38.197723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246421d-0532-4f1a-a6c0-270e58e20522 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:38.198014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246421d-0532-4f1a-a6c0-270e58e20522 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:38.198303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246421d-0532-4f1a-a6c0-270e58e20522 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:38.200973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 415/839] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:19:38.204956 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca4b22-1379-4edb-afc6-fe51d72f7db5 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:38.205249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca4b22-1379-4edb-afc6-fe51d72f7db5 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:38.205530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca4b22-1379-4edb-afc6-fe51d72f7db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:38.225842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-0eca4b22-1379-4edb-afc6-fe51d72f7db5 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:38.227093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0eca4b22-1379-4edb-afc6-fe51d72f7db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:38.229474 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb71045-0d86-4f3e-a2fb-36a8d2714c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:38.230432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb71045-0d86-4f3e-a2fb-36a8d2714c04 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:38.230748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb71045-0d86-4f3e-a2fb-36a8d2714c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:38.231027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb71045-0d86-4f3e-a2fb-36a8d2714c04 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:38.239260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb71045-0d86-4f3e-a2fb-36a8d2714c04 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:38.241355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb71045-0d86-4f3e-a2fb-36a8d2714c04 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-3bb71045-0d86-4f3e-a2fb-36a8d2714c04 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:38.254521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:38.255656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:38.257748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:38.257748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:38.257748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:38.257748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:38.257748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:38.257748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:38.257748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:38.257748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:38.257748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:19:38.257748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:38.257748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 425/840] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:19:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:38.261890 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb71045-0d86-4f3e-a2fb-36a8d2714c04 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:38.313726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 416/841] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:19:38.333113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca4b22-1379-4edb-afc6-fe51d72f7db5 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:38.367450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:38.387623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb71045-0d86-4f3e-a2fb-36a8d2714c04 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:38.424256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adc76c-c1a0-45fe-b2b4-331bb50e67e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:38.425234 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adc76c-c1a0-45fe-b2b4-331bb50e67e4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:38.425746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adc76c-c1a0-45fe-b2b4-331bb50e67e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:38.426229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adc76c-c1a0-45fe-b2b4-331bb50e67e4 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:38.427266 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adc76c-c1a0-45fe-b2b4-331bb50e67e4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:38.428426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adc76c-c1a0-45fe-b2b4-331bb50e67e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:38.430196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adc76c-c1a0-45fe-b2b4-331bb50e67e4 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:38.434619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:38.450146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 426/842] 10.222.0.60 () {56 vars in 1135 bytes} [Thu Aug 4 02:19:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:38.456647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adc76c-c1a0-45fe-b2b4-331bb50e67e4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:38.466641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca4b22-1379-4edb-afc6-fe51d72f7db5 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:38.506549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7c219-3285-4402-8910-ed61dae94605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:38.507622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7c219-3285-4402-8910-ed61dae94605 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:38.508113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7c219-3285-4402-8910-ed61dae94605 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:38.508595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7c219-3285-4402-8910-ed61dae94605 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:38.509437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7c219-3285-4402-8910-ed61dae94605 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:38.511082 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7c219-3285-4402-8910-ed61dae94605 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-03f7c219-3285-4402-8910-ed61dae94605 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:38.521985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:38.523307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:19:38.524140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:38.530702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 417/843] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:19:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:38.533478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7c219-3285-4402-8910-ed61dae94605 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:38.586874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adc76c-c1a0-45fe-b2b4-331bb50e67e4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:38.634448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8f337-438c-4fa3-9933-400e0a08840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:38.635053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8f337-438c-4fa3-9933-400e0a08840f None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:38.635588 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8f337-438c-4fa3-9933-400e0a08840f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:38.635588 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8f337-438c-4fa3-9933-400e0a08840f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:38.644134 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:38.665914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7c219-3285-4402-8910-ed61dae94605 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:38.709019 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd8aa5-002d-4edb-a277-defec2a686df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:38.710057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd8aa5-002d-4edb-a277-defec2a686df None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:38.710645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd8aa5-002d-4edb-a277-defec2a686df None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:38.711156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd8aa5-002d-4edb-a277-defec2a686df None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:38.712148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd8aa5-002d-4edb-a277-defec2a686df None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:38.712668 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd8aa5-002d-4edb-a277-defec2a686df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:38.713617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8f337-438c-4fa3-9933-400e0a08840f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:38.714572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd8aa5-002d-4edb-a277-defec2a686df None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:38.715111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8f337-438c-4fa3-9933-400e0a08840f None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:38.724836 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 418/844] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:19:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:38.726388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd8aa5-002d-4edb-a277-defec2a686df None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:38.730241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:38.816347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 427/845] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:38 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:19:38.822634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8f337-438c-4fa3-9933-400e0a08840f None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:38.840399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd8aa5-002d-4edb-a277-defec2a686df None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:38.878304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3981e1-d772-4c5f-b6e7-691cee8a4d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:38.879264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3981e1-d772-4c5f-b6e7-691cee8a4d42 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:38.879701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3981e1-d772-4c5f-b6e7-691cee8a4d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:38.879821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:38.880936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3981e1-d772-4c5f-b6e7-691cee8a4d42 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:38.881888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3981e1-d772-4c5f-b6e7-691cee8a4d42 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:38.882348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3981e1-d772-4c5f-b6e7-691cee8a4d42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:38.883937 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3981e1-d772-4c5f-b6e7-691cee8a4d42 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:38.894065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 419/846] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:19:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:38.942088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8f337-438c-4fa3-9933-400e0a08840f None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:38.981732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47693695-2449-4bdf-b185-3e33779a90d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:38.982591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47693695-2449-4bdf-b185-3e33779a90d2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:38.982986 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47693695-2449-4bdf-b185-3e33779a90d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:38.983373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47693695-2449-4bdf-b185-3e33779a90d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:38.996782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47693695-2449-4bdf-b185-3e33779a90d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:38.998459 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47693695-2449-4bdf-b185-3e33779a90d2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-47693695-2449-4bdf-b185-3e33779a90d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:39.015093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:39.016230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:39.017331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:39.017331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:39.017331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:39.017331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:39.019383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 428/847] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:39.025096 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3981e1-d772-4c5f-b6e7-691cee8a4d42 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:39.109991 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:39.145714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3981e1-d772-4c5f-b6e7-691cee8a4d42 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:39.185704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ebb07-9c5c-4530-b7b2-c329129a419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:39.186330 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ebb07-9c5c-4530-b7b2-c329129a419d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:39.186686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ebb07-9c5c-4530-b7b2-c329129a419d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:39.186971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ebb07-9c5c-4530-b7b2-c329129a419d None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:39.187674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ebb07-9c5c-4530-b7b2-c329129a419d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:39.187986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ebb07-9c5c-4530-b7b2-c329129a419d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:39.189363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ebb07-9c5c-4530-b7b2-c329129a419d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:39.203128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 420/848] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:39.208502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47693695-2449-4bdf-b185-3e33779a90d2 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:39.309518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:39.320065 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47693695-2449-4bdf-b185-3e33779a90d2 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:39.354769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37f747-30c9-4efb-b77a-72db6ea5c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:39.355419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37f747-30c9-4efb-b77a-72db6ea5c21b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:39.355706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37f747-30c9-4efb-b77a-72db6ea5c21b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:39.355985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37f747-30c9-4efb-b77a-72db6ea5c21b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:39.363194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37f747-30c9-4efb-b77a-72db6ea5c21b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:39.365293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37f747-30c9-4efb-b77a-72db6ea5c21b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-0b37f747-30c9-4efb-b77a-72db6ea5c21b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:39.377330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:39.378288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:39.379228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:39.379228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:39.379228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:39.379228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:39.379228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:39.379228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:39.379228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:39.379228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:39.379228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 429/849] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:39.386605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ebb07-9c5c-4530-b7b2-c329129a419d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:39.493808 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ebb07-9c5c-4530-b7b2-c329129a419d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:39.522849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:39.530884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b0960-991e-458c-ab37-105c53e8766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:39.531508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b0960-991e-458c-ab37-105c53e8766c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:39.531850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b0960-991e-458c-ab37-105c53e8766c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:39.532134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b0960-991e-458c-ab37-105c53e8766c None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:39.532946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b0960-991e-458c-ab37-105c53e8766c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:39.533258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b0960-991e-458c-ab37-105c53e8766c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:39.534726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b0960-991e-458c-ab37-105c53e8766c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:39.547201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 421/850] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:39.553979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37f747-30c9-4efb-b77a-72db6ea5c21b None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:39.592881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a610f9-0f5d-4504-b6e0-91e1c3b2c924 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:39.593220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a610f9-0f5d-4504-b6e0-91e1c3b2c924 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:39.593504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a610f9-0f5d-4504-b6e0-91e1c3b2c924 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:39.595158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 422/851] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:19:39.601282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6aa96-9e11-4c9d-ae33-5fe525771844 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:39.601927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6aa96-9e11-4c9d-ae33-5fe525771844 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:39.602438 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6aa96-9e11-4c9d-ae33-5fe525771844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:39.623626 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-cff6aa96-9e11-4c9d-ae33-5fe525771844 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:39.624911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-cff6aa96-9e11-4c9d-ae33-5fe525771844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:39.670458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37f747-30c9-4efb-b77a-72db6ea5c21b None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:39.703891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 423/852] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:19:39.710147 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca65d1a-0c76-489d-a66b-c25192531ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:39.710810 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca65d1a-0c76-489d-a66b-c25192531ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:39.711100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca65d1a-0c76-489d-a66b-c25192531ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:39.711377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca65d1a-0c76-489d-a66b-c25192531ff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:39.712173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca65d1a-0c76-489d-a66b-c25192531ff6 None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=6414c895c6d642a2affb36013b71df34) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:39.712489 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca65d1a-0c76-489d-a66b-c25192531ff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:39.713933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca65d1a-0c76-489d-a66b-c25192531ff6 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:39.720728 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 430/853] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:39 2022] GET /identity/v3/role_assignments?user.id=6414c895c6d642a2affb36013b71df34&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:39.724489 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6aa96-9e11-4c9d-ae33-5fe525771844 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:39.837881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6aa96-9e11-4c9d-ae33-5fe525771844 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:39.857813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:39.876593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fedee-f449-4cfb-a4a3-0075424194e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:39.880038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fedee-f449-4cfb-a4a3-0075424194e3 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:39.880038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fedee-f449-4cfb-a4a3-0075424194e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:39.880038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fedee-f449-4cfb-a4a3-0075424194e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:39.880038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fedee-f449-4cfb-a4a3-0075424194e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:39.880038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fedee-f449-4cfb-a4a3-0075424194e3 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-361fedee-f449-4cfb-a4a3-0075424194e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:39.889651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:39.890685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:39.891561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 424/854] 10.222.0.60 () {56 vars in 1132 bytes} [Thu Aug 4 02:19:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:39.897680 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca65d1a-0c76-489d-a66b-c25192531ff6 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:39.916628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:40.007738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca65d1a-0c76-489d-a66b-c25192531ff6 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:40.046906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d60e35-2b69-4777-9912-8f51448a4328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:40.047544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60e35-2b69-4777-9912-8f51448a4328 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:40.047832 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60e35-2b69-4777-9912-8f51448a4328 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:40.048112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60e35-2b69-4777-9912-8f51448a4328 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:40.048805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d60e35-2b69-4777-9912-8f51448a4328 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:40.049113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d60e35-2b69-4777-9912-8f51448a4328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:40.049918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d738f-5e43-4817-813d-5b66fe1540de None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:40.049918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d738f-5e43-4817-813d-5b66fe1540de None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:40.050186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d738f-5e43-4817-813d-5b66fe1540de None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:40.050522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d60e35-2b69-4777-9912-8f51448a4328 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:40.051854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 425/855] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:40.056612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 431/856] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Aug 4 02:19:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:40.057805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b4c82-4339-4c7d-b3e4-8c0987db393b None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:40.058101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b4c82-4339-4c7d-b3e4-8c0987db393b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:40.058383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b4c82-4339-4c7d-b3e4-8c0987db393b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:40.063131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d60e35-2b69-4777-9912-8f51448a4328 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:40.078638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f30b4c82-4339-4c7d-b3e4-8c0987db393b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:40.079844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f30b4c82-4339-4c7d-b3e4-8c0987db393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:40.159407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:40.160621 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 426/857] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:40.183565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b4c82-4339-4c7d-b3e4-8c0987db393b None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:40.185787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d60e35-2b69-4777-9912-8f51448a4328 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:40.223744 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26813680-b569-4b08-91b7-c03b1c65fc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:40.224985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26813680-b569-4b08-91b7-c03b1c65fc90 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:40.225490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26813680-b569-4b08-91b7-c03b1c65fc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:40.225970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26813680-b569-4b08-91b7-c03b1c65fc90 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:40.227067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26813680-b569-4b08-91b7-c03b1c65fc90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:40.227578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26813680-b569-4b08-91b7-c03b1c65fc90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:40.229321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26813680-b569-4b08-91b7-c03b1c65fc90 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:40.234881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 432/858] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Aug 4 02:19:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:40.297253 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b4c82-4339-4c7d-b3e4-8c0987db393b None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:40.313404 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:40.337164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409203a-d1f1-4390-a491-17acb1b5e567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:40.337821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409203a-d1f1-4390-a491-17acb1b5e567 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:40.338104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409203a-d1f1-4390-a491-17acb1b5e567 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:40.338378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409203a-d1f1-4390-a491-17acb1b5e567 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:40.351686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409203a-d1f1-4390-a491-17acb1b5e567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-c409203a-d1f1-4390-a491-17acb1b5e567 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:40.357025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:40.358023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:40.358903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 427/859] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:19:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:40.364707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26813680-b569-4b08-91b7-c03b1c65fc90 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:40.476055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26813680-b569-4b08-91b7-c03b1c65fc90 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:40.511678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261739b-2c3f-4bfd-a114-d6d9d1045648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:40.512666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261739b-2c3f-4bfd-a114-d6d9d1045648 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:40.513154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261739b-2c3f-4bfd-a114-d6d9d1045648 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:40.513669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261739b-2c3f-4bfd-a114-d6d9d1045648 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:40.514689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261739b-2c3f-4bfd-a114-d6d9d1045648 None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:40.515197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261739b-2c3f-4bfd-a114-d6d9d1045648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:40.516780 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261739b-2c3f-4bfd-a114-d6d9d1045648 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:40.527785 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 433/860] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:19:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:40.534571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409203a-d1f1-4390-a491-17acb1b5e567 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:40.639170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409203a-d1f1-4390-a491-17acb1b5e567 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:40.675084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20033fe7-8f90-4d0e-8415-d21811594097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:40.675731 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20033fe7-8f90-4d0e-8415-d21811594097 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:40.676028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20033fe7-8f90-4d0e-8415-d21811594097 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:40.676293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20033fe7-8f90-4d0e-8415-d21811594097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:40.687134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20033fe7-8f90-4d0e-8415-d21811594097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:40.688597 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20033fe7-8f90-4d0e-8415-d21811594097 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-20033fe7-8f90-4d0e-8415-d21811594097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:40.704346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:40.705284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:40.706228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:40.706228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:40.706228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:40.706228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:40.706228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 428/861] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:40.711773 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261739b-2c3f-4bfd-a114-d6d9d1045648 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:40.718454 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:40.819126 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261739b-2c3f-4bfd-a114-d6d9d1045648 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:40.854232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3694a0a-c8ad-4fe1-87f5-bc18e1699058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:40.854884 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694a0a-c8ad-4fe1-87f5-bc18e1699058 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:40.855170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694a0a-c8ad-4fe1-87f5-bc18e1699058 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:40.855503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694a0a-c8ad-4fe1-87f5-bc18e1699058 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:40.856194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3694a0a-c8ad-4fe1-87f5-bc18e1699058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:40.856555 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3694a0a-c8ad-4fe1-87f5-bc18e1699058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:40.858090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3694a0a-c8ad-4fe1-87f5-bc18e1699058 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:40.871374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 434/862] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:40.876543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20033fe7-8f90-4d0e-8415-d21811594097 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:40.906960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:40.992169 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20033fe7-8f90-4d0e-8415-d21811594097 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:41.028398 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb0466-8111-4725-914c-84193389971a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:41.029049 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb0466-8111-4725-914c-84193389971a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:41.029335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb0466-8111-4725-914c-84193389971a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:41.029617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb0466-8111-4725-914c-84193389971a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:41.037896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb0466-8111-4725-914c-84193389971a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:41.039394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb0466-8111-4725-914c-84193389971a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-b4fb0466-8111-4725-914c-84193389971a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:41.052031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:41.053529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:41.054706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:41.054706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:41.054706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:41.054706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:41.054706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:41.054706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:41.054706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:41.054706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:41.054706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:19:41.054706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:41.054706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 429/863] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Aug 4 02:19:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:41.060139 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3694a0a-c8ad-4fe1-87f5-bc18e1699058 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:41.100594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a307bb7-d130-4011-8ef1-66c6e635e15b None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:41.100900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a307bb7-d130-4011-8ef1-66c6e635e15b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:41.101168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a307bb7-d130-4011-8ef1-66c6e635e15b None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:41.102873 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 430/864] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:19:41.110634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729fbc4-a29d-42f8-8548-f19122e9d2f0 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:41.111070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729fbc4-a29d-42f8-8548-f19122e9d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:41.111861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729fbc4-a29d-42f8-8548-f19122e9d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:41.134344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:41.137206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e729fbc4-a29d-42f8-8548-f19122e9d2f0 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:41.138398 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e729fbc4-a29d-42f8-8548-f19122e9d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:41.184050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3694a0a-c8ad-4fe1-87f5-bc18e1699058 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:41.212970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 431/865] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:19:41.230715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a6e18-9fd6-4820-b3ab-e07c3baa58bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:41.231334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a6e18-9fd6-4820-b3ab-e07c3baa58bc None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:41.231620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a6e18-9fd6-4820-b3ab-e07c3baa58bc None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:41.231895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a6e18-9fd6-4820-b3ab-e07c3baa58bc None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:41.232750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a6e18-9fd6-4820-b3ab-e07c3baa58bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:41.233068 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a6e18-9fd6-4820-b3ab-e07c3baa58bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:41.234605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a6e18-9fd6-4820-b3ab-e07c3baa58bc None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:41.239501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729fbc4-a29d-42f8-8548-f19122e9d2f0 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:41.257389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 435/866] 10.222.0.60 () {56 vars in 1149 bytes} [Thu Aug 4 02:19:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:41.257696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:41.263440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a6e18-9fd6-4820-b3ab-e07c3baa58bc None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:41.366099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729fbc4-a29d-42f8-8548-f19122e9d2f0 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:41.386464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a6e18-9fd6-4820-b3ab-e07c3baa58bc None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:41.407023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dfcc2-c779-4c14-8e64-bc71ae3160d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:41.408075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dfcc2-c779-4c14-8e64-bc71ae3160d1 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:41.408567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dfcc2-c779-4c14-8e64-bc71ae3160d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:41.409058 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dfcc2-c779-4c14-8e64-bc71ae3160d1 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:41.410001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626dfcc2-c779-4c14-8e64-bc71ae3160d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:41.411959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626dfcc2-c779-4c14-8e64-bc71ae3160d1 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:41.420274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:41.431689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690be477-e3b2-4e6c-8260-182a8896017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:41.432417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690be477-e3b2-4e6c-8260-182a8896017e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:41.432882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690be477-e3b2-4e6c-8260-182a8896017e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:41.433166 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690be477-e3b2-4e6c-8260-182a8896017e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:41.481988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 432/867] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:19:41 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:19:41.518714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690be477-e3b2-4e6c-8260-182a8896017e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:41.520451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690be477-e3b2-4e6c-8260-182a8896017e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:41.635447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 436/868] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:19:41.641277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dfcc2-c779-4c14-8e64-bc71ae3160d1 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:41.725487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:41.757875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dfcc2-c779-4c14-8e64-bc71ae3160d1 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:41.795024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45440a5-36be-4dbb-a500-771bfffd1660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:41.795645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45440a5-36be-4dbb-a500-771bfffd1660 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:41.795938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45440a5-36be-4dbb-a500-771bfffd1660 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:41.796215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45440a5-36be-4dbb-a500-771bfffd1660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:41.807844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45440a5-36be-4dbb-a500-771bfffd1660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:41.810346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45440a5-36be-4dbb-a500-771bfffd1660 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-a45440a5-36be-4dbb-a500-771bfffd1660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:41.826676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:41.827877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:41.828822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:41.828822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:41.828822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:41.828822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:41.828822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 433/869] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:41.834008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690be477-e3b2-4e6c-8260-182a8896017e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:41.860158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:41.924040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5a707-2ec2-45b1-a745-41deb83da9ab None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:41.924345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5a707-2ec2-45b1-a745-41deb83da9ab None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:41.924548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5a707-2ec2-45b1-a745-41deb83da9ab None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:41.926185 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 434/870] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:41.932030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c3705-3d90-4502-b6aa-24dfa7501f7d None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:41.932444 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c3705-3d90-4502-b6aa-24dfa7501f7d None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:41.932832 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c3705-3d90-4502-b6aa-24dfa7501f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:41.943714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690be477-e3b2-4e6c-8260-182a8896017e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:41.953672 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-159c3705-3d90-4502-b6aa-24dfa7501f7d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:41.955637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-159c3705-3d90-4502-b6aa-24dfa7501f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:41.982343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db5b21-919e-4e40-af87-2093269e1c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:41.983271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db5b21-919e-4e40-af87-2093269e1c79 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:41.983660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db5b21-919e-4e40-af87-2093269e1c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:41.984043 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db5b21-919e-4e40-af87-2093269e1c79 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:41.984848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db5b21-919e-4e40-af87-2093269e1c79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:41.985260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db5b21-919e-4e40-af87-2093269e1c79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:41.987017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db5b21-919e-4e40-af87-2093269e1c79 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:42.000998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 437/871] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:42.006798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db5b21-919e-4e40-af87-2093269e1c79 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:42.035154 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 435/872] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:19:42.057738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c3705-3d90-4502-b6aa-24dfa7501f7d None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:42.098062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:42.120643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db5b21-919e-4e40-af87-2093269e1c79 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:42.126911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:42.167679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf8ee7-647c-417c-a568-69e8ac4d0395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:42.168380 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf8ee7-647c-417c-a568-69e8ac4d0395 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:42.168667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf8ee7-647c-417c-a568-69e8ac4d0395 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:42.169083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf8ee7-647c-417c-a568-69e8ac4d0395 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:42.169199 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c3705-3d90-4502-b6aa-24dfa7501f7d None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:42.178089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf8ee7-647c-417c-a568-69e8ac4d0395 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:42.179995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf8ee7-647c-417c-a568-69e8ac4d0395 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-b3bf8ee7-647c-417c-a568-69e8ac4d0395 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:42.196495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:42.197567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:42.198591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:42.198591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:42.198591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:42.198591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:42.198591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:42.198591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:42.198591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:42.198591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:42.198591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 438/873] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:42.204725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf8ee7-647c-417c-a568-69e8ac4d0395 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:42.212615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df526a8e-6b53-4492-939c-a304853ac550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:42.213388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df526a8e-6b53-4492-939c-a304853ac550 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:42.213770 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df526a8e-6b53-4492-939c-a304853ac550 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:42.214148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df526a8e-6b53-4492-939c-a304853ac550 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:42.214917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df526a8e-6b53-4492-939c-a304853ac550 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:42.216397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df526a8e-6b53-4492-939c-a304853ac550 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-df526a8e-6b53-4492-939c-a304853ac550 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:42.226314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:42.227611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:42.228643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:42.234506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 436/874] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Aug 4 02:19:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:42.236536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df526a8e-6b53-4492-939c-a304853ac550 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:42.321727 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf8ee7-647c-417c-a568-69e8ac4d0395 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:42.342782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df526a8e-6b53-4492-939c-a304853ac550 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:42.358297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369d593-4d0f-4bd6-bc1c-43d17cb234f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:42.359002 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369d593-4d0f-4bd6-bc1c-43d17cb234f2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:42.359286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369d593-4d0f-4bd6-bc1c-43d17cb234f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:42.359705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:42.360394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369d593-4d0f-4bd6-bc1c-43d17cb234f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:42.361081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369d593-4d0f-4bd6-bc1c-43d17cb234f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:42.361386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369d593-4d0f-4bd6-bc1c-43d17cb234f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:42.362855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369d593-4d0f-4bd6-bc1c-43d17cb234f2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:42.377818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2e451-59e5-442b-a9a1-56e4ca3b9587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:42.378559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2e451-59e5-442b-a9a1-56e4ca3b9587 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:42.378855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2e451-59e5-442b-a9a1-56e4ca3b9587 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:42.379106 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2e451-59e5-442b-a9a1-56e4ca3b9587 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:42.379784 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2e451-59e5-442b-a9a1-56e4ca3b9587 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:42.380146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2e451-59e5-442b-a9a1-56e4ca3b9587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:42.382178 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2e451-59e5-442b-a9a1-56e4ca3b9587 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:42.382638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 439/875] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:42.384192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755276ee-2e37-4af9-9fbb-03018bc077aa None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:42.384561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755276ee-2e37-4af9-9fbb-03018bc077aa None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:42.384844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755276ee-2e37-4af9-9fbb-03018bc077aa None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:42.386262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 440/876] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:42.389966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 437/877] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Aug 4 02:19:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:42.390811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755276ee-2e37-4af9-9fbb-03018bc077aa None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:42.391787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429e784-0601-48e2-b429-bbe63cc7c391 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:42.392080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429e784-0601-48e2-b429-bbe63cc7c391 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:42.392361 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429e784-0601-48e2-b429-bbe63cc7c391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:42.393836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:42.412072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6429e784-0601-48e2-b429-bbe63cc7c391 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:42.413364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6429e784-0601-48e2-b429-bbe63cc7c391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:42.489020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 438/878] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:19:42.491777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429e784-0601-48e2-b429-bbe63cc7c391 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:42.498951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755276ee-2e37-4af9-9fbb-03018bc077aa None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:42.537889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d2dd6-4907-4a26-a199-a5399840703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:42.538537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d2dd6-4907-4a26-a199-a5399840703c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:42.538831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d2dd6-4907-4a26-a199-a5399840703c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:42.539109 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d2dd6-4907-4a26-a199-a5399840703c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:42.539892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d2dd6-4907-4a26-a199-a5399840703c None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=fb334753d1f34e41a450961dfb5f2075) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:42.540207 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d2dd6-4907-4a26-a199-a5399840703c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:42.541639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d2dd6-4907-4a26-a199-a5399840703c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:42.547485 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 441/879] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:42 2022] GET /identity/v3/role_assignments?user.id=fb334753d1f34e41a450961dfb5f2075&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:42.548244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d2dd6-4907-4a26-a199-a5399840703c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:42.629707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:42.656477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429e784-0601-48e2-b429-bbe63cc7c391 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:42.674836 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:42.680826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d2dd6-4907-4a26-a199-a5399840703c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:42.712829 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a4b8a-d8c1-4f61-97d5-74724693b1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:42.714049 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a4b8a-d8c1-4f61-97d5-74724693b1de None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:42.714331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a4b8a-d8c1-4f61-97d5-74724693b1de None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:42.714628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a4b8a-d8c1-4f61-97d5-74724693b1de None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:42.715467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a4b8a-d8c1-4f61-97d5-74724693b1de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:42.716082 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a4b8a-d8c1-4f61-97d5-74724693b1de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:42.717732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a4b8a-d8c1-4f61-97d5-74724693b1de None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:42.721420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9290d79-bba2-4dca-9aeb-50118d0a8d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:42.722032 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9290d79-bba2-4dca-9aeb-50118d0a8d01 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:42.722319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9290d79-bba2-4dca-9aeb-50118d0a8d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:42.722646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9290d79-bba2-4dca-9aeb-50118d0a8d01 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:42.723349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9290d79-bba2-4dca-9aeb-50118d0a8d01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:42.723614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 439/880] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Aug 4 02:19:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:42.725321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9290d79-bba2-4dca-9aeb-50118d0a8d01 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:42.814629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 442/881] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:19:42 2022] POST /identity/v3/services => generated 269 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:19:43.722282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff083c3-0c5d-48db-b55e-f61da0bad372 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:43.722825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff083c3-0c5d-48db-b55e-f61da0bad372 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:43.722933 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff083c3-0c5d-48db-b55e-f61da0bad372 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:43.724539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 440/882] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:43.729676 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ecb2f-dd4c-4230-989f-dce567369f5a None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:43.730065 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ecb2f-dd4c-4230-989f-dce567369f5a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:43.730229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ecb2f-dd4c-4230-989f-dce567369f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:43.749199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-e10ecb2f-dd4c-4230-989f-dce567369f5a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:43.750383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e10ecb2f-dd4c-4230-989f-dce567369f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:43.829588 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 443/883] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:43.852603 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff083c3-0c5d-48db-b55e-f61da0bad372 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:43.970889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff083c3-0c5d-48db-b55e-f61da0bad372 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:44.006770 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f2ead-268b-4b78-a018-20e297f3440d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:44.007716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f2ead-268b-4b78-a018-20e297f3440d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:44.008200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f2ead-268b-4b78-a018-20e297f3440d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:44.008672 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f2ead-268b-4b78-a018-20e297f3440d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:44.009548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f2ead-268b-4b78-a018-20e297f3440d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:44.011145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f2ead-268b-4b78-a018-20e297f3440d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-0e0f2ead-268b-4b78-a018-20e297f3440d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:44.020241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:44.021789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:19:44.022757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:44.025603 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 441/884] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:19:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:44.031206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ecb2f-dd4c-4230-989f-dce567369f5a None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:44.097024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:44.146561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ecb2f-dd4c-4230-989f-dce567369f5a None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:44.182978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4462aa-20bd-4c2b-a9f7-43f20bc72a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:44.184227 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4462aa-20bd-4c2b-a9f7-43f20bc72a81 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:44.184718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4462aa-20bd-4c2b-a9f7-43f20bc72a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:44.185221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4462aa-20bd-4c2b-a9f7-43f20bc72a81 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:44.186100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4462aa-20bd-4c2b-a9f7-43f20bc72a81 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:44.186641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4462aa-20bd-4c2b-a9f7-43f20bc72a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:44.188291 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4462aa-20bd-4c2b-a9f7-43f20bc72a81 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:44.194464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 444/885] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:19:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:44.200501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f2ead-268b-4b78-a018-20e297f3440d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:44.242437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:44.306930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f2ead-268b-4b78-a018-20e297f3440d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:44.344492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13e140-0411-4f33-82f6-6a3bdd3ec73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:44.345114 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13e140-0411-4f33-82f6-6a3bdd3ec73a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:44.345396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13e140-0411-4f33-82f6-6a3bdd3ec73a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:44.345670 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13e140-0411-4f33-82f6-6a3bdd3ec73a None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:44.346353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13e140-0411-4f33-82f6-6a3bdd3ec73a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:44.346695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13e140-0411-4f33-82f6-6a3bdd3ec73a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:44.348075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13e140-0411-4f33-82f6-6a3bdd3ec73a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:44.354310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 442/886] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:19:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:44.359783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4462aa-20bd-4c2b-a9f7-43f20bc72a81 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:44.467060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4462aa-20bd-4c2b-a9f7-43f20bc72a81 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:44.485495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:44.504093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95583c8-4da7-4a4a-8df6-b16d5807e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:44.504772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95583c8-4da7-4a4a-8df6-b16d5807e6df None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:44.505175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95583c8-4da7-4a4a-8df6-b16d5807e6df None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:44.505614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95583c8-4da7-4a4a-8df6-b16d5807e6df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:44.506385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95583c8-4da7-4a4a-8df6-b16d5807e6df None admin] RBAC: Adding query filter params (interface=public, service_id=162b2f084b1f43bb8536bd380b73d111, region_id=RegionOne) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:44.506731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95583c8-4da7-4a4a-8df6-b16d5807e6df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:44.508123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95583c8-4da7-4a4a-8df6-b16d5807e6df None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:44.513762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 445/887] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Aug 4 02:19:44 2022] GET /identity/v3/endpoints?service_id=162b2f084b1f43bb8536bd380b73d111&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:44.519402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13e140-0411-4f33-82f6-6a3bdd3ec73a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:44.631901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13e140-0411-4f33-82f6-6a3bdd3ec73a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:44.633427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:44.669028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc2111-8a92-482b-ba5b-8cfc454e76dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:44.669652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc2111-8a92-482b-ba5b-8cfc454e76dd None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:44.669933 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc2111-8a92-482b-ba5b-8cfc454e76dd None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:44.671246 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc2111-8a92-482b-ba5b-8cfc454e76dd None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:44.671923 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc2111-8a92-482b-ba5b-8cfc454e76dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:44.673296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc2111-8a92-482b-ba5b-8cfc454e76dd None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:44.680196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 443/888] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Aug 4 02:19:44 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:19:44.780236 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fdda4-bf45-4c55-ab82-a7b7c4912107 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:44.781186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fdda4-bf45-4c55-ab82-a7b7c4912107 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:44.781635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fdda4-bf45-4c55-ab82-a7b7c4912107 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:44.785125 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 446/889] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:44.790057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dbac7-8b47-4f32-9765-faf84b4d4f64 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:44.790576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dbac7-8b47-4f32-9765-faf84b4d4f64 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:44.790658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dbac7-8b47-4f32-9765-faf84b4d4f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:44.811320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-037dbac7-8b47-4f32-9765-faf84b4d4f64 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:44.812541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-037dbac7-8b47-4f32-9765-faf84b4d4f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:44.824073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990c2b-b590-4369-bce0-010968e1428f None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:44.824403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990c2b-b590-4369-bce0-010968e1428f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:44.824629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990c2b-b590-4369-bce0-010968e1428f None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:44.826286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 447/890] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:19:44.831695 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a250bd-bfc2-4ce6-90ba-61ceef8f040a None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:44.831978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a250bd-bfc2-4ce6-90ba-61ceef8f040a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:44.832254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a250bd-bfc2-4ce6-90ba-61ceef8f040a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:44.852351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-82a250bd-bfc2-4ce6-90ba-61ceef8f040a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:44.853773 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-82a250bd-bfc2-4ce6-90ba-61ceef8f040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:44.891691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 444/891] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:44.914962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dbac7-8b47-4f32-9765-faf84b4d4f64 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:44.936029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 448/892] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:44.937306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172691c-c694-4612-a979-4c346a5ae789 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:44.937601 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172691c-c694-4612-a979-4c346a5ae789 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:44.937878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172691c-c694-4612-a979-4c346a5ae789 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:44.939416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 449/893] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:44.944476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4c6b1-9d6e-4760-8380-801ae420f2e9 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:44.944764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4c6b1-9d6e-4760-8380-801ae420f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:44.945047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4c6b1-9d6e-4760-8380-801ae420f2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:44.963784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-12c4c6b1-9d6e-4760-8380-801ae420f2e9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:44.964987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-12c4c6b1-9d6e-4760-8380-801ae420f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:45.017550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:45.023687 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dbac7-8b47-4f32-9765-faf84b4d4f64 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:45.039077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 450/894] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:19:45.040160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4c6b1-9d6e-4760-8380-801ae420f2e9 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:45.078702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddf40e-022f-4300-a03c-1f3ad94e7c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:45.079599 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddf40e-022f-4300-a03c-1f3ad94e7c8c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:45.080067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddf40e-022f-4300-a03c-1f3ad94e7c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:45.080348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddf40e-022f-4300-a03c-1f3ad94e7c8c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:45.091831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddf40e-022f-4300-a03c-1f3ad94e7c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:45.092825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-2dddf40e-022f-4300-a03c-1f3ad94e7c8c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:45.096797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:45.097747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:45.098951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 445/895] 10.222.0.60 () {56 vars in 1120 bytes} [Thu Aug 4 02:19:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:45.099908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddf40e-022f-4300-a03c-1f3ad94e7c8c None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:45.158573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4c6b1-9d6e-4760-8380-801ae420f2e9 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:45.198133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca6441-6f08-49cd-8208-abdc06d48d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:45.198783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca6441-6f08-49cd-8208-abdc06d48d78 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:45.199063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca6441-6f08-49cd-8208-abdc06d48d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:45.199333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca6441-6f08-49cd-8208-abdc06d48d78 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:45.200016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca6441-6f08-49cd-8208-abdc06d48d78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:45.201392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca6441-6f08-49cd-8208-abdc06d48d78 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:45.210841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddf40e-022f-4300-a03c-1f3ad94e7c8c None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:45.244924 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c88a22-3b58-406a-8400-d8787536beaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:45.245586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88a22-3b58-406a-8400-d8787536beaf None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:45.245866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88a22-3b58-406a-8400-d8787536beaf None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:45.246142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88a22-3b58-406a-8400-d8787536beaf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:45.246832 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c88a22-3b58-406a-8400-d8787536beaf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:45.248194 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c88a22-3b58-406a-8400-d8787536beaf None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-59c88a22-3b58-406a-8400-d8787536beaf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:45.258724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:45.259856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:45.260724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 446/896] 10.222.0.60 () {56 vars in 1132 bytes} [Thu Aug 4 02:19:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:45.261565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c88a22-3b58-406a-8400-d8787536beaf None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:45.276382 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 451/897] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:19:45 2022] POST /identity/v3/services => generated 241 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:19:45.277425 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca6441-6f08-49cd-8208-abdc06d48d78 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:45.330919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:45.387047 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c88a22-3b58-406a-8400-d8787536beaf None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:45.423221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:45.436071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca6441-6f08-49cd-8208-abdc06d48d78 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:45.437073 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14732947-3cfd-465d-95b1-2fba3039e87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:45.438105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14732947-3cfd-465d-95b1-2fba3039e87e None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:45.438606 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14732947-3cfd-465d-95b1-2fba3039e87e None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:45.439884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14732947-3cfd-465d-95b1-2fba3039e87e None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:45.440773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14732947-3cfd-465d-95b1-2fba3039e87e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:45.441116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14732947-3cfd-465d-95b1-2fba3039e87e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:45.444640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14732947-3cfd-465d-95b1-2fba3039e87e None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:45.458568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 447/898] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Aug 4 02:19:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:45.461975 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14732947-3cfd-465d-95b1-2fba3039e87e None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:45.482624 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e829065-6573-4d9c-8456-cabc4000c72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:45.483632 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e829065-6573-4d9c-8456-cabc4000c72a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:45.484170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e829065-6573-4d9c-8456-cabc4000c72a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:45.484647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e829065-6573-4d9c-8456-cabc4000c72a None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:45.485909 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e829065-6573-4d9c-8456-cabc4000c72a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:45.485909 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e829065-6573-4d9c-8456-cabc4000c72a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:45.487681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e829065-6573-4d9c-8456-cabc4000c72a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:45.494710 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 452/899] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Aug 4 02:19:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:45.500510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e829065-6573-4d9c-8456-cabc4000c72a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:45.568573 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:45.589067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14732947-3cfd-465d-95b1-2fba3039e87e None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:45.622662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e829065-6573-4d9c-8456-cabc4000c72a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:45.637300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2ede8-102d-4c03-ab0d-70fbe86d79d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:45.638350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2ede8-102d-4c03-ab0d-70fbe86d79d5 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:45.638890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2ede8-102d-4c03-ab0d-70fbe86d79d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:45.639349 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2ede8-102d-4c03-ab0d-70fbe86d79d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:45.650444 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2ede8-102d-4c03-ab0d-70fbe86d79d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:45.652163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2ede8-102d-4c03-ab0d-70fbe86d79d5 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:45.660520 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95300bdc-c571-4a84-9519-de147e660741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:45.661823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300bdc-c571-4a84-9519-de147e660741 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:45.662170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300bdc-c571-4a84-9519-de147e660741 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:45.662524 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300bdc-c571-4a84-9519-de147e660741 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:45.663632 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95300bdc-c571-4a84-9519-de147e660741 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:45.663759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95300bdc-c571-4a84-9519-de147e660741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:45.665123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95300bdc-c571-4a84-9519-de147e660741 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-bfe2ede8-102d-4c03-ab0d-70fbe86d79d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:45.674594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:45.675571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:45.676817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:45.676817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:45.676817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:45.676817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:45.677667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 453/900] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Aug 4 02:19:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:45.679099 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95300bdc-c571-4a84-9519-de147e660741 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:45.683955 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 448/901] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:45.686593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2ede8-102d-4c03-ab0d-70fbe86d79d5 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:45.713229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:45.797094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95300bdc-c571-4a84-9519-de147e660741 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:45.797709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2ede8-102d-4c03-ab0d-70fbe86d79d5 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:45.837384 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16f34f-65b7-474e-b86f-d463265d0798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:45.837638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8c414-4e00-43c1-8afe-11863e25d328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:45.838236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8c414-4e00-43c1-8afe-11863e25d328 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:45.838345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16f34f-65b7-474e-b86f-d463265d0798 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:45.838538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8c414-4e00-43c1-8afe-11863e25d328 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:45.838820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8c414-4e00-43c1-8afe-11863e25d328 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:45.838934 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16f34f-65b7-474e-b86f-d463265d0798 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:45.839290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16f34f-65b7-474e-b86f-d463265d0798 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:45.839533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8c414-4e00-43c1-8afe-11863e25d328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:45.839843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8c414-4e00-43c1-8afe-11863e25d328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:45.840344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16f34f-65b7-474e-b86f-d463265d0798 None admin] RBAC: Adding query filter params (interface=public, service_id=8b287198cd1548c5aa900798d71d5bb0, region_id=RegionOne) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:45.840759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16f34f-65b7-474e-b86f-d463265d0798 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:45.841329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8c414-4e00-43c1-8afe-11863e25d328 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:45.842351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16f34f-65b7-474e-b86f-d463265d0798 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:45.849165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 454/902] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Aug 4 02:19:45 2022] GET /identity/v3/endpoints?service_id=8b287198cd1548c5aa900798d71d5bb0&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:45.854927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:45.855177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16f34f-65b7-474e-b86f-d463265d0798 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:45.866575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 449/903] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:45.869501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8c414-4e00-43c1-8afe-11863e25d328 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:45.971531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:45.985262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16f34f-65b7-474e-b86f-d463265d0798 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:45.994730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8c414-4e00-43c1-8afe-11863e25d328 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:46.024541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094d0a4-39c1-478c-9180-cc3c539f4555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:46.025282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094d0a4-39c1-478c-9180-cc3c539f4555 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:46.025879 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094d0a4-39c1-478c-9180-cc3c539f4555 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:46.026158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094d0a4-39c1-478c-9180-cc3c539f4555 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:46.026948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094d0a4-39c1-478c-9180-cc3c539f4555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:46.028515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094d0a4-39c1-478c-9180-cc3c539f4555 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:46.034297 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820c43d-6488-4a6d-9f5a-ad7bdc006161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:46.035138 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820c43d-6488-4a6d-9f5a-ad7bdc006161 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:46.042524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820c43d-6488-4a6d-9f5a-ad7bdc006161 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:46.042757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 455/904] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Aug 4 02:19:45 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:19:46.042869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820c43d-6488-4a6d-9f5a-ad7bdc006161 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:46.054600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820c43d-6488-4a6d-9f5a-ad7bdc006161 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:46.056084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820c43d-6488-4a6d-9f5a-ad7bdc006161 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-c820c43d-6488-4a6d-9f5a-ad7bdc006161 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:46.074116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:46.075180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:46.076128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:46.076128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:46.076128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:46.076128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:46.076128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:46.076128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:46.076128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:46.076128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:46.076128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:19:46.076128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:46.076128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 450/905] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Aug 4 02:19:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:46.081595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094d0a4-39c1-478c-9180-cc3c539f4555 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:46.196966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094d0a4-39c1-478c-9180-cc3c539f4555 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:46.233016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c95a9d-dbc1-4c2b-94c8-b500197d7f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:46.233561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c95a9d-dbc1-4c2b-94c8-b500197d7f85 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:46.233862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c95a9d-dbc1-4c2b-94c8-b500197d7f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:46.234139 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c95a9d-dbc1-4c2b-94c8-b500197d7f85 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:46.234970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c95a9d-dbc1-4c2b-94c8-b500197d7f85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:46.235277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c95a9d-dbc1-4c2b-94c8-b500197d7f85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:46.236717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c95a9d-dbc1-4c2b-94c8-b500197d7f85 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:46.256048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 456/906] 10.222.0.60 () {56 vars in 1149 bytes} [Thu Aug 4 02:19:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:46.261626 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820c43d-6488-4a6d-9f5a-ad7bdc006161 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:46.322133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:46.368586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820c43d-6488-4a6d-9f5a-ad7bdc006161 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:46.404003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c6939-7712-4b29-a16f-016169984609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:46.404625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c6939-7712-4b29-a16f-016169984609 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:46.404912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c6939-7712-4b29-a16f-016169984609 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:46.405189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c6939-7712-4b29-a16f-016169984609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:46.482811 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c6939-7712-4b29-a16f-016169984609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:46.484811 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c6939-7712-4b29-a16f-016169984609 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:46.546399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:46.597124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 451/907] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:46 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:19:46.602458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c95a9d-dbc1-4c2b-94c8-b500197d7f85 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:46.615820 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:46.710876 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c95a9d-dbc1-4c2b-94c8-b500197d7f85 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:46.748379 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d22bb6-bd0d-42d4-9d03-f91f650a4031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:46.749386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d22bb6-bd0d-42d4-9d03-f91f650a4031 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:46.749871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d22bb6-bd0d-42d4-9d03-f91f650a4031 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:46.750651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d22bb6-bd0d-42d4-9d03-f91f650a4031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:46.760267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc1596-124b-4182-9803-cc5eb7c6ec7c None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:46.760592 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc1596-124b-4182-9803-cc5eb7c6ec7c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:46.760823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc1596-124b-4182-9803-cc5eb7c6ec7c None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:46.762334 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 452/908] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:46.765964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d22bb6-bd0d-42d4-9d03-f91f650a4031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:46.767610 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d22bb6-bd0d-42d4-9d03-f91f650a4031 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:46.767947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0190a83-6af4-43e9-a65d-fa0319af5ca8 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:46.768454 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0190a83-6af4-43e9-a65d-fa0319af5ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:46.768936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0190a83-6af4-43e9-a65d-fa0319af5ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-63d22bb6-bd0d-42d4-9d03-f91f650a4031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:46.785484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:46.788141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:46.789338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:46.789338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:46.789338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:46.789338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:46.789338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 457/909] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:46.790542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-d0190a83-6af4-43e9-a65d-fa0319af5ca8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:46.792133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d0190a83-6af4-43e9-a65d-fa0319af5ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:46.795980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d22bb6-bd0d-42d4-9d03-f91f650a4031 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:46.871508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 453/910] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:19:46.882527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:46.889822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0190a83-6af4-43e9-a65d-fa0319af5ca8 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:46.934980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d22bb6-bd0d-42d4-9d03-f91f650a4031 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:46.980060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2e5be-f459-4251-8d05-c5923377815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:46.980798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2e5be-f459-4251-8d05-c5923377815b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:46.981085 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2e5be-f459-4251-8d05-c5923377815b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:46.981419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2e5be-f459-4251-8d05-c5923377815b None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:46.982132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2e5be-f459-4251-8d05-c5923377815b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:46.982582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2e5be-f459-4251-8d05-c5923377815b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:46.983951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2e5be-f459-4251-8d05-c5923377815b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:46.990118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:46.999295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 458/911] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:47.004361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2e5be-f459-4251-8d05-c5923377815b None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:47.017403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0190a83-6af4-43e9-a65d-fa0319af5ca8 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:47.059126 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7576eb5-12a2-408f-874b-d1636700bc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:47.060870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7576eb5-12a2-408f-874b-d1636700bc17 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:47.061351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7576eb5-12a2-408f-874b-d1636700bc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:47.061765 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7576eb5-12a2-408f-874b-d1636700bc17 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:47.062622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7576eb5-12a2-408f-874b-d1636700bc17 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:47.064189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7576eb5-12a2-408f-874b-d1636700bc17 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-d7576eb5-12a2-408f-874b-d1636700bc17 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:47.077251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:47.078316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:19:47.079301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:47.082700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 454/912] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:19:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:47.086676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7576eb5-12a2-408f-874b-d1636700bc17 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:47.139784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2e5be-f459-4251-8d05-c5923377815b None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:47.164242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:47.177402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b7e01-8bce-41b1-a74e-2da3503c95f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:47.178254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b7e01-8bce-41b1-a74e-2da3503c95f5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:47.178700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b7e01-8bce-41b1-a74e-2da3503c95f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:47.181747 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b7e01-8bce-41b1-a74e-2da3503c95f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:47.186719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b7e01-8bce-41b1-a74e-2da3503c95f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:47.188470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b7e01-8bce-41b1-a74e-2da3503c95f5 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:47.194254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7576eb5-12a2-408f-874b-d1636700bc17 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-b71b7e01-8bce-41b1-a74e-2da3503c95f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:47.200767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:47.201836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:47.202802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:47.202802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:47.202802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:47.202802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:47.202802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:47.202802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:47.202802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:47.202802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:47.204961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 459/913] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:47.211181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b7e01-8bce-41b1-a74e-2da3503c95f5 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:47.239800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41863066-db80-4011-9249-4b845152ad33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:47.240968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41863066-db80-4011-9249-4b845152ad33 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:47.241477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41863066-db80-4011-9249-4b845152ad33 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:47.241957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41863066-db80-4011-9249-4b845152ad33 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:47.242880 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41863066-db80-4011-9249-4b845152ad33 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:47.243397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41863066-db80-4011-9249-4b845152ad33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:47.245031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41863066-db80-4011-9249-4b845152ad33 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:47.255572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 455/914] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:19:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:47.256725 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41863066-db80-4011-9249-4b845152ad33 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:47.272708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:47.323162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b7e01-8bce-41b1-a74e-2da3503c95f5 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:47.359714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aa4d5-562a-4102-9c85-029a4f8cc5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:47.360339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aa4d5-562a-4102-9c85-029a4f8cc5ea None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:47.360622 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aa4d5-562a-4102-9c85-029a4f8cc5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:47.360897 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5aa4d5-562a-4102-9c85-029a4f8cc5ea None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:47.361691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5aa4d5-562a-4102-9c85-029a4f8cc5ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:47.361947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5aa4d5-562a-4102-9c85-029a4f8cc5ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:47.363429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5aa4d5-562a-4102-9c85-029a4f8cc5ea None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:47.372939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41863066-db80-4011-9249-4b845152ad33 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:47.382154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 460/915] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:47.383307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aa4d5-562a-4102-9c85-029a4f8cc5ea None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:47.416886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dc26f-0e63-47c7-b238-7f8f601650c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:47.417890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dc26f-0e63-47c7-b238-7f8f601650c3 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:47.418558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dc26f-0e63-47c7-b238-7f8f601650c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:47.419149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dc26f-0e63-47c7-b238-7f8f601650c3 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:47.420053 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dc26f-0e63-47c7-b238-7f8f601650c3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:47.420561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dc26f-0e63-47c7-b238-7f8f601650c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:47.422225 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dc26f-0e63-47c7-b238-7f8f601650c3 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:47.428339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:47.434154 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 456/916] 10.222.0.60 () {56 vars in 1114 bytes} [Thu Aug 4 02:19:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:47.434990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dc26f-0e63-47c7-b238-7f8f601650c3 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:47.492526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5aa4d5-562a-4102-9c85-029a4f8cc5ea None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:47.519079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:47.528355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97e062-2fd5-418d-89c2-13ffd7a9ee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:47.528970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97e062-2fd5-418d-89c2-13ffd7a9ee56 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:47.530738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97e062-2fd5-418d-89c2-13ffd7a9ee56 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:47.530738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97e062-2fd5-418d-89c2-13ffd7a9ee56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:47.530738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97e062-2fd5-418d-89c2-13ffd7a9ee56 None admin] RBAC: Adding query filter params (role.id=1de5c22423df4a2982b137a938cdd3d9, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=fb334753d1f34e41a450961dfb5f2075) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:47.530738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97e062-2fd5-418d-89c2-13ffd7a9ee56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:47.532353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97e062-2fd5-418d-89c2-13ffd7a9ee56 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:47.546587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 461/917] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:47 2022] GET /identity/v3/role_assignments?user.id=fb334753d1f34e41a450961dfb5f2075&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=1de5c22423df4a2982b137a938cdd3d9 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:47.546587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca98ae-16ad-4988-8b47-38b9815ec39c None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:47.546587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca98ae-16ad-4988-8b47-38b9815ec39c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:47.546587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca98ae-16ad-4988-8b47-38b9815ec39c None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:47.546976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dc26f-0e63-47c7-b238-7f8f601650c3 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:47.547081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 462/918] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:47.549205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1280c-07c6-4258-acc9-3be71b46df16 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:47.549491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1280c-07c6-4258-acc9-3be71b46df16 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:47.550783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1280c-07c6-4258-acc9-3be71b46df16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:47.580519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-cef1280c-07c6-4258-acc9-3be71b46df16 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:47.582156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cef1280c-07c6-4258-acc9-3be71b46df16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:47.593511 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fd72d-3288-4268-b927-bb4784708bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:47.594157 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fd72d-3288-4268-b927-bb4784708bf2 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:47.594515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fd72d-3288-4268-b927-bb4784708bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:47.594801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fd72d-3288-4268-b927-bb4784708bf2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:47.595559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fd72d-3288-4268-b927-bb4784708bf2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:47.597039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fd72d-3288-4268-b927-bb4784708bf2 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:47.667961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 463/919] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:19:47.692579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1280c-07c6-4258-acc9-3be71b46df16 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:47.695175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 457/920] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:19:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:19:47.742227 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:47.829819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1280c-07c6-4258-acc9-3be71b46df16 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:47.878259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f54e32-2e58-4664-a8c7-0fb30707502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:47.878964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f54e32-2e58-4664-a8c7-0fb30707502e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:47.879219 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f54e32-2e58-4664-a8c7-0fb30707502e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:47.879489 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f54e32-2e58-4664-a8c7-0fb30707502e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:47.880329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f54e32-2e58-4664-a8c7-0fb30707502e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:47.881706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f54e32-2e58-4664-a8c7-0fb30707502e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-53f54e32-2e58-4664-a8c7-0fb30707502e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:47.891042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:47.892530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:47.893623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 464/921] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Aug 4 02:19:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:47.899535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fd72d-3288-4268-b927-bb4784708bf2 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:48.012283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fd72d-3288-4268-b927-bb4784708bf2 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:48.042903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:48.051157 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101c65b-56a5-4b31-ae01-3fea445dd16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:48.052284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101c65b-56a5-4b31-ae01-3fea445dd16d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:48.052581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101c65b-56a5-4b31-ae01-3fea445dd16d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:48.052854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101c65b-56a5-4b31-ae01-3fea445dd16d None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:48.053541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101c65b-56a5-4b31-ae01-3fea445dd16d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:48.053844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101c65b-56a5-4b31-ae01-3fea445dd16d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:48.055325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101c65b-56a5-4b31-ae01-3fea445dd16d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:48.061230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 458/922] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Aug 4 02:19:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:48.066923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f54e32-2e58-4664-a8c7-0fb30707502e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:48.176172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:48.181835 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f54e32-2e58-4664-a8c7-0fb30707502e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:48.217864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed9cce-0d84-41e8-bd14-46450f7dd14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:48.218514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed9cce-0d84-41e8-bd14-46450f7dd14c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:48.218792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed9cce-0d84-41e8-bd14-46450f7dd14c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:48.219062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed9cce-0d84-41e8-bd14-46450f7dd14c None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:48.219737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed9cce-0d84-41e8-bd14-46450f7dd14c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:48.220039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed9cce-0d84-41e8-bd14-46450f7dd14c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:48.221401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed9cce-0d84-41e8-bd14-46450f7dd14c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:48.226673 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 465/923] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Aug 4 02:19:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:48.232656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101c65b-56a5-4b31-ae01-3fea445dd16d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:48.237361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ff35-21cb-47e5-af4c-8182d54b4f3a None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:48.237658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ff35-21cb-47e5-af4c-8182d54b4f3a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:48.237942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ff35-21cb-47e5-af4c-8182d54b4f3a None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:48.240211 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 466/924] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:48.245420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59143676-4174-4472-945d-a3fd9d8f5c2d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:48.245709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59143676-4174-4472-945d-a3fd9d8f5c2d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:48.245992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59143676-4174-4472-945d-a3fd9d8f5c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:48.265011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-59143676-4174-4472-945d-a3fd9d8f5c2d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:48.266282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-59143676-4174-4472-945d-a3fd9d8f5c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:48.350631 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 467/925] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:19:48.353879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101c65b-56a5-4b31-ae01-3fea445dd16d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:48.365989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59143676-4174-4472-945d-a3fd9d8f5c2d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:48.390370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c489d1b-d0dc-4426-925e-193313d65811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:48.391028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c489d1b-d0dc-4426-925e-193313d65811 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:48.391315 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c489d1b-d0dc-4426-925e-193313d65811 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:48.391591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c489d1b-d0dc-4426-925e-193313d65811 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:48.392347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c489d1b-d0dc-4426-925e-193313d65811 None admin] RBAC: Adding query filter params (interface=public, service_id=368bb92c6454477eb532a140f6761733, region_id=RegionOne) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:48.392658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c489d1b-d0dc-4426-925e-193313d65811 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:48.394151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c489d1b-d0dc-4426-925e-193313d65811 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:48.402461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 459/926] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Aug 4 02:19:48 2022] GET /identity/v3/endpoints?service_id=368bb92c6454477eb532a140f6761733&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:48.407889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c489d1b-d0dc-4426-925e-193313d65811 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:48.465258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:48.471756 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:48.474248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59143676-4174-4472-945d-a3fd9d8f5c2d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:48.510221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaecab-5e3d-432b-b432-c11b2ec0f94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:48.511058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaecab-5e3d-432b-b432-c11b2ec0f94a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:48.511345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaecab-5e3d-432b-b432-c11b2ec0f94a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:48.511793 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaecab-5e3d-432b-b432-c11b2ec0f94a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:48.512752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaecab-5e3d-432b-b432-c11b2ec0f94a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:48.514439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaecab-5e3d-432b-b432-c11b2ec0f94a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:48.518256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c489d1b-d0dc-4426-925e-193313d65811 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-4dfaecab-5e3d-432b-b432-c11b2ec0f94a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:48.527096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:48.535412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:48.537120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 468/927] 10.222.0.60 () {56 vars in 1132 bytes} [Thu Aug 4 02:19:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:48.538139 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaecab-5e3d-432b-b432-c11b2ec0f94a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:48.561582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb666e-1bf2-46ae-ad89-c1016fbd3876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:48.562352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb666e-1bf2-46ae-ad89-c1016fbd3876 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:48.562748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb666e-1bf2-46ae-ad89-c1016fbd3876 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:48.563123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb666e-1bf2-46ae-ad89-c1016fbd3876 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:48.563879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb666e-1bf2-46ae-ad89-c1016fbd3876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:48.565453 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb666e-1bf2-46ae-ad89-c1016fbd3876 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:48.578631 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 460/928] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Aug 4 02:19:48 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:19:48.657425 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaecab-5e3d-432b-b432-c11b2ec0f94a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:48.696072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c52e-eb2c-4cc3-86cc-89ee30633a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:48.696718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c52e-eb2c-4cc3-86cc-89ee30633a6e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:48.697005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c52e-eb2c-4cc3-86cc-89ee30633a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:48.697282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c52e-eb2c-4cc3-86cc-89ee30633a6e None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:48.697982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854c52e-eb2c-4cc3-86cc-89ee30633a6e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:48.698292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854c52e-eb2c-4cc3-86cc-89ee30633a6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:48.699743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854c52e-eb2c-4cc3-86cc-89ee30633a6e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:48.710740 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 469/929] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Aug 4 02:19:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:48.712145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb666e-1bf2-46ae-ad89-c1016fbd3876 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:48.824002 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb666e-1bf2-46ae-ad89-c1016fbd3876 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:48.849026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:48.860088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749d986-a587-4672-bbdc-e145f0e0af34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:48.860710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749d986-a587-4672-bbdc-e145f0e0af34 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:48.860996 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749d986-a587-4672-bbdc-e145f0e0af34 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:48.864708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749d986-a587-4672-bbdc-e145f0e0af34 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:48.864708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749d986-a587-4672-bbdc-e145f0e0af34 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:48.864708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749d986-a587-4672-bbdc-e145f0e0af34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:48.864708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749d986-a587-4672-bbdc-e145f0e0af34 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:48.874170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 461/930] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Aug 4 02:19:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:48.875591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c52e-eb2c-4cc3-86cc-89ee30633a6e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:48.900005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:48.986276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c52e-eb2c-4cc3-86cc-89ee30633a6e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:49.023551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cc515-3dd3-4bb2-a6ff-dc7950b8888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:49.024175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cc515-3dd3-4bb2-a6ff-dc7950b8888f None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:49.024459 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cc515-3dd3-4bb2-a6ff-dc7950b8888f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:49.024736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cc515-3dd3-4bb2-a6ff-dc7950b8888f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:49.025442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cc515-3dd3-4bb2-a6ff-dc7950b8888f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:49.026892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cc515-3dd3-4bb2-a6ff-dc7950b8888f None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:49.141348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 470/931] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:19:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:19:49.667538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3a4f3-ebbd-4de0-990c-9544934dc73b None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:49.668208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3a4f3-ebbd-4de0-990c-9544934dc73b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:49.668208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3a4f3-ebbd-4de0-990c-9544934dc73b None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:49.669699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 462/932] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:49.674910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637763-92bc-4e74-b6aa-f15b779a8a06 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:49.675208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637763-92bc-4e74-b6aa-f15b779a8a06 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:49.675485 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637763-92bc-4e74-b6aa-f15b779a8a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:49.695731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-5e637763-92bc-4e74-b6aa-f15b779a8a06 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:49.696919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5e637763-92bc-4e74-b6aa-f15b779a8a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:49.767786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:49.774615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 471/933] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:49.797342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3a4f3-ebbd-4de0-990c-9544934dc73b None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:49.903971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3a4f3-ebbd-4de0-990c-9544934dc73b None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:49.928392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a1d47-9d25-4ffe-927e-7cdcb3fe015b None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:49.929308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a1d47-9d25-4ffe-927e-7cdcb3fe015b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:49.929799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a1d47-9d25-4ffe-927e-7cdcb3fe015b None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:49.931670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 472/934] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:49.936844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf77ef8-2155-4ae6-b363-e98703864d5d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:49.937362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf77ef8-2155-4ae6-b363-e98703864d5d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:49.937847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf77ef8-2155-4ae6-b363-e98703864d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:49.945395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbef33-5d90-4ebd-ad06-52a97f78ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:49.946042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbef33-5d90-4ebd-ad06-52a97f78ba9b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:49.946328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbef33-5d90-4ebd-ad06-52a97f78ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:49.946652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbef33-5d90-4ebd-ad06-52a97f78ba9b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:49.958426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbef33-5d90-4ebd-ad06-52a97f78ba9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:49.961222 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-9bf77ef8-2155-4ae6-b363-e98703864d5d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:49.963196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9bf77ef8-2155-4ae6-b363-e98703864d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-13bbef33-5d90-4ebd-ad06-52a97f78ba9b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:49.963364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:49.964394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:49.965239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 463/935] 10.222.0.60 () {56 vars in 1120 bytes} [Thu Aug 4 02:19:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:49.970268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbef33-5d90-4ebd-ad06-52a97f78ba9b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:50.023081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:50.056086 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 473/936] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:50.079682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf77ef8-2155-4ae6-b363-e98703864d5d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:50.083729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbef33-5d90-4ebd-ad06-52a97f78ba9b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:50.124022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a91e06-1d40-4f41-8fe3-8a02008ccf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:50.124640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a91e06-1d40-4f41-8fe3-8a02008ccf3d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:50.124919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a91e06-1d40-4f41-8fe3-8a02008ccf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:50.125190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a91e06-1d40-4f41-8fe3-8a02008ccf3d None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:50.125901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a91e06-1d40-4f41-8fe3-8a02008ccf3d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:50.126204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a91e06-1d40-4f41-8fe3-8a02008ccf3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:50.127595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a91e06-1d40-4f41-8fe3-8a02008ccf3d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:50.137461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 464/937] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Aug 4 02:19:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:50.142816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a91e06-1d40-4f41-8fe3-8a02008ccf3d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:50.213618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf77ef8-2155-4ae6-b363-e98703864d5d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:50.251313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a91e06-1d40-4f41-8fe3-8a02008ccf3d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:50.253376 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:50.261737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167924e-e06a-4261-9f53-67c8582b4f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:50.271966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:50.272092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167924e-e06a-4261-9f53-67c8582b4f2c None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:50.272092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167924e-e06a-4261-9f53-67c8582b4f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:50.272092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167924e-e06a-4261-9f53-67c8582b4f2c None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:50.272092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167924e-e06a-4261-9f53-67c8582b4f2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:50.272092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167924e-e06a-4261-9f53-67c8582b4f2c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:50.272457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: WARNING keystone.server.flask.common [None req-0167924e-e06a-4261-9f53-67c8582b4f2c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 02:19:50.296133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385014e8-57ac-416a-b7c5-2269c03268b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:50.296786 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385014e8-57ac-416a-b7c5-2269c03268b8 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:50.297067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385014e8-57ac-416a-b7c5-2269c03268b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:50.297343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385014e8-57ac-416a-b7c5-2269c03268b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:50.310276 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385014e8-57ac-416a-b7c5-2269c03268b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:50.311806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385014e8-57ac-416a-b7c5-2269c03268b8 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-385014e8-57ac-416a-b7c5-2269c03268b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:50.326259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:50.332796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:50.333896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:50.333896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:50.333896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:50.333896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:50.333896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 465/938] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:50.333896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385014e8-57ac-416a-b7c5-2269c03268b8 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:50.336321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.sql.core [None req-0167924e-e06a-4261-9f53-67c8582b4f2c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 02:19:50.336321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 02:19:50.336321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [parameters: {'id': 'd9166fe276804d908c98cf8f1fab1fca', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 02:19:50.336321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80642) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-0167924e-e06a-4261-9f53-67c8582b4f2c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d9166fe276804d908c98cf8f1fab1fca.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d9166fe276804d908c98cf8f1fab1fca. Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application conn.query(q) Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 02:19:50.361410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application result.read() Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 04 02:19:50.362336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application next(self.gen) Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application yield resource Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application next(self.gen) Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise self.value Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application session.commit() Aug 04 02:19:50.363373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self.session.flush() Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application compat.raise_( Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 02:19:50.365000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 02:19:50.366004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application conn.query(q) Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application result.read() Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 02:19:50.372470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [parameters: {'id': 'd9166fe276804d908c98cf8f1fab1fca', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:50.375444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:50.378774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:50.381475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:50.381475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 04 02:19:50.381475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 04 02:19:50.381475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:50.381475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:50.381475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 04 02:19:50.381475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 04 02:19:50.381475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d9166fe276804d908c98cf8f1fab1fca. Aug 04 02:19:50.381475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:50.381475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 474/939] 10.222.0.60 () {60 vars in 1140 bytes} [Thu Aug 4 02:19:50 2022] POST /identity/v3/projects => generated 262 bytes in 286 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:50.381475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167924e-e06a-4261-9f53-67c8582b4f2c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:50.468514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385014e8-57ac-416a-b7c5-2269c03268b8 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:50.488993 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167924e-e06a-4261-9f53-67c8582b4f2c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:50.507369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b53c1-9b00-4cee-9a14-b5211c9cfdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:50.508338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b53c1-9b00-4cee-9a14-b5211c9cfdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:50.508842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b53c1-9b00-4cee-9a14-b5211c9cfdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:50.509331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b53c1-9b00-4cee-9a14-b5211c9cfdc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:50.510372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b53c1-9b00-4cee-9a14-b5211c9cfdc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:50.510947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b53c1-9b00-4cee-9a14-b5211c9cfdc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:50.512716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b53c1-9b00-4cee-9a14-b5211c9cfdc8 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:50.525350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad69ac-8425-49b4-9ee5-76ad89bbc029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:50.525988 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad69ac-8425-49b4-9ee5-76ad89bbc029 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:50.526277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad69ac-8425-49b4-9ee5-76ad89bbc029 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:50.526604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad69ac-8425-49b4-9ee5-76ad89bbc029 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:50.532891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 466/940] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:50.533607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad69ac-8425-49b4-9ee5-76ad89bbc029 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:50.534270 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b53c1-9b00-4cee-9a14-b5211c9cfdc8 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:50.535311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad69ac-8425-49b4-9ee5-76ad89bbc029 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-2dad69ac-8425-49b4-9ee5-76ad89bbc029 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:50.547663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:50.548634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:50.549570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:50.549570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:50.549570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:50.549570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:50.549570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:50.549570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:50.549570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:50.549570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:50.553632 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 475/941] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:50.554688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad69ac-8425-49b4-9ee5-76ad89bbc029 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:50.565437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:50.605565 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:50.651441 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b53c1-9b00-4cee-9a14-b5211c9cfdc8 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:50.665229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad69ac-8425-49b4-9ee5-76ad89bbc029 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:50.689833 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609908d8-56b8-41ff-a468-f5d7ea22cacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:50.691332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609908d8-56b8-41ff-a468-f5d7ea22cacb None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:50.691885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609908d8-56b8-41ff-a468-f5d7ea22cacb None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:50.692559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609908d8-56b8-41ff-a468-f5d7ea22cacb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:50.701335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609908d8-56b8-41ff-a468-f5d7ea22cacb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:50.702846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8580b7-00d3-4429-8258-37ac099c6504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:50.703496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609908d8-56b8-41ff-a468-f5d7ea22cacb None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:50.703736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8580b7-00d3-4429-8258-37ac099c6504 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:50.704116 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8580b7-00d3-4429-8258-37ac099c6504 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:50.704464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8580b7-00d3-4429-8258-37ac099c6504 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:50.705261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8580b7-00d3-4429-8258-37ac099c6504 None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:50.705641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8580b7-00d3-4429-8258-37ac099c6504 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:50.707512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8580b7-00d3-4429-8258-37ac099c6504 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-609908d8-56b8-41ff-a468-f5d7ea22cacb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:50.717799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:50.718903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:50.719893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:50.719893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:50.719893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:50.719893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:50.719893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:50.719893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:50.719893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:50.719893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:50.719893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:19:50.719893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:50.721934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 467/942] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Aug 4 02:19:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:50.724079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a851b07-80b1-437c-ab16-8d05acddbc6a None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:50.724544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a851b07-80b1-437c-ab16-8d05acddbc6a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:50.724962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a851b07-80b1-437c-ab16-8d05acddbc6a None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:50.726625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 468/943] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:50.729310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a851b07-80b1-437c-ab16-8d05acddbc6a None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:50.734592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 476/944] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:19:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:50.736164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a721df7-12c3-4f3e-b45e-adf9c053515c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:50.736466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a721df7-12c3-4f3e-b45e-adf9c053515c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:50.736812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a721df7-12c3-4f3e-b45e-adf9c053515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:50.760499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-4a721df7-12c3-4f3e-b45e-adf9c053515c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:50.762242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4a721df7-12c3-4f3e-b45e-adf9c053515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:50.831110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:50.852337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a851b07-80b1-437c-ab16-8d05acddbc6a None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:50.870767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 477/945] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:50.895974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a721df7-12c3-4f3e-b45e-adf9c053515c None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:50.903244 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7c4e3-aef2-435a-9033-689547070805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:50.903940 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7c4e3-aef2-435a-9033-689547070805 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:50.904228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7c4e3-aef2-435a-9033-689547070805 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:50.904511 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7c4e3-aef2-435a-9033-689547070805 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:50.905382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7c4e3-aef2-435a-9033-689547070805 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:50.905696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7c4e3-aef2-435a-9033-689547070805 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:50.907369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7c4e3-aef2-435a-9033-689547070805 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:50.927987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 469/946] 10.222.0.60 () {56 vars in 1149 bytes} [Thu Aug 4 02:19:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:50.936495 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7c4e3-aef2-435a-9033-689547070805 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:50.950287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:51.037735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a721df7-12c3-4f3e-b45e-adf9c053515c None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:51.071949 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7c4e3-aef2-435a-9033-689547070805 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:51.087731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dde3b-01a7-464a-a8e4-fe157d1b335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:51.088388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dde3b-01a7-464a-a8e4-fe157d1b335c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:51.088674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dde3b-01a7-464a-a8e4-fe157d1b335c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:51.088953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dde3b-01a7-464a-a8e4-fe157d1b335c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:51.089593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dde3b-01a7-464a-a8e4-fe157d1b335c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:51.091024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dde3b-01a7-464a-a8e4-fe157d1b335c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-fe2dde3b-01a7-464a-a8e4-fe157d1b335c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:51.100855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:51.101924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:51.102808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:51.106600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 478/947] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Aug 4 02:19:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:51.108393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dde3b-01a7-464a-a8e4-fe157d1b335c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:51.115419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebf08e-61db-4ed8-9167-3086ee705764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:51.116074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebf08e-61db-4ed8-9167-3086ee705764 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:51.116355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebf08e-61db-4ed8-9167-3086ee705764 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:51.116632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebf08e-61db-4ed8-9167-3086ee705764 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:51.128749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:51.132640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebf08e-61db-4ed8-9167-3086ee705764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:51.134125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebf08e-61db-4ed8-9167-3086ee705764 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-11ebf08e-61db-4ed8-9167-3086ee705764 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:51.150045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:51.151020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:51.152012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:51.152012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:51.152012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:51.152012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:51.155933 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 470/948] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:51.157224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebf08e-61db-4ed8-9167-3086ee705764 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:51.251296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:51.254249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dde3b-01a7-464a-a8e4-fe157d1b335c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:51.274242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebf08e-61db-4ed8-9167-3086ee705764 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:51.296322 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14917ac4-98fe-4cc3-8e0d-7c4419343e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:51.296870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14917ac4-98fe-4cc3-8e0d-7c4419343e6b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:51.297162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14917ac4-98fe-4cc3-8e0d-7c4419343e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:51.297440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14917ac4-98fe-4cc3-8e0d-7c4419343e6b None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:51.298120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14917ac4-98fe-4cc3-8e0d-7c4419343e6b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:51.298429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14917ac4-98fe-4cc3-8e0d-7c4419343e6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:51.299844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14917ac4-98fe-4cc3-8e0d-7c4419343e6b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:51.310647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 479/949] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Aug 4 02:19:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:51.310647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786894fc-a9b6-498f-9450-4d9a4eed7c38 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:51.310647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786894fc-a9b6-498f-9450-4d9a4eed7c38 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:51.310647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786894fc-a9b6-498f-9450-4d9a4eed7c38 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:51.311263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 480/950] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:51.314776 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab139e24-9d2f-466d-9bb9-745b8c9e2ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:51.315636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab139e24-9d2f-466d-9bb9-745b8c9e2ece None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:51.315922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab139e24-9d2f-466d-9bb9-745b8c9e2ece None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:51.316036 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786894fc-a9b6-498f-9450-4d9a4eed7c38 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:51.316197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab139e24-9d2f-466d-9bb9-745b8c9e2ece None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:51.316892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab139e24-9d2f-466d-9bb9-745b8c9e2ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:51.317295 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab139e24-9d2f-466d-9bb9-745b8c9e2ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:51.321128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab139e24-9d2f-466d-9bb9-745b8c9e2ece None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:51.336760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 471/951] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:51.338255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887e864-d95f-4b56-a7c2-62e11484e378 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:51.338564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887e864-d95f-4b56-a7c2-62e11484e378 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:51.338843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887e864-d95f-4b56-a7c2-62e11484e378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:51.358660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-1887e864-d95f-4b56-a7c2-62e11484e378 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:51.359869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1887e864-d95f-4b56-a7c2-62e11484e378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:51.410151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:51.431392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 472/952] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:51.432338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887e864-d95f-4b56-a7c2-62e11484e378 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:51.443782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786894fc-a9b6-498f-9450-4d9a4eed7c38 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:51.481926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c14bb-ad46-4d55-ba15-6e880d01f050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:51.482626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c14bb-ad46-4d55-ba15-6e880d01f050 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:51.482916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c14bb-ad46-4d55-ba15-6e880d01f050 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:51.483200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c14bb-ad46-4d55-ba15-6e880d01f050 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:51.483874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c14bb-ad46-4d55-ba15-6e880d01f050 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:51.484182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c14bb-ad46-4d55-ba15-6e880d01f050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:51.485568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c14bb-ad46-4d55-ba15-6e880d01f050 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:51.492035 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 481/953] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Aug 4 02:19:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:51.492843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c14bb-ad46-4d55-ba15-6e880d01f050 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:51.525014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:51.545656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887e864-d95f-4b56-a7c2-62e11484e378 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:51.583650 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f1c0e-b4e7-4e4b-ad49-eebc809c5aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:51.584305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f1c0e-b4e7-4e4b-ad49-eebc809c5aaf None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:51.584596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f1c0e-b4e7-4e4b-ad49-eebc809c5aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:51.584877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f1c0e-b4e7-4e4b-ad49-eebc809c5aaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:51.591931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f1c0e-b4e7-4e4b-ad49-eebc809c5aaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:51.593392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f1c0e-b4e7-4e4b-ad49-eebc809c5aaf None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:51.601505 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c14bb-ad46-4d55-ba15-6e880d01f050 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-135f1c0e-b4e7-4e4b-ad49-eebc809c5aaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:51.606087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:51.607229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:51.613688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:51.613688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:51.613688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:51.613688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:51.613688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:51.613688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:51.613688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:51.613688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:51.613688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 473/954] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:51.613688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f1c0e-b4e7-4e4b-ad49-eebc809c5aaf None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:51.643566 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787edb4-c927-462e-802e-9b753ae9dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:51.644292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787edb4-c927-462e-802e-9b753ae9dba2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:51.644626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787edb4-c927-462e-802e-9b753ae9dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:51.644905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787edb4-c927-462e-802e-9b753ae9dba2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:51.645586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787edb4-c927-462e-802e-9b753ae9dba2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:51.646984 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787edb4-c927-462e-802e-9b753ae9dba2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:51.655552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-1787edb4-c927-462e-802e-9b753ae9dba2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:51.655869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:51.656870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:51.657765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 482/955] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:51.659162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787edb4-c927-462e-802e-9b753ae9dba2 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:51.725764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f1c0e-b4e7-4e4b-ad49-eebc809c5aaf None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:51.761156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154d6f9-71a3-4c0a-b86d-a4a0e7e8e7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:51.761379 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:51.762181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154d6f9-71a3-4c0a-b86d-a4a0e7e8e7bf None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:51.762683 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154d6f9-71a3-4c0a-b86d-a4a0e7e8e7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:51.762969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154d6f9-71a3-4c0a-b86d-a4a0e7e8e7bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:51.763751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154d6f9-71a3-4c0a-b86d-a4a0e7e8e7bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:51.765125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154d6f9-71a3-4c0a-b86d-a4a0e7e8e7bf None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:51.770827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787edb4-c927-462e-802e-9b753ae9dba2 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:51.805788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9154e5-4f69-4017-b2fa-1478c30df29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:51.806408 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9154e5-4f69-4017-b2fa-1478c30df29e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:51.806724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9154e5-4f69-4017-b2fa-1478c30df29e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:51.807002 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9154e5-4f69-4017-b2fa-1478c30df29e None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:51.807748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9154e5-4f69-4017-b2fa-1478c30df29e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:51.808309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9154e5-4f69-4017-b2fa-1478c30df29e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:51.809757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9154e5-4f69-4017-b2fa-1478c30df29e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:51.821558 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 483/956] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:51.822402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9154e5-4f69-4017-b2fa-1478c30df29e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:51.855178 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 474/957] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:19:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:19:51.867635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154d6f9-71a3-4c0a-b86d-a4a0e7e8e7bf None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:51.949433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9154e5-4f69-4017-b2fa-1478c30df29e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:52.010626 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:52.012353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea1cfe-5a47-4dcc-91e3-e7d4ace27ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:52.013760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1cfe-5a47-4dcc-91e3-e7d4ace27ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:52.014210 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1cfe-5a47-4dcc-91e3-e7d4ace27ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:52.014762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1cfe-5a47-4dcc-91e3-e7d4ace27ee8 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:52.015675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea1cfe-5a47-4dcc-91e3-e7d4ace27ee8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:52.015803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154d6f9-71a3-4c0a-b86d-a4a0e7e8e7bf None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:52.016240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea1cfe-5a47-4dcc-91e3-e7d4ace27ee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:52.018069 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea1cfe-5a47-4dcc-91e3-e7d4ace27ee8 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:52.027072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 484/958] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:19:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:52.033063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea1cfe-5a47-4dcc-91e3-e7d4ace27ee8 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:52.057435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:52.070429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb14991-466c-4371-ae2f-b7538c7acf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:52.071211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb14991-466c-4371-ae2f-b7538c7acf23 None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:52.071499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb14991-466c-4371-ae2f-b7538c7acf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:52.071838 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb14991-466c-4371-ae2f-b7538c7acf23 None admin] PATH_INFO: `/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/fb334753d1f34e41a450961dfb5f2075/roles/1de5c22423df4a2982b137a938cdd3d9` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:52.074032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb14991-466c-4371-ae2f-b7538c7acf23 None admin] RBAC: Authorizing `identity:create_grant(project_id=fae65363f2fb415b834ac367a6c4b7ad, user_id=fb334753d1f34e41a450961dfb5f2075, role_id=1de5c22423df4a2982b137a938cdd3d9)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:52.075804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb14991-466c-4371-ae2f-b7538c7acf23 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:52.136371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 475/959] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:19:51 2022] PUT /identity/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/fb334753d1f34e41a450961dfb5f2075/roles/1de5c22423df4a2982b137a938cdd3d9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:19:52.162480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea1cfe-5a47-4dcc-91e3-e7d4ace27ee8 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:52.198933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8c8ab-1caa-4cd8-81a9-a64e43072ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:52.199616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8c8ab-1caa-4cd8-81a9-a64e43072ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:52.199905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8c8ab-1caa-4cd8-81a9-a64e43072ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:52.200179 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8c8ab-1caa-4cd8-81a9-a64e43072ed2 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:52.200868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8c8ab-1caa-4cd8-81a9-a64e43072ed2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:52.201172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8c8ab-1caa-4cd8-81a9-a64e43072ed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:52.202628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8c8ab-1caa-4cd8-81a9-a64e43072ed2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:52.208767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 485/960] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:19:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:52.918775 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bc76c-a33b-4b72-b9f4-5451bf9ec1a1 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:52.919319 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bc76c-a33b-4b72-b9f4-5451bf9ec1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:52.919319 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bc76c-a33b-4b72-b9f4-5451bf9ec1a1 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:52.920978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 476/961] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:52.926055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd13ff-49d3-434b-aaa6-a983dd55b2b3 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:52.926401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd13ff-49d3-434b-aaa6-a983dd55b2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:52.926780 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd13ff-49d3-434b-aaa6-a983dd55b2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:52.945126 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b5fd13ff-49d3-434b-aaa6-a983dd55b2b3 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:52.946337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b5fd13ff-49d3-434b-aaa6-a983dd55b2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:53.016784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 486/962] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:53.041232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bc76c-a33b-4b72-b9f4-5451bf9ec1a1 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:53.153981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bc76c-a33b-4b72-b9f4-5451bf9ec1a1 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:53.191584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93dd1b-e921-4fe5-9dbf-f92e6d09cbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:53.192160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93dd1b-e921-4fe5-9dbf-f92e6d09cbc3 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:53.192455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93dd1b-e921-4fe5-9dbf-f92e6d09cbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:53.192729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93dd1b-e921-4fe5-9dbf-f92e6d09cbc3 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:53.193520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93dd1b-e921-4fe5-9dbf-f92e6d09cbc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:53.195013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93dd1b-e921-4fe5-9dbf-f92e6d09cbc3 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:53.197559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: WARNING keystone.server.flask.common [None req-2f93dd1b-e921-4fe5-9dbf-f92e6d09cbc3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 02:19:53.241076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.sql.core [None req-2f93dd1b-e921-4fe5-9dbf-f92e6d09cbc3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 02:19:53.241076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 02:19:53.241076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [parameters: {'user_id': 'fe1a3c0d8e8a488f9271611fffb8d0fe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 02:19:53.241076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80641) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-2f93dd1b-e921-4fe5-9dbf-f92e6d09cbc3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application conn.query(q) Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application result.read() Aug 04 02:19:53.248004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 02:19:53.248883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application next(self.gen) Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application yield resource Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application next(self.gen) Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise self.value Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application session.commit() Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 02:19:53.249875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self.session.flush() Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application compat.raise_( Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 02:19:53.251689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 02:19:53.253798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application conn.query(q) Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application result.read() Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 02:19:53.255947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fe1a3c0d8e8a488f9271611fffb8d0fe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:53.257942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 04 02:19:53.259902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 04 02:19:53.262041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 04 02:19:53.262041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 04 02:19:53.262041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 02:19:53.262041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 02:19:53.262041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 02:19:53.262041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:53.262041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 477/963] 10.222.0.60 () {60 vars in 1131 bytes} [Thu Aug 4 02:19:53 2022] POST /identity/v3/users => generated 160 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:53.263004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd13ff-49d3-434b-aaa6-a983dd55b2b3 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:53.265351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:53.370262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd13ff-49d3-434b-aaa6-a983dd55b2b3 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:53.408709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2192e-06e6-4ee6-8105-34357f986ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:53.409732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2192e-06e6-4ee6-8105-34357f986ddf None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:53.410262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2192e-06e6-4ee6-8105-34357f986ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:53.411501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2192e-06e6-4ee6-8105-34357f986ddf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:53.419421 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2192e-06e6-4ee6-8105-34357f986ddf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:53.421151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2192e-06e6-4ee6-8105-34357f986ddf None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-dca2192e-06e6-4ee6-8105-34357f986ddf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:53.436374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:53.437614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:53.438605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:53.438605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:53.438605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:53.438605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:53.438605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:53.438605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:53.438605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:53.438605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:53.438605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:19:53.438605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:53.442784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 487/964] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:19:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:53.452644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93dd1b-e921-4fe5-9dbf-f92e6d09cbc3 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:53.478662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:53.586614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93dd1b-e921-4fe5-9dbf-f92e6d09cbc3 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:53.633448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0be50-6821-4ea0-b715-f5bdac0a5fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:53.634187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0be50-6821-4ea0-b715-f5bdac0a5fac None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:53.634476 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0be50-6821-4ea0-b715-f5bdac0a5fac None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:53.634779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0be50-6821-4ea0-b715-f5bdac0a5fac None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:53.635558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0be50-6821-4ea0-b715-f5bdac0a5fac None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:53.635863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0be50-6821-4ea0-b715-f5bdac0a5fac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:53.637524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0be50-6821-4ea0-b715-f5bdac0a5fac None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:53.688692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 478/965] 10.222.0.60 () {56 vars in 1101 bytes} [Thu Aug 4 02:19:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:54.072809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803f9f-5683-408b-9048-fc20207e0ae0 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.073350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803f9f-5683-408b-9048-fc20207e0ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.073350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803f9f-5683-408b-9048-fc20207e0ae0 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.074897 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 488/966] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:54.080126 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137e6c1-8d2a-45d5-b982-1ae6d8702e63 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.080546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137e6c1-8d2a-45d5-b982-1ae6d8702e63 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.080753 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137e6c1-8d2a-45d5-b982-1ae6d8702e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.101197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c137e6c1-8d2a-45d5-b982-1ae6d8702e63 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:54.102869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c137e6c1-8d2a-45d5-b982-1ae6d8702e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:54.181207 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 479/967] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:54.204090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b803f9f-5683-408b-9048-fc20207e0ae0 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:54.271778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:54.274248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108d98f-1799-41aa-8445-28dee5b4df10 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.274574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108d98f-1799-41aa-8445-28dee5b4df10 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.274860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108d98f-1799-41aa-8445-28dee5b4df10 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.276385 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 480/968] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:19:54.281732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72654e0-889e-419a-93a1-79e370b434a2 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.286906 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72654e0-889e-419a-93a1-79e370b434a2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.286906 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72654e0-889e-419a-93a1-79e370b434a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.303893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c72654e0-889e-419a-93a1-79e370b434a2 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:54.305119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c72654e0-889e-419a-93a1-79e370b434a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:54.307190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:54.313451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b803f9f-5683-408b-9048-fc20207e0ae0 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:54.348946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43333b6c-2a9d-4572-8976-e56ed05aaa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:54.349597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43333b6c-2a9d-4572-8976-e56ed05aaa4d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.349880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43333b6c-2a9d-4572-8976-e56ed05aaa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.350158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43333b6c-2a9d-4572-8976-e56ed05aaa4d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.350817 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43333b6c-2a9d-4572-8976-e56ed05aaa4d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:54.352205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43333b6c-2a9d-4572-8976-e56ed05aaa4d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-43333b6c-2a9d-4572-8976-e56ed05aaa4d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:54.361226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:54.362209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:54.363137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 489/969] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Aug 4 02:19:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:54.368714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43333b6c-2a9d-4572-8976-e56ed05aaa4d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:54.382876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 481/970] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:19:54.405960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72654e0-889e-419a-93a1-79e370b434a2 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:54.478317 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43333b6c-2a9d-4572-8976-e56ed05aaa4d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:54.506666 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72654e0-889e-419a-93a1-79e370b434a2 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:54.507780 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:54.513389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e6c6b-0e04-454f-b37f-d78190d7eecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:54.514015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e6c6b-0e04-454f-b37f-d78190d7eecb None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.514333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e6c6b-0e04-454f-b37f-d78190d7eecb None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.514654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e6c6b-0e04-454f-b37f-d78190d7eecb None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.521579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e6c6b-0e04-454f-b37f-d78190d7eecb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:54.521579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e6c6b-0e04-454f-b37f-d78190d7eecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:54.521579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e6c6b-0e04-454f-b37f-d78190d7eecb None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:54.522414 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 490/971] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Aug 4 02:19:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:54.523643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee24903-1e3d-48b9-ab49-d93b40ff6ac7 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.523923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee24903-1e3d-48b9-ab49-d93b40ff6ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.524194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee24903-1e3d-48b9-ab49-d93b40ff6ac7 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.525598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 491/972] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:54.527961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee24903-1e3d-48b9-ab49-d93b40ff6ac7 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:54.543735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c70f14-370d-419e-a1aa-5e6021cbced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:54.544391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c70f14-370d-419e-a1aa-5e6021cbced9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.544678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c70f14-370d-419e-a1aa-5e6021cbced9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.544954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c70f14-370d-419e-a1aa-5e6021cbced9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.552525 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:54.556285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c70f14-370d-419e-a1aa-5e6021cbced9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-e0c70f14-370d-419e-a1aa-5e6021cbced9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:19:54.561434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:54.569504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 482/973] 10.222.0.60 () {56 vars in 1120 bytes} [Thu Aug 4 02:19:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:54.570581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecc5f4-d623-4911-8a43-386d6abadd84 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.571520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecc5f4-d623-4911-8a43-386d6abadd84 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.571520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecc5f4-d623-4911-8a43-386d6abadd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.583365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-32ecc5f4-d623-4911-8a43-386d6abadd84 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:54.585160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-32ecc5f4-d623-4911-8a43-386d6abadd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:54.639514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee24903-1e3d-48b9-ab49-d93b40ff6ac7 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:54.666512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 483/974] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:54.666512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecc5f4-d623-4911-8a43-386d6abadd84 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:54.676970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f4366-c2ac-45e7-bedc-f1c68f5bd700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:54.677597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f4366-c2ac-45e7-bedc-f1c68f5bd700 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.677883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f4366-c2ac-45e7-bedc-f1c68f5bd700 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.678165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f4366-c2ac-45e7-bedc-f1c68f5bd700 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.678988 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f4366-c2ac-45e7-bedc-f1c68f5bd700 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:54.679298 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f4366-c2ac-45e7-bedc-f1c68f5bd700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:54.680682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f4366-c2ac-45e7-bedc-f1c68f5bd700 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:54.685728 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 492/975] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Aug 4 02:19:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:54.686558 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f4366-c2ac-45e7-bedc-f1c68f5bd700 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:54.747670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:54.753782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecc5f4-d623-4911-8a43-386d6abadd84 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:54.780872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:54.788763 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e439a-18a0-42d8-9504-81d487c68d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:54.789435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e439a-18a0-42d8-9504-81d487c68d3f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.789552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f4366-c2ac-45e7-bedc-f1c68f5bd700 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:54.789724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e439a-18a0-42d8-9504-81d487c68d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.790003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e439a-18a0-42d8-9504-81d487c68d3f None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.790756 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e439a-18a0-42d8-9504-81d487c68d3f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:54.791068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e439a-18a0-42d8-9504-81d487c68d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:54.792456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e439a-18a0-42d8-9504-81d487c68d3f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:54.801533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 484/976] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Aug 4 02:19:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:54.808803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e439a-18a0-42d8-9504-81d487c68d3f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:54.828466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045c9a2-7d21-4ec3-b042-35ea9afda7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:54.829088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045c9a2-7d21-4ec3-b042-35ea9afda7d7 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.829433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045c9a2-7d21-4ec3-b042-35ea9afda7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.829692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045c9a2-7d21-4ec3-b042-35ea9afda7d7 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.837105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045c9a2-7d21-4ec3-b042-35ea9afda7d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:54.837105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045c9a2-7d21-4ec3-b042-35ea9afda7d7 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:54.901136 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e439a-18a0-42d8-9504-81d487c68d3f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:54.916564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 493/977] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:19:54 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:19:54.917456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045c9a2-7d21-4ec3-b042-35ea9afda7d7 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:54.953950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a1ef7-af18-420f-9538-af7334546963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:54.955618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a1ef7-af18-420f-9538-af7334546963 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:54.956098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a1ef7-af18-420f-9538-af7334546963 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:54.956563 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a1ef7-af18-420f-9538-af7334546963 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:54.958474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a1ef7-af18-420f-9538-af7334546963 None admin] RBAC: Adding query filter params (interface=admin, service_id=368bb92c6454477eb532a140f6761733, region_id=RegionOne) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:54.959897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a1ef7-af18-420f-9538-af7334546963 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:54.961539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a1ef7-af18-420f-9538-af7334546963 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:54.973370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 485/978] 10.222.0.60 () {56 vars in 1249 bytes} [Thu Aug 4 02:19:54 2022] GET /identity/v3/endpoints?service_id=368bb92c6454477eb532a140f6761733&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:54.974688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a1ef7-af18-420f-9538-af7334546963 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:55.031155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:55.046071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045c9a2-7d21-4ec3-b042-35ea9afda7d7 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:55.066335 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:55.085718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc5bd5-ba84-41b2-93ca-7bb92a6f094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:55.086373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc5bd5-ba84-41b2-93ca-7bb92a6f094e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:55.086707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc5bd5-ba84-41b2-93ca-7bb92a6f094e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:55.087732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc5bd5-ba84-41b2-93ca-7bb92a6f094e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:55.099617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc5bd5-ba84-41b2-93ca-7bb92a6f094e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:55.101182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc5bd5-ba84-41b2-93ca-7bb92a6f094e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:55.101303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a1ef7-af18-420f-9538-af7334546963 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-2cdc5bd5-ba84-41b2-93ca-7bb92a6f094e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:55.119407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:55.120385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:55.121484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:55.121484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:55.121484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:55.121484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:55.121484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 494/979] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:55.126382 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc5bd5-ba84-41b2-93ca-7bb92a6f094e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:55.142439 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41309de1-b044-4856-a480-49256fb47e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:55.143138 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41309de1-b044-4856-a480-49256fb47e9a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:55.143421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41309de1-b044-4856-a480-49256fb47e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:55.143699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41309de1-b044-4856-a480-49256fb47e9a None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:55.144356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41309de1-b044-4856-a480-49256fb47e9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:55.146207 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41309de1-b044-4856-a480-49256fb47e9a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:55.152554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 486/980] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Aug 4 02:19:54 2022] GET /identity/v3/services => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:19:55.240014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc5bd5-ba84-41b2-93ca-7bb92a6f094e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:55.276691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5b7ad-4a10-40d4-94c6-ae49c4d0778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:55.277328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5b7ad-4a10-40d4-94c6-ae49c4d0778d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:55.277615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5b7ad-4a10-40d4-94c6-ae49c4d0778d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:55.277891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5b7ad-4a10-40d4-94c6-ae49c4d0778d None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:55.278626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5b7ad-4a10-40d4-94c6-ae49c4d0778d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:55.278939 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5b7ad-4a10-40d4-94c6-ae49c4d0778d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:55.280372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5b7ad-4a10-40d4-94c6-ae49c4d0778d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:55.294159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 495/981] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:55.299611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41309de1-b044-4856-a480-49256fb47e9a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:55.404968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41309de1-b044-4856-a480-49256fb47e9a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:55.420846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:55.442605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f454d6-e025-48d2-89f5-5b50c2672f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:55.443250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f454d6-e025-48d2-89f5-5b50c2672f4b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:55.443533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f454d6-e025-48d2-89f5-5b50c2672f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:55.443806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f454d6-e025-48d2-89f5-5b50c2672f4b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:55.451617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f454d6-e025-48d2-89f5-5b50c2672f4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:55.453166 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f454d6-e025-48d2-89f5-5b50c2672f4b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-43f454d6-e025-48d2-89f5-5b50c2672f4b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:19:55.465771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:55.467036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:55.467986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:55.467986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:55.467986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:19:55.467986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:19:55.467986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:19:55.467986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:19:55.467986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:19:55.467986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:19:55.467986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:19:55.467986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:55.467986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 487/982] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Aug 4 02:19:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:55.475131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5b7ad-4a10-40d4-94c6-ae49c4d0778d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:55.508184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:55.580307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5b7ad-4a10-40d4-94c6-ae49c4d0778d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:55.618367 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a200a65-a693-48aa-a344-a2331b4fcbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:55.619167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a200a65-a693-48aa-a344-a2331b4fcbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:55.619543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a200a65-a693-48aa-a344-a2331b4fcbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:55.619914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a200a65-a693-48aa-a344-a2331b4fcbe4 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:55.620799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a200a65-a693-48aa-a344-a2331b4fcbe4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:55.621206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a200a65-a693-48aa-a344-a2331b4fcbe4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:55.622763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a200a65-a693-48aa-a344-a2331b4fcbe4 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:55.640817 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 496/983] 10.222.0.60 () {56 vars in 1149 bytes} [Thu Aug 4 02:19:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:55.646455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f454d6-e025-48d2-89f5-5b50c2672f4b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:55.753917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f454d6-e025-48d2-89f5-5b50c2672f4b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:55.787950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c4372-efea-4d97-aa0e-35fa10fdb2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:55.788558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4372-efea-4d97-aa0e-35fa10fdb2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:55.788838 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4372-efea-4d97-aa0e-35fa10fdb2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:55.789181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4372-efea-4d97-aa0e-35fa10fdb2a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:55.831833 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:55.856461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c4372-efea-4d97-aa0e-35fa10fdb2a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:55.858008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c4372-efea-4d97-aa0e-35fa10fdb2a5 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:55.956931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 488/984] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:19:55 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:19:55.963039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a200a65-a693-48aa-a344-a2331b4fcbe4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:56.060840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:56.074702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a200a65-a693-48aa-a344-a2331b4fcbe4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:56.109971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c90d7-a5fa-43e4-a62c-48003393dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:56.110733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c90d7-a5fa-43e4-a62c-48003393dfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:56.110920 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c90d7-a5fa-43e4-a62c-48003393dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:56.111195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c90d7-a5fa-43e4-a62c-48003393dfb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:56.122169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c90d7-a5fa-43e4-a62c-48003393dfb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:56.123649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c90d7-a5fa-43e4-a62c-48003393dfb4 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-3e2c90d7-a5fa-43e4-a62c-48003393dfb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:19:56.138665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:56.139586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:56.140480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:19:56.140480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:19:56.140480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:19:56.140480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:56.140480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 497/985] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:56.146902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c4372-efea-4d97-aa0e-35fa10fdb2a5 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:56.228120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:56.252728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c4372-efea-4d97-aa0e-35fa10fdb2a5 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:56.289675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04573a67-f291-4817-ae55-283621800092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:56.290359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04573a67-f291-4817-ae55-283621800092 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:56.290678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04573a67-f291-4817-ae55-283621800092 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:56.290962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04573a67-f291-4817-ae55-283621800092 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:56.291718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04573a67-f291-4817-ae55-283621800092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:56.292034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04573a67-f291-4817-ae55-283621800092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:56.293405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04573a67-f291-4817-ae55-283621800092 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:56.310787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 489/986] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:56.311889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c90d7-a5fa-43e4-a62c-48003393dfb4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:56.414478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c90d7-a5fa-43e4-a62c-48003393dfb4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:56.449284 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e39a43-0fc0-4971-bd72-87cba1ce32dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:56.449928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e39a43-0fc0-4971-bd72-87cba1ce32dc None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:56.450214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e39a43-0fc0-4971-bd72-87cba1ce32dc None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:56.450506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e39a43-0fc0-4971-bd72-87cba1ce32dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:56.457169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e39a43-0fc0-4971-bd72-87cba1ce32dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:56.459186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e39a43-0fc0-4971-bd72-87cba1ce32dc None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:56.461685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-37e39a43-0fc0-4971-bd72-87cba1ce32dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:19:56.471333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:56.475177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:56.476089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:19:56.476089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:19:56.476089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:19:56.476089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:19:56.476089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:19:56.476089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:19:56.476089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:19:56.476089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:56.476089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 498/987] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:56.478821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04573a67-f291-4817-ae55-283621800092 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:56.579469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04573a67-f291-4817-ae55-283621800092 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:56.614466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce052e25-ffec-43b1-8852-40e6d2a8027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:56.615105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce052e25-ffec-43b1-8852-40e6d2a8027d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:56.615394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce052e25-ffec-43b1-8852-40e6d2a8027d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:56.615671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce052e25-ffec-43b1-8852-40e6d2a8027d None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:56.616429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce052e25-ffec-43b1-8852-40e6d2a8027d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:56.616737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce052e25-ffec-43b1-8852-40e6d2a8027d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:56.618184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce052e25-ffec-43b1-8852-40e6d2a8027d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:56.619888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:56.632224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 490/988] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:19:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:56.638002 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e39a43-0fc0-4971-bd72-87cba1ce32dc None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:56.744122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e39a43-0fc0-4971-bd72-87cba1ce32dc None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:56.778471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbeba45-5d31-4964-b6b7-f574005efadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:56.779114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbeba45-5d31-4964-b6b7-f574005efadd None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:56.783617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbeba45-5d31-4964-b6b7-f574005efadd None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:56.783617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbeba45-5d31-4964-b6b7-f574005efadd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:56.783617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbeba45-5d31-4964-b6b7-f574005efadd None admin] RBAC: Adding query filter params (role.id=1de5c22423df4a2982b137a938cdd3d9, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=fb334753d1f34e41a450961dfb5f2075) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:56.783617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbeba45-5d31-4964-b6b7-f574005efadd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:56.783617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbeba45-5d31-4964-b6b7-f574005efadd None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:56.794522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 499/989] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:19:56 2022] GET /identity/v3/role_assignments?user.id=fb334753d1f34e41a450961dfb5f2075&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=1de5c22423df4a2982b137a938cdd3d9 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:56.977078 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470ffb-f1bc-4b86-8689-ea2b3f5d1b3b None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:56.977272 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470ffb-f1bc-4b86-8689-ea2b3f5d1b3b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:56.977585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470ffb-f1bc-4b86-8689-ea2b3f5d1b3b None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:56.979356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 491/990] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:56.984445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f69bc-8274-4e68-801f-dc0a5dfe8717 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:56.984736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f69bc-8274-4e68-801f-dc0a5dfe8717 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:56.985015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f69bc-8274-4e68-801f-dc0a5dfe8717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:57.003933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-5c9f69bc-8274-4e68-801f-dc0a5dfe8717 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:57.005569 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5c9f69bc-8274-4e68-801f-dc0a5dfe8717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:57.073712 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:57.082188 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 500/991] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:57.105127 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a470ffb-f1bc-4b86-8689-ea2b3f5d1b3b None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:57.196529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6c572-a11d-4910-97a9-d4c80773ded1 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:57.197644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6c572-a11d-4910-97a9-d4c80773ded1 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:57.197938 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6c572-a11d-4910-97a9-d4c80773ded1 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:57.199511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 501/992] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:19:57.204218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa73799-c208-4f70-95f9-a4eada152dcc None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:57.204507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa73799-c208-4f70-95f9-a4eada152dcc None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:57.204783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa73799-c208-4f70-95f9-a4eada152dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:57.216422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a470ffb-f1bc-4b86-8689-ea2b3f5d1b3b None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:57.224555 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-7aa73799-c208-4f70-95f9-a4eada152dcc None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:57.225763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7aa73799-c208-4f70-95f9-a4eada152dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:57.254840 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be4075-27c2-4583-8c9a-8f298e594b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:57.255680 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be4075-27c2-4583-8c9a-8f298e594b58 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:57.255965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be4075-27c2-4583-8c9a-8f298e594b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:57.256244 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be4075-27c2-4583-8c9a-8f298e594b58 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:57.256878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be4075-27c2-4583-8c9a-8f298e594b58 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:57.258249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be4075-27c2-4583-8c9a-8f298e594b58 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-b4be4075-27c2-4583-8c9a-8f298e594b58 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:57.267419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:57.268432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:57.271309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 492/993] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:19:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:57.275667 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be4075-27c2-4583-8c9a-8f298e594b58 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:57.305842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 502/994] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:19:57.329293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa73799-c208-4f70-95f9-a4eada152dcc None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:57.342284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:57.385509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be4075-27c2-4583-8c9a-8f298e594b58 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:57.419719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253333d-d081-40eb-ba55-cd8bcb68e82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:57.420343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253333d-d081-40eb-ba55-cd8bcb68e82a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:57.420627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253333d-d081-40eb-ba55-cd8bcb68e82a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:57.420904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253333d-d081-40eb-ba55-cd8bcb68e82a None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:57.421578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253333d-d081-40eb-ba55-cd8bcb68e82a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:57.421885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253333d-d081-40eb-ba55-cd8bcb68e82a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:57.423284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253333d-d081-40eb-ba55-cd8bcb68e82a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:57.428726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 493/995] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:19:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:57.434293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253333d-d081-40eb-ba55-cd8bcb68e82a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:57.436568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa73799-c208-4f70-95f9-a4eada152dcc None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:57.462572 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:57.474892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb72c24-8fa1-41b9-b033-97ce280a7d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:57.475469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb72c24-8fa1-41b9-b033-97ce280a7d4d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:57.475746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb72c24-8fa1-41b9-b033-97ce280a7d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:57.476017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb72c24-8fa1-41b9-b033-97ce280a7d4d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:57.476636 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb72c24-8fa1-41b9-b033-97ce280a7d4d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:57.478138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb72c24-8fa1-41b9-b033-97ce280a7d4d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-1cb72c24-8fa1-41b9-b033-97ce280a7d4d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:57.488306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:57.489967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:19:57.490871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 503/996] 10.222.0.60 () {56 vars in 1126 bytes} [Thu Aug 4 02:19:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:19:57.495916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb72c24-8fa1-41b9-b033-97ce280a7d4d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:57.541193 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253333d-d081-40eb-ba55-cd8bcb68e82a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:57.563901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:57.576519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e98c6-91cb-45c7-93cc-8e75fabc5197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:57.577177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e98c6-91cb-45c7-93cc-8e75fabc5197 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:57.577466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e98c6-91cb-45c7-93cc-8e75fabc5197 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:57.580700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e98c6-91cb-45c7-93cc-8e75fabc5197 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:57.580700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e98c6-91cb-45c7-93cc-8e75fabc5197 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:57.580700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e98c6-91cb-45c7-93cc-8e75fabc5197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:57.580700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e98c6-91cb-45c7-93cc-8e75fabc5197 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:57.585088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 494/997] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:19:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:57.590772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e98c6-91cb-45c7-93cc-8e75fabc5197 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:57.604766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb72c24-8fa1-41b9-b033-97ce280a7d4d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:57.641403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6675-bfea-4563-9471-9ad9847e995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:57.642096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6675-bfea-4563-9471-9ad9847e995d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:57.642446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6675-bfea-4563-9471-9ad9847e995d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:57.642814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6675-bfea-4563-9471-9ad9847e995d None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:57.643549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a6675-bfea-4563-9471-9ad9847e995d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:57.644004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a6675-bfea-4563-9471-9ad9847e995d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:57.645659 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a6675-bfea-4563-9471-9ad9847e995d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:57.650793 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 504/998] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Aug 4 02:19:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:57.656363 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6675-bfea-4563-9471-9ad9847e995d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:57.693151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e98c6-91cb-45c7-93cc-8e75fabc5197 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:57.712870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:57.728483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96771e8a-c281-4c6c-9ccd-f1d33a21efda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:57.729102 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96771e8a-c281-4c6c-9ccd-f1d33a21efda None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:57.729393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96771e8a-c281-4c6c-9ccd-f1d33a21efda None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:57.729673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96771e8a-c281-4c6c-9ccd-f1d33a21efda None admin] PATH_INFO: `/v3/endpoints` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:57.730427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96771e8a-c281-4c6c-9ccd-f1d33a21efda None admin] RBAC: Adding query filter params (interface=public, service_id=35d72166ec1146feaaaf586e20563879, region_id=RegionOne) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:57.730771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96771e8a-c281-4c6c-9ccd-f1d33a21efda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:57.732173 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96771e8a-c281-4c6c-9ccd-f1d33a21efda None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:57.737692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 495/999] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Aug 4 02:19:57 2022] GET /identity/v3/endpoints?service_id=35d72166ec1146feaaaf586e20563879&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:57.743230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96771e8a-c281-4c6c-9ccd-f1d33a21efda None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:57.766786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6675-bfea-4563-9471-9ad9847e995d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:57.798926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:57.802419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb8b8a-ddd9-47da-8251-db68464e7e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:57.803278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb8b8a-ddd9-47da-8251-db68464e7e8d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:57.803645 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb8b8a-ddd9-47da-8251-db68464e7e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:57.804003 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb8b8a-ddd9-47da-8251-db68464e7e8d None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:57.804687 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb8b8a-ddd9-47da-8251-db68464e7e8d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:57.805000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb8b8a-ddd9-47da-8251-db68464e7e8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:57.806406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb8b8a-ddd9-47da-8251-db68464e7e8d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:57.811693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 505/1000] 10.222.0.60 () {56 vars in 1122 bytes} [Thu Aug 4 02:19:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:57.818314 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb8b8a-ddd9-47da-8251-db68464e7e8d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:57.852219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96771e8a-c281-4c6c-9ccd-f1d33a21efda None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:57.886290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a52779-d7a2-48f4-b956-c952c3e44918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:57.886942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a52779-d7a2-48f4-b956-c952c3e44918 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:57.887230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a52779-d7a2-48f4-b956-c952c3e44918 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:57.887515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a52779-d7a2-48f4-b956-c952c3e44918 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:57.888168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a52779-d7a2-48f4-b956-c952c3e44918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:57.889552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a52779-d7a2-48f4-b956-c952c3e44918 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:57.896446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 496/1001] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Aug 4 02:19:57 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:19:57.931671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb8b8a-ddd9-47da-8251-db68464e7e8d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:57.951504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:57.972566 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9906f1-6665-472a-963b-d9515155f322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:57.973515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9906f1-6665-472a-963b-d9515155f322 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:57.973907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9906f1-6665-472a-963b-d9515155f322 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:57.974220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9906f1-6665-472a-963b-d9515155f322 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:57.975058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9906f1-6665-472a-963b-d9515155f322 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:57.976533 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9906f1-6665-472a-963b-d9515155f322 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:58.050533 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 506/1002] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:19:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:19:58.875113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0c298-f172-4f2f-ab2c-a10f879d1b0c None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:58.875656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0c298-f172-4f2f-ab2c-a10f879d1b0c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:58.875656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0c298-f172-4f2f-ab2c-a10f879d1b0c None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:58.877180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 497/1003] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:58.882461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a875d0-9601-49ed-a40f-bcffbffdde7d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:58.882896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a875d0-9601-49ed-a40f-bcffbffdde7d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:58.883068 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a875d0-9601-49ed-a40f-bcffbffdde7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:58.901807 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-49a875d0-9601-49ed-a40f-bcffbffdde7d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:58.903024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-49a875d0-9601-49ed-a40f-bcffbffdde7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:19:58.986530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 507/1004] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:19:59.007006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0c298-f172-4f2f-ab2c-a10f879d1b0c None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:59.123237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0c298-f172-4f2f-ab2c-a10f879d1b0c None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:59.137783 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:59.157956 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff930f-6588-4554-81b3-2546359b3d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:59.158662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff930f-6588-4554-81b3-2546359b3d31 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:59.158951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff930f-6588-4554-81b3-2546359b3d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:59.159231 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff930f-6588-4554-81b3-2546359b3d31 None admin] PATH_INFO: `/v3/services/image` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:59.159876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff930f-6588-4554-81b3-2546359b3d31 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:59.162206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff930f-6588-4554-81b3-2546359b3d31 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-5bff930f-6588-4554-81b3-2546359b3d31 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:19:59.171858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:19:59.172911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:19:59.173810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:19:59.178561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 498/1005] 10.222.0.60 () {56 vars in 1105 bytes} [Thu Aug 4 02:19:59 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:19:59.180056 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a875d0-9601-49ed-a40f-bcffbffdde7d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:59.281748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a875d0-9601-49ed-a40f-bcffbffdde7d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:59.283296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:19:59.318982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd15a88-cf9d-4b61-8bf6-b1d01ad7f9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:59.319600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd15a88-cf9d-4b61-8bf6-b1d01ad7f9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:59.319872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd15a88-cf9d-4b61-8bf6-b1d01ad7f9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:59.320152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd15a88-cf9d-4b61-8bf6-b1d01ad7f9d9 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:59.320831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd15a88-cf9d-4b61-8bf6-b1d01ad7f9d9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:59.321140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd15a88-cf9d-4b61-8bf6-b1d01ad7f9d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:59.322542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd15a88-cf9d-4b61-8bf6-b1d01ad7f9d9 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:59.327611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 508/1006] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:19:59.333423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff930f-6588-4554-81b3-2546359b3d31 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:19:59.434576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff930f-6588-4554-81b3-2546359b3d31 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:19:59.468097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7922a9-7fa9-49a0-98f7-cdd3c7f5619e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:19:59.468715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7922a9-7fa9-49a0-98f7-cdd3c7f5619e None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:59.468994 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7922a9-7fa9-49a0-98f7-cdd3c7f5619e None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:59.469265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7922a9-7fa9-49a0-98f7-cdd3c7f5619e None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:59.469936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7922a9-7fa9-49a0-98f7-cdd3c7f5619e None admin] RBAC: Adding query filter params (type=image) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:19:59.470235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7922a9-7fa9-49a0-98f7-cdd3c7f5619e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:19:59.471628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7922a9-7fa9-49a0-98f7-cdd3c7f5619e None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:19:59.477064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 499/1007] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:19:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:19:59.938092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c71aa-2b1c-4cca-8165-6689ce7e4b23 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:59.938658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c71aa-2b1c-4cca-8165-6689ce7e4b23 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:59.938658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c71aa-2b1c-4cca-8165-6689ce7e4b23 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:59.940166 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 509/1008] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:19:59.945850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131fc78-15e2-4651-b264-2ddf30482caf None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:19:59.946284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131fc78-15e2-4651-b264-2ddf30482caf None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:19:59.946440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131fc78-15e2-4651-b264-2ddf30482caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:19:59.965125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8131fc78-15e2-4651-b264-2ddf30482caf None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:19:59.966312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8131fc78-15e2-4651-b264-2ddf30482caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:00.003066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:00.043458 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 500/1009] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:19:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:00.059051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c71aa-2b1c-4cca-8165-6689ce7e4b23 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:00.066060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd582e1f-afc8-44c5-971b-16f77c62b7e9 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:00.066386 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd582e1f-afc8-44c5-971b-16f77c62b7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:00.066709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd582e1f-afc8-44c5-971b-16f77c62b7e9 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:00.068300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 501/1010] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:20:00.073094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e699-dffc-46d7-98a2-05018842e787 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:00.073383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e699-dffc-46d7-98a2-05018842e787 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:00.073658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e699-dffc-46d7-98a2-05018842e787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:00.092845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6391e699-dffc-46d7-98a2-05018842e787 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:00.094039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6391e699-dffc-46d7-98a2-05018842e787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:00.165985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 502/1011] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:20:00.168116 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c71aa-2b1c-4cca-8165-6689ce7e4b23 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:00.189393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391e699-dffc-46d7-98a2-05018842e787 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:00.209142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c5355-578a-43ed-96c9-6a40b38df4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:00.209906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c5355-578a-43ed-96c9-6a40b38df4af None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:00.210188 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c5355-578a-43ed-96c9-6a40b38df4af None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:00.210619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c5355-578a-43ed-96c9-6a40b38df4af None admin] PATH_INFO: `/v3/services/compute` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:00.211245 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c5355-578a-43ed-96c9-6a40b38df4af None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:00.212612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c5355-578a-43ed-96c9-6a40b38df4af None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-4c8c5355-578a-43ed-96c9-6a40b38df4af None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:00.221567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:00.223390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:00.224269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 510/1012] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:20:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:20:00.229974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c5355-578a-43ed-96c9-6a40b38df4af None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:00.263846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:00.310125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391e699-dffc-46d7-98a2-05018842e787 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:00.312203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:00.335234 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c5355-578a-43ed-96c9-6a40b38df4af None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:00.354374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5111e9f-7819-470c-8d7f-eee4dbdaae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:00.355671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5111e9f-7819-470c-8d7f-eee4dbdaae86 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:00.356124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5111e9f-7819-470c-8d7f-eee4dbdaae86 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:00.356788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5111e9f-7819-470c-8d7f-eee4dbdaae86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:00.358246 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5111e9f-7819-470c-8d7f-eee4dbdaae86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:00.360048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5111e9f-7819-470c-8d7f-eee4dbdaae86 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:00.361733 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 503/1013] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:00.368000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5111e9f-7819-470c-8d7f-eee4dbdaae86 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:00.370172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba5000-eb25-43b2-b982-8f2ccf61f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:00.370995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba5000-eb25-43b2-b982-8f2ccf61f51e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:00.371281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba5000-eb25-43b2-b982-8f2ccf61f51e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:00.372461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba5000-eb25-43b2-b982-8f2ccf61f51e None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:00.373152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba5000-eb25-43b2-b982-8f2ccf61f51e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:00.373462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba5000-eb25-43b2-b982-8f2ccf61f51e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:00.374868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba5000-eb25-43b2-b982-8f2ccf61f51e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:00.381547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 511/1014] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:20:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:00.387342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba5000-eb25-43b2-b982-8f2ccf61f51e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:00.475037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5111e9f-7819-470c-8d7f-eee4dbdaae86 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:00.489820 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:00.497201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba5000-eb25-43b2-b982-8f2ccf61f51e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:00.511394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf44cdd-3f1d-4243-a995-609fdb79c929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:00.512022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf44cdd-3f1d-4243-a995-609fdb79c929 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:00.515011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf44cdd-3f1d-4243-a995-609fdb79c929 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:00.515011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf44cdd-3f1d-4243-a995-609fdb79c929 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:00.515011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf44cdd-3f1d-4243-a995-609fdb79c929 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:00.515011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf44cdd-3f1d-4243-a995-609fdb79c929 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:00.532110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaca2b2-10b2-448d-ba69-fc3755dccc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:00.532737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaca2b2-10b2-448d-ba69-fc3755dccc18 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:00.533023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaca2b2-10b2-448d-ba69-fc3755dccc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:00.533300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaca2b2-10b2-448d-ba69-fc3755dccc18 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:00.533979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaca2b2-10b2-448d-ba69-fc3755dccc18 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:00.534290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaca2b2-10b2-448d-ba69-fc3755dccc18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:00.535736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaca2b2-10b2-448d-ba69-fc3755dccc18 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:00.540738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 512/1015] 10.222.0.60 () {56 vars in 1112 bytes} [Thu Aug 4 02:20:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:00.546191 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaca2b2-10b2-448d-ba69-fc3755dccc18 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:00.630325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 504/1016] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:20:00 2022] POST /identity/v3/projects => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:20:00.661936 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaca2b2-10b2-448d-ba69-fc3755dccc18 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:00.701442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdb720-30a1-41c4-89a2-8d51cf3fca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:00.702081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb720-30a1-41c4-89a2-8d51cf3fca99 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:00.702367 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb720-30a1-41c4-89a2-8d51cf3fca99 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:00.702676 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb720-30a1-41c4-89a2-8d51cf3fca99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:00.703403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdb720-30a1-41c4-89a2-8d51cf3fca99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:00.704824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdb720-30a1-41c4-89a2-8d51cf3fca99 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:00.780581 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 513/1017] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:20:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:20:01.505192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77d980-25ef-45d9-8bf6-bf97cd624a10 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:01.505712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77d980-25ef-45d9-8bf6-bf97cd624a10 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:01.505712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77d980-25ef-45d9-8bf6-bf97cd624a10 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:01.507202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 505/1018] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:01.512343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae73c4f-9cf2-43b1-9eed-ac3639cfb3cb None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:01.512716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae73c4f-9cf2-43b1-9eed-ac3639cfb3cb None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:01.512911 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae73c4f-9cf2-43b1-9eed-ac3639cfb3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:01.532291 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-5ae73c4f-9cf2-43b1-9eed-ac3639cfb3cb None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:01.533494 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5ae73c4f-9cf2-43b1-9eed-ac3639cfb3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:01.543003 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:01.608434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 514/1019] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:01 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:01.631497 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77d980-25ef-45d9-8bf6-bf97cd624a10 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:01.656999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:01.744750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77d980-25ef-45d9-8bf6-bf97cd624a10 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:01.780541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbbe36-4707-472b-9296-d7d62e53e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:01.780541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbbe36-4707-472b-9296-d7d62e53e67d None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:01.780541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbbe36-4707-472b-9296-d7d62e53e67d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:01.780541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbbe36-4707-472b-9296-d7d62e53e67d None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:01.781157 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbbe36-4707-472b-9296-d7d62e53e67d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:01.782591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbbe36-4707-472b-9296-d7d62e53e67d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:01.875552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 506/1020] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:20:01 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:20:02.701699 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108ec6d-b727-4bc6-8680-b07673136aff None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:02.702238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108ec6d-b727-4bc6-8680-b07673136aff None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:02.702238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108ec6d-b727-4bc6-8680-b07673136aff None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:02.703789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 515/1021] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:02.709167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b84786-26ee-4feb-ac15-3969a154efaa None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:02.709552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b84786-26ee-4feb-ac15-3969a154efaa None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:02.709720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b84786-26ee-4feb-ac15-3969a154efaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:02.728123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f3b84786-26ee-4feb-ac15-3969a154efaa None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:02.729300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f3b84786-26ee-4feb-ac15-3969a154efaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:02.806573 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 507/1022] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:02.828296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108ec6d-b727-4bc6-8680-b07673136aff None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:02.908961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4af95-a724-4de3-a544-e4d0966a50c4 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:02.909308 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4af95-a724-4de3-a544-e4d0966a50c4 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:02.909527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4af95-a724-4de3-a544-e4d0966a50c4 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:02.911235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 508/1023] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:20:02.916057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cabeeb-90d1-4c09-80c1-8d844829999a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:02.916346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cabeeb-90d1-4c09-80c1-8d844829999a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:02.916625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cabeeb-90d1-4c09-80c1-8d844829999a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:02.932258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108ec6d-b727-4bc6-8680-b07673136aff None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:02.934660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c3cabeeb-90d1-4c09-80c1-8d844829999a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:02.935837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c3cabeeb-90d1-4c09-80c1-8d844829999a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:02.937822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:02.973852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f5477-59db-493a-9188-0366ef6fcb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:02.974434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f5477-59db-493a-9188-0366ef6fcb16 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:02.974757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f5477-59db-493a-9188-0366ef6fcb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:02.975035 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f5477-59db-493a-9188-0366ef6fcb16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:02.976204 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f5477-59db-493a-9188-0366ef6fcb16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:02.977684 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f5477-59db-493a-9188-0366ef6fcb16 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:02.979334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 516/1024] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:02.984967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f5477-59db-493a-9188-0366ef6fcb16 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:02.998150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:03.016926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 509/1025] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:03.045037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cabeeb-90d1-4c09-80c1-8d844829999a None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:03.096685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f5477-59db-493a-9188-0366ef6fcb16 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:03.133348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993e29b-ecd5-46ca-bd0a-101aa99f308d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:03.133964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993e29b-ecd5-46ca-bd0a-101aa99f308d None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:03.134246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993e29b-ecd5-46ca-bd0a-101aa99f308d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:03.134748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993e29b-ecd5-46ca-bd0a-101aa99f308d None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:03.135215 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993e29b-ecd5-46ca-bd0a-101aa99f308d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:03.136641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993e29b-ecd5-46ca-bd0a-101aa99f308d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:03.151607 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cabeeb-90d1-4c09-80c1-8d844829999a None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:03.187075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccf6b0-11c6-4b11-a69d-016f9cd96c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:03.187717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccf6b0-11c6-4b11-a69d-016f9cd96c43 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:03.188002 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccf6b0-11c6-4b11-a69d-016f9cd96c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:03.188282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccf6b0-11c6-4b11-a69d-016f9cd96c43 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:03.195273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:03.199009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccf6b0-11c6-4b11-a69d-016f9cd96c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-c1ccf6b0-11c6-4b11-a69d-016f9cd96c43 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:20:03.204268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:03.205236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:03.206201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 510/1026] 10.222.0.60 () {56 vars in 1120 bytes} [Thu Aug 4 02:20:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:03.212178 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccf6b0-11c6-4b11-a69d-016f9cd96c43 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:03.274596 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 517/1027] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:20:02 2022] POST /identity/v3/users => generated 285 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:20:03.328983 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccf6b0-11c6-4b11-a69d-016f9cd96c43 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:03.368336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b163900-fb2f-4073-8d38-6fda97dbffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:03.369080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b163900-fb2f-4073-8d38-6fda97dbffd1 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:03.369434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b163900-fb2f-4073-8d38-6fda97dbffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:03.369782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b163900-fb2f-4073-8d38-6fda97dbffd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:03.370629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b163900-fb2f-4073-8d38-6fda97dbffd1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:03.371041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b163900-fb2f-4073-8d38-6fda97dbffd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:03.372505 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b163900-fb2f-4073-8d38-6fda97dbffd1 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:03.382582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 511/1028] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Aug 4 02:20:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:03.388386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993e29b-ecd5-46ca-bd0a-101aa99f308d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:03.460196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:03.501548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993e29b-ecd5-46ca-bd0a-101aa99f308d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:03.537580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c20e2-e1b6-4b42-9292-502d866dd86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:03.538150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c20e2-e1b6-4b42-9292-502d866dd86c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:03.538439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c20e2-e1b6-4b42-9292-502d866dd86c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:03.538764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c20e2-e1b6-4b42-9292-502d866dd86c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:03.549928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c20e2-e1b6-4b42-9292-502d866dd86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:03.551449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c20e2-e1b6-4b42-9292-502d866dd86c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-349c20e2-e1b6-4b42-9292-502d866dd86c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:20:03.566871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:03.567972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:03.569089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:20:03.569089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:20:03.569089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:03.569089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:03.570554 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 518/1029] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:03.574076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b163900-fb2f-4073-8d38-6fda97dbffd1 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:03.636445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:03.679046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b163900-fb2f-4073-8d38-6fda97dbffd1 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:03.713768 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695362-6e13-4bbc-910f-3dcb8b46f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:03.714390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695362-6e13-4bbc-910f-3dcb8b46f217 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:03.714691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695362-6e13-4bbc-910f-3dcb8b46f217 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:03.714972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695362-6e13-4bbc-910f-3dcb8b46f217 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:03.715664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695362-6e13-4bbc-910f-3dcb8b46f217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:03.715972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695362-6e13-4bbc-910f-3dcb8b46f217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:03.717343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695362-6e13-4bbc-910f-3dcb8b46f217 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:03.729453 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 512/1030] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:03.734791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c20e2-e1b6-4b42-9292-502d866dd86c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:03.840292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c20e2-e1b6-4b42-9292-502d866dd86c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:03.856953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:03.875006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a6473-b3d9-4e24-a9c4-f1870f34ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:03.875664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a6473-b3d9-4e24-a9c4-f1870f34ad92 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:03.875952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a6473-b3d9-4e24-a9c4-f1870f34ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:03.876230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a6473-b3d9-4e24-a9c4-f1870f34ad92 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:03.884372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a6473-b3d9-4e24-a9c4-f1870f34ad92 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:03.885891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a6473-b3d9-4e24-a9c4-f1870f34ad92 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-c34a6473-b3d9-4e24-a9c4-f1870f34ad92 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:20:03.898600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:03.899577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:03.900608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:03.900608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:03.900608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:20:03.900608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:20:03.900608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:20:03.900608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:20:03.900608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:20:03.900608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:20:03.900608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:20:03.900608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:03.900608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 519/1031] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Aug 4 02:20:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:03.906523 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695362-6e13-4bbc-910f-3dcb8b46f217 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:03.926165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab80507-dcb4-487a-bcb2-935122aad280 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:03.926706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab80507-dcb4-487a-bcb2-935122aad280 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:03.927174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab80507-dcb4-487a-bcb2-935122aad280 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:03.929230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 520/1032] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:20:03.934853 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6481-f33c-45c6-9a50-06b07afc3377 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:03.935432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6481-f33c-45c6-9a50-06b07afc3377 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:03.936202 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6481-f33c-45c6-9a50-06b07afc3377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:03.958371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-be8a6481-f33c-45c6-9a50-06b07afc3377 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:03.959692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-be8a6481-f33c-45c6-9a50-06b07afc3377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:04.013719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695362-6e13-4bbc-910f-3dcb8b46f217 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:04.030046 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 521/1033] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:20:04.035901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:04.055581 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6481-f33c-45c6-9a50-06b07afc3377 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:04.055707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03af2-f1f5-4325-9129-06f9557de4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:04.055707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03af2-f1f5-4325-9129-06f9557de4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:04.055707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03af2-f1f5-4325-9129-06f9557de4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:04.055707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f03af2-f1f5-4325-9129-06f9557de4d9 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:04.056000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f03af2-f1f5-4325-9129-06f9557de4d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:04.056069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f03af2-f1f5-4325-9129-06f9557de4d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:04.058830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f03af2-f1f5-4325-9129-06f9557de4d9 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:04.083084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 513/1034] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Aug 4 02:20:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:04.084107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03af2-f1f5-4325-9129-06f9557de4d9 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:04.162197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6481-f33c-45c6-9a50-06b07afc3377 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:04.171163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:04.193370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f03af2-f1f5-4325-9129-06f9557de4d9 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:04.200616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c04f94-0327-46d1-a57f-a947559ac713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:04.201671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c04f94-0327-46d1-a57f-a947559ac713 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:04.201963 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c04f94-0327-46d1-a57f-a947559ac713 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:04.202244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c04f94-0327-46d1-a57f-a947559ac713 None admin] PATH_INFO: `/v3/services/image` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:04.203279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c04f94-0327-46d1-a57f-a947559ac713 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:04.205358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c04f94-0327-46d1-a57f-a947559ac713 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-19c04f94-0327-46d1-a57f-a947559ac713 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:04.217931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:04.219186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:20:04.220053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:04.221489 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 522/1035] 10.222.0.60 () {56 vars in 1105 bytes} [Thu Aug 4 02:20:04 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:20:04.225999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c04f94-0327-46d1-a57f-a947559ac713 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:04.231730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a3c1e-d702-40ed-89ec-ef6a0f47f388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:04.232355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3c1e-d702-40ed-89ec-ef6a0f47f388 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:04.232641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3c1e-d702-40ed-89ec-ef6a0f47f388 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:04.232919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3c1e-d702-40ed-89ec-ef6a0f47f388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:04.286957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:04.310964 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a3c1e-d702-40ed-89ec-ef6a0f47f388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:04.312421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a3c1e-d702-40ed-89ec-ef6a0f47f388 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:04.334583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c04f94-0327-46d1-a57f-a947559ac713 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:04.373844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3ad26-7523-48b8-8a28-c47cfbec4fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:04.374466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3ad26-7523-48b8-8a28-c47cfbec4fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:04.374780 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3ad26-7523-48b8-8a28-c47cfbec4fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:04.375088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3ad26-7523-48b8-8a28-c47cfbec4fc9 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:04.375862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3ad26-7523-48b8-8a28-c47cfbec4fc9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:04.376331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3ad26-7523-48b8-8a28-c47cfbec4fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:04.377685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3ad26-7523-48b8-8a28-c47cfbec4fc9 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:04.387866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 523/1036] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:04.388655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3ad26-7523-48b8-8a28-c47cfbec4fc9 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:04.420861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 514/1037] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:20:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:04.424503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:04.426984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a3c1e-d702-40ed-89ec-ef6a0f47f388 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:04.498407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3ad26-7523-48b8-8a28-c47cfbec4fc9 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:04.510767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:04.532660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a3c1e-d702-40ed-89ec-ef6a0f47f388 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:04.536403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc1e01-0eca-4bc3-927e-5a08194e3e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:04.537087 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc1e01-0eca-4bc3-927e-5a08194e3e9c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:04.537376 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc1e01-0eca-4bc3-927e-5a08194e3e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:04.537649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc1e01-0eca-4bc3-927e-5a08194e3e9c None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:04.538332 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc1e01-0eca-4bc3-927e-5a08194e3e9c None admin] RBAC: Adding query filter params (type=image) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:04.538671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc1e01-0eca-4bc3-927e-5a08194e3e9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:04.540051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc1e01-0eca-4bc3-927e-5a08194e3e9c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:04.550195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 524/1038] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:04.551686 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc1e01-0eca-4bc3-927e-5a08194e3e9c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:04.568954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30534a-5e43-4b27-be88-abcd6d41192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:04.569598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30534a-5e43-4b27-be88-abcd6d41192f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:04.569887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30534a-5e43-4b27-be88-abcd6d41192f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:04.570163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30534a-5e43-4b27-be88-abcd6d41192f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:04.580393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30534a-5e43-4b27-be88-abcd6d41192f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:04.582436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30534a-5e43-4b27-be88-abcd6d41192f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-df30534a-5e43-4b27-be88-abcd6d41192f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:20:04.597159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:04.598115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:04.599992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:20:04.599992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:20:04.599992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:04.599992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:04.599992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 515/1039] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:20:04.603987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30534a-5e43-4b27-be88-abcd6d41192f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:04.659320 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:04.663356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc1e01-0eca-4bc3-927e-5a08194e3e9c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:04.697262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9c17-01ff-413b-9e6b-5978fba28cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:04.697805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9c17-01ff-413b-9e6b-5978fba28cbd None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:04.698088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9c17-01ff-413b-9e6b-5978fba28cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:04.698365 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9c17-01ff-413b-9e6b-5978fba28cbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:04.699160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e9c17-01ff-413b-9e6b-5978fba28cbd None admin] RBAC: Adding query filter params (interface=public, service_id=9844e29575104d088408732d6085b446, region_id=RegionOne) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:04.699468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e9c17-01ff-413b-9e6b-5978fba28cbd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:04.700839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e9c17-01ff-413b-9e6b-5978fba28cbd None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:04.710816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 525/1040] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Aug 4 02:20:04 2022] GET /identity/v3/endpoints?service_id=9844e29575104d088408732d6085b446&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:04.711840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9c17-01ff-413b-9e6b-5978fba28cbd None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:04.717745 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30534a-5e43-4b27-be88-abcd6d41192f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:04.747702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:04.753605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b9457-27c6-4040-8059-a53fae006efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:04.754793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b9457-27c6-4040-8059-a53fae006efd None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:04.759900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b9457-27c6-4040-8059-a53fae006efd None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:04.759900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b9457-27c6-4040-8059-a53fae006efd None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:04.759900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b9457-27c6-4040-8059-a53fae006efd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:04.759900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b9457-27c6-4040-8059-a53fae006efd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:04.759900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b9457-27c6-4040-8059-a53fae006efd None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:04.770924 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 516/1041] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:04.776504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b9457-27c6-4040-8059-a53fae006efd None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:04.822123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9c17-01ff-413b-9e6b-5978fba28cbd None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:04.859680 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ec401-df35-4372-a25e-016bc2c92110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:04.860316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ec401-df35-4372-a25e-016bc2c92110 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:04.860586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ec401-df35-4372-a25e-016bc2c92110 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:04.860867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ec401-df35-4372-a25e-016bc2c92110 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:04.861525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ec401-df35-4372-a25e-016bc2c92110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:04.863580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ec401-df35-4372-a25e-016bc2c92110 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:04.870397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 526/1042] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Aug 4 02:20:04 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:20:04.890456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b9457-27c6-4040-8059-a53fae006efd None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:04.930579 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8f745-6b0a-4189-bc76-5968ace260bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:04.931636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8f745-6b0a-4189-bc76-5968ace260bb None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:04.932125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8f745-6b0a-4189-bc76-5968ace260bb None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:04.932954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8f745-6b0a-4189-bc76-5968ace260bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:04.941817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8f745-6b0a-4189-bc76-5968ace260bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:04.943972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8f745-6b0a-4189-bc76-5968ace260bb None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-27b8f745-6b0a-4189-bc76-5968ace260bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:20:04.957419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:04.958674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:04.959766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:20:04.959766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:20:04.959766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:20:04.959766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:20:04.959766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:20:04.959766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:20:04.959766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:20:04.959766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:04.961627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 517/1043] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:20:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:20:04.967545 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ec401-df35-4372-a25e-016bc2c92110 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:04.999748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:05.082232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ec401-df35-4372-a25e-016bc2c92110 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:05.118084 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c4e09-ec30-4840-93c0-1e72c02f51c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:05.118731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c4e09-ec30-4840-93c0-1e72c02f51c8 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:05.119018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c4e09-ec30-4840-93c0-1e72c02f51c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:05.119294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c4e09-ec30-4840-93c0-1e72c02f51c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:05.120046 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c4e09-ec30-4840-93c0-1e72c02f51c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:05.120358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c4e09-ec30-4840-93c0-1e72c02f51c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:05.121819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c4e09-ec30-4840-93c0-1e72c02f51c8 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:05.133997 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 527/1044] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:05.140283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8f745-6b0a-4189-bc76-5968ace260bb None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:05.194579 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:05.246374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8f745-6b0a-4189-bc76-5968ace260bb None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:05.279935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409294ad-680c-47eb-a7f1-98b7beb6a31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:05.280560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409294ad-680c-47eb-a7f1-98b7beb6a31a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:05.280843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409294ad-680c-47eb-a7f1-98b7beb6a31a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:05.281121 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409294ad-680c-47eb-a7f1-98b7beb6a31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:05.281904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409294ad-680c-47eb-a7f1-98b7beb6a31a None admin] RBAC: Adding query filter params (role.id=1de5c22423df4a2982b137a938cdd3d9, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=c6d95db1228f48669e1985eb74306a25) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:05.282217 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409294ad-680c-47eb-a7f1-98b7beb6a31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:05.283681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409294ad-680c-47eb-a7f1-98b7beb6a31a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:05.298514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 518/1045] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:20:05 2022] GET /identity/v3/role_assignments?user.id=c6d95db1228f48669e1985eb74306a25&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=1de5c22423df4a2982b137a938cdd3d9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:05.361512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7bb57-8cb6-4d31-b436-e397905a62d7 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:05.361799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7bb57-8cb6-4d31-b436-e397905a62d7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:05.362076 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7bb57-8cb6-4d31-b436-e397905a62d7 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:05.364586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 528/1046] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:05.370001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a27fe8-ec61-4192-a535-c63892171384 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:05.370280 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a27fe8-ec61-4192-a535-c63892171384 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:05.370597 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a27fe8-ec61-4192-a535-c63892171384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:05.390159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f7a27fe8-ec61-4192-a535-c63892171384 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:05.391423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f7a27fe8-ec61-4192-a535-c63892171384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:05.468273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 519/1047] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:05.491027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7bb57-8cb6-4d31-b436-e397905a62d7 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:05.583141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:05.599877 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7bb57-8cb6-4d31-b436-e397905a62d7 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:05.636557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195e5b2-53d1-4ffe-87b1-bfa4ad97e916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:05.637247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195e5b2-53d1-4ffe-87b1-bfa4ad97e916 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:05.637534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195e5b2-53d1-4ffe-87b1-bfa4ad97e916 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:05.637810 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195e5b2-53d1-4ffe-87b1-bfa4ad97e916 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:05.648730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195e5b2-53d1-4ffe-87b1-bfa4ad97e916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-3195e5b2-53d1-4ffe-87b1-bfa4ad97e916 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:20:05.653737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:05.654891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:05.655733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 529/1048] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:20:05.663512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a27fe8-ec61-4192-a535-c63892171384 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:05.709351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:05.767060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a27fe8-ec61-4192-a535-c63892171384 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:05.803542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb99a99-95f3-480a-8ef3-875373acde19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:05.804420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb99a99-95f3-480a-8ef3-875373acde19 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:05.804849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb99a99-95f3-480a-8ef3-875373acde19 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:05.805270 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb99a99-95f3-480a-8ef3-875373acde19 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:05.806226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb99a99-95f3-480a-8ef3-875373acde19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:05.806714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb99a99-95f3-480a-8ef3-875373acde19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:05.808539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb99a99-95f3-480a-8ef3-875373acde19 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:05.822669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 520/1049] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:05.823937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195e5b2-53d1-4ffe-87b1-bfa4ad97e916 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:05.927064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195e5b2-53d1-4ffe-87b1-bfa4ad97e916 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:05.962420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea43ee-f014-4cb8-a5bc-8a079bbe5bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:05.963093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea43ee-f014-4cb8-a5bc-8a079bbe5bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:05.963373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea43ee-f014-4cb8-a5bc-8a079bbe5bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:05.963674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea43ee-f014-4cb8-a5bc-8a079bbe5bd8 None admin] PATH_INFO: `/v3/users/9445d48503b549d2ba9bc221a2f7073d` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:05.977739 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea43ee-f014-4cb8-a5bc-8a079bbe5bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=9445d48503b549d2ba9bc221a2f7073d)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:05.979213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea43ee-f014-4cb8-a5bc-8a079bbe5bd8 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:05.981037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 530/1050] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:05 2022] GET /identity/v3/users/9445d48503b549d2ba9bc221a2f7073d => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:05.986514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb99a99-95f3-480a-8ef3-875373acde19 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:06.099019 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb99a99-95f3-480a-8ef3-875373acde19 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:06.105807 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:06.132565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f7c80-ceba-453c-8ce1-a0773b5cfc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:06.133176 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f7c80-ceba-453c-8ce1-a0773b5cfc38 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:06.133457 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f7c80-ceba-453c-8ce1-a0773b5cfc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:06.133730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f7c80-ceba-453c-8ce1-a0773b5cfc38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:06.200604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f7c80-ceba-453c-8ce1-a0773b5cfc38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:06.201970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f7c80-ceba-453c-8ce1-a0773b5cfc38 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:06.303667 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 521/1051] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:20:05 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:06.309499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea43ee-f014-4cb8-a5bc-8a079bbe5bd8 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:06.313286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:06.412095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea43ee-f014-4cb8-a5bc-8a079bbe5bd8 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:06.446751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fcd21-7ea2-4ffd-8c6e-9cee24ac905c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:06.447402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fcd21-7ea2-4ffd-8c6e-9cee24ac905c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:06.447682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fcd21-7ea2-4ffd-8c6e-9cee24ac905c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:06.447951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fcd21-7ea2-4ffd-8c6e-9cee24ac905c None admin] PATH_INFO: `/v3/projects/c438dc80942a44539e73df15ab29909a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:06.449089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fcd21-7ea2-4ffd-8c6e-9cee24ac905c None admin] RBAC: Authorizing `identity:get_project(project_id=c438dc80942a44539e73df15ab29909a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:06.450536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fcd21-7ea2-4ffd-8c6e-9cee24ac905c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:06.452413 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 531/1052] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:20:06 2022] GET /identity/v3/projects/c438dc80942a44539e73df15ab29909a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:06.458292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f7c80-ceba-453c-8ce1-a0773b5cfc38 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:06.466457 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:06.559679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f7c80-ceba-453c-8ce1-a0773b5cfc38 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:06.594440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc272a2-9a7d-47d7-a12b-c8daed483df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:06.595425 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc272a2-9a7d-47d7-a12b-c8daed483df5 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:06.595893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc272a2-9a7d-47d7-a12b-c8daed483df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:06.596351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc272a2-9a7d-47d7-a12b-c8daed483df5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:06.597935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc272a2-9a7d-47d7-a12b-c8daed483df5 None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=c438dc80942a44539e73df15ab29909a, user.id=9445d48503b549d2ba9bc221a2f7073d) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:06.598516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc272a2-9a7d-47d7-a12b-c8daed483df5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:06.600081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc272a2-9a7d-47d7-a12b-c8daed483df5 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:06.605857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 522/1053] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:20:06 2022] GET /identity/v3/role_assignments?user.id=9445d48503b549d2ba9bc221a2f7073d&scope.project.id=c438dc80942a44539e73df15ab29909a&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:06.919202 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd0f9-5b7a-4772-b4b1-253d3dd81378 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:06.919720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd0f9-5b7a-4772-b4b1-253d3dd81378 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:06.919823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd0f9-5b7a-4772-b4b1-253d3dd81378 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:06.921263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 532/1054] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:06.926984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4a625-0cb3-465f-b7c8-6979a08452d9 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:06.927376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4a625-0cb3-465f-b7c8-6979a08452d9 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:06.927542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4a625-0cb3-465f-b7c8-6979a08452d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:06.946158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-68b4a625-0cb3-465f-b7c8-6979a08452d9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:06.947373 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-68b4a625-0cb3-465f-b7c8-6979a08452d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:07.012461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:07.017877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 523/1055] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:07.040911 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dd0f9-5b7a-4772-b4b1-253d3dd81378 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:07.117214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:07.148840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dd0f9-5b7a-4772-b4b1-253d3dd81378 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:07.183816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ece878-50ac-4b6e-addf-77847050dd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:07.184387 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ece878-50ac-4b6e-addf-77847050dd96 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:07.184673 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ece878-50ac-4b6e-addf-77847050dd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:07.184952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ece878-50ac-4b6e-addf-77847050dd96 None admin] PATH_INFO: `/v3/services/image` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:07.185582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ece878-50ac-4b6e-addf-77847050dd96 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:07.186996 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ece878-50ac-4b6e-addf-77847050dd96 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-b8ece878-50ac-4b6e-addf-77847050dd96 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:07.196788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:07.197885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:07.198834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 533/1056] 10.222.0.60 () {56 vars in 1105 bytes} [Thu Aug 4 02:20:07 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:07.203905 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4a625-0cb3-465f-b7c8-6979a08452d9 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:07.303945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4a625-0cb3-465f-b7c8-6979a08452d9 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:07.332863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cdda1-fa2a-4515-8e57-23754d44274a None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:07.333145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cdda1-fa2a-4515-8e57-23754d44274a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:07.333426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cdda1-fa2a-4515-8e57-23754d44274a None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:07.334939 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 534/1057] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:20:07.340026 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b7e3d-2d72-443c-802b-1d0dfacaba22 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:07.340312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b7e3d-2d72-443c-802b-1d0dfacaba22 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:07.340592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b7e3d-2d72-443c-802b-1d0dfacaba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:07.341780 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5390dd-0cdb-467e-9a63-751d8f091d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:07.342401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5390dd-0cdb-467e-9a63-751d8f091d8a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:07.342709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5390dd-0cdb-467e-9a63-751d8f091d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:07.342984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5390dd-0cdb-467e-9a63-751d8f091d8a None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:07.343661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5390dd-0cdb-467e-9a63-751d8f091d8a None admin] RBAC: Adding query filter params (name=image) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:07.343965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5390dd-0cdb-467e-9a63-751d8f091d8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:07.345324 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5390dd-0cdb-467e-9a63-751d8f091d8a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:07.351157 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 524/1058] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:07.357309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5390dd-0cdb-467e-9a63-751d8f091d8a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:07.361616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-661b7e3d-2d72-443c-802b-1d0dfacaba22 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:07.363416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-661b7e3d-2d72-443c-802b-1d0dfacaba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:07.426720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:07.438344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 535/1059] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:20:07.459161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b7e3d-2d72-443c-802b-1d0dfacaba22 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:07.467610 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5390dd-0cdb-467e-9a63-751d8f091d8a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:07.506128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0f6f2-e29d-4070-b16d-f2514bad3628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:07.507244 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f6f2-e29d-4070-b16d-f2514bad3628 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:07.507714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f6f2-e29d-4070-b16d-f2514bad3628 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:07.508217 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f6f2-e29d-4070-b16d-f2514bad3628 None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:07.509032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0f6f2-e29d-4070-b16d-f2514bad3628 None admin] RBAC: Adding query filter params (type=image) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:07.509485 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0f6f2-e29d-4070-b16d-f2514bad3628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:07.511150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0f6f2-e29d-4070-b16d-f2514bad3628 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:07.516613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 525/1060] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:07.522363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0f6f2-e29d-4070-b16d-f2514bad3628 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:07.524590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:07.563003 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b7e3d-2d72-443c-802b-1d0dfacaba22 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:07.597347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d772ec9-da04-4d68-83a2-e3a0c6ce68ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:07.597984 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d772ec9-da04-4d68-83a2-e3a0c6ce68ac None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:07.598265 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d772ec9-da04-4d68-83a2-e3a0c6ce68ac None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:07.598566 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d772ec9-da04-4d68-83a2-e3a0c6ce68ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:07.611221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d772ec9-da04-4d68-83a2-e3a0c6ce68ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-8d772ec9-da04-4d68-83a2-e3a0c6ce68ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:20:07.618522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:07.619654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:07.620526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 536/1061] 10.222.0.60 () {56 vars in 1120 bytes} [Thu Aug 4 02:20:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:20:07.625441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d772ec9-da04-4d68-83a2-e3a0c6ce68ac None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:07.632143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0f6f2-e29d-4070-b16d-f2514bad3628 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:07.662656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:07.670645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a90558-a36e-4873-9495-f87bc656621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:07.671491 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a90558-a36e-4873-9495-f87bc656621d None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:07.672872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a90558-a36e-4873-9495-f87bc656621d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:07.672872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a90558-a36e-4873-9495-f87bc656621d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:07.672872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a90558-a36e-4873-9495-f87bc656621d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:07.674067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a90558-a36e-4873-9495-f87bc656621d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:07.733776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d772ec9-da04-4d68-83a2-e3a0c6ce68ac None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:07.757310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 526/1062] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:20:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:20:07.760941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:07.778863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dccbcd-4351-4849-baf9-118272db1829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:07.779503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dccbcd-4351-4849-baf9-118272db1829 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:07.779843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dccbcd-4351-4849-baf9-118272db1829 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:07.780122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dccbcd-4351-4849-baf9-118272db1829 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:07.780937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dccbcd-4351-4849-baf9-118272db1829 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:07.781251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dccbcd-4351-4849-baf9-118272db1829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:07.782778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dccbcd-4351-4849-baf9-118272db1829 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:07.792938 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 537/1063] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Aug 4 02:20:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:07.798739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a90558-a36e-4873-9495-f87bc656621d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:07.911624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a90558-a36e-4873-9495-f87bc656621d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:07.949371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb960872-49a0-4dff-aa78-e1b77ccea2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:07.950003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960872-49a0-4dff-aa78-e1b77ccea2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:07.950275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960872-49a0-4dff-aa78-e1b77ccea2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:07.950612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960872-49a0-4dff-aa78-e1b77ccea2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:07.964285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb960872-49a0-4dff-aa78-e1b77ccea2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:07.964998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb960872-49a0-4dff-aa78-e1b77ccea2a4 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-bb960872-49a0-4dff-aa78-e1b77ccea2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:20:07.984630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:07.985542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:07.986472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:20:07.986472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:20:07.986472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:07.986472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:07.986472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 527/1064] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:07.992007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dccbcd-4351-4849-baf9-118272db1829 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:08.106349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dccbcd-4351-4849-baf9-118272db1829 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:08.142096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cfd80-b8bf-42a1-b268-8b25d43b9c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:08.142751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cfd80-b8bf-42a1-b268-8b25d43b9c99 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:08.143034 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cfd80-b8bf-42a1-b268-8b25d43b9c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:08.143309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cfd80-b8bf-42a1-b268-8b25d43b9c99 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:08.144273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cfd80-b8bf-42a1-b268-8b25d43b9c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:08.144798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cfd80-b8bf-42a1-b268-8b25d43b9c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:08.146271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cfd80-b8bf-42a1-b268-8b25d43b9c99 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:08.158519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 538/1065] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:08.164765 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb960872-49a0-4dff-aa78-e1b77ccea2a4 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:08.203004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:08.272922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb960872-49a0-4dff-aa78-e1b77ccea2a4 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:08.309861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdde7b-457a-48e3-b45c-355352bd6065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:08.310516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdde7b-457a-48e3-b45c-355352bd6065 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:08.310808 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdde7b-457a-48e3-b45c-355352bd6065 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:08.311080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdde7b-457a-48e3-b45c-355352bd6065 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:08.319520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdde7b-457a-48e3-b45c-355352bd6065 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:08.320962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdde7b-457a-48e3-b45c-355352bd6065 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-eacdde7b-457a-48e3-b45c-355352bd6065 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:20:08.333635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:08.334636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:08.335614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:08.335614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:08.335614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:20:08.335614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:20:08.335614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:20:08.335614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:20:08.335614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:20:08.335614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:20:08.335614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:20:08.335614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:08.336775 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 528/1066] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Aug 4 02:20:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:20:08.340483 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cfd80-b8bf-42a1-b268-8b25d43b9c99 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:08.388427 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:08.443974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cfd80-b8bf-42a1-b268-8b25d43b9c99 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:08.478081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b522eb2-527a-42d2-8213-6ab41d1e8ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:08.478735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b522eb2-527a-42d2-8213-6ab41d1e8ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:08.479015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b522eb2-527a-42d2-8213-6ab41d1e8ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:08.479290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b522eb2-527a-42d2-8213-6ab41d1e8ce3 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:08.480086 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b522eb2-527a-42d2-8213-6ab41d1e8ce3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:08.480395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b522eb2-527a-42d2-8213-6ab41d1e8ce3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:08.481830 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b522eb2-527a-42d2-8213-6ab41d1e8ce3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:08.500225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 539/1067] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Aug 4 02:20:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:08.506189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdde7b-457a-48e3-b45c-355352bd6065 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:08.600795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:08.607054 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdde7b-457a-48e3-b45c-355352bd6065 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:08.631196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8217f-564b-4c88-95d7-f264a2e56e89 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:08.631515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8217f-564b-4c88-95d7-f264a2e56e89 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:08.631772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8217f-564b-4c88-95d7-f264a2e56e89 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:08.633266 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 540/1068] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:20:08.638212 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b0d10-e9c8-470d-83ec-abb6bdab2ba4 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:08.638517 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b0d10-e9c8-470d-83ec-abb6bdab2ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:08.638811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b0d10-e9c8-470d-83ec-abb6bdab2ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:08.641793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83707119-637c-4cdf-81c4-c677bc9b292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:08.642512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83707119-637c-4cdf-81c4-c677bc9b292d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:08.643239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83707119-637c-4cdf-81c4-c677bc9b292d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:08.643517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83707119-637c-4cdf-81c4-c677bc9b292d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:08.655709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83707119-637c-4cdf-81c4-c677bc9b292d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:08.657154 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83707119-637c-4cdf-81c4-c677bc9b292d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:08.658200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-654b0d10-e9c8-470d-83ec-abb6bdab2ba4 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:08.660147 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-654b0d10-e9c8-470d-83ec-abb6bdab2ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-83707119-637c-4cdf-81c4-c677bc9b292d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:20:08.672869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:08.673802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:08.674761 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:20:08.674761 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:20:08.674761 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:08.674761 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:08.678635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 529/1069] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:08.679882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83707119-637c-4cdf-81c4-c677bc9b292d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:08.733916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 541/1070] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:20:08.757490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b0d10-e9c8-470d-83ec-abb6bdab2ba4 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:08.781506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83707119-637c-4cdf-81c4-c677bc9b292d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:08.789872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:08.818127 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb85f1-c41e-4fc6-99e5-e9c1a8142b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:08.818791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb85f1-c41e-4fc6-99e5-e9c1a8142b69 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:08.819167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb85f1-c41e-4fc6-99e5-e9c1a8142b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:08.819414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb85f1-c41e-4fc6-99e5-e9c1a8142b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:08.820056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb85f1-c41e-4fc6-99e5-e9c1a8142b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:08.820363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb85f1-c41e-4fc6-99e5-e9c1a8142b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:08.821743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb85f1-c41e-4fc6-99e5-e9c1a8142b69 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:08.839132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 530/1071] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:08.840688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb85f1-c41e-4fc6-99e5-e9c1a8142b69 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:08.852169 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:08.868589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b0d10-e9c8-470d-83ec-abb6bdab2ba4 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:08.903801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfd0e4-f6ab-4b56-848b-1ddbaeccee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:08.904464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfd0e4-f6ab-4b56-848b-1ddbaeccee3a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:08.904747 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfd0e4-f6ab-4b56-848b-1ddbaeccee3a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:08.905030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfd0e4-f6ab-4b56-848b-1ddbaeccee3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:08.917562 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfd0e4-f6ab-4b56-848b-1ddbaeccee3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-c9cfd0e4-f6ab-4b56-848b-1ddbaeccee3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:20:08.922441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:08.923501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:08.924369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 542/1072] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:08.930417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfd0e4-f6ab-4b56-848b-1ddbaeccee3a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:08.950236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb85f1-c41e-4fc6-99e5-e9c1a8142b69 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:08.988476 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7658f-31d9-4d82-b8f7-10c81b840a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:08.989199 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7658f-31d9-4d82-b8f7-10c81b840a08 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:08.989484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7658f-31d9-4d82-b8f7-10c81b840a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:08.990181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7658f-31d9-4d82-b8f7-10c81b840a08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:08.997122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7658f-31d9-4d82-b8f7-10c81b840a08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:08.998602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7658f-31d9-4d82-b8f7-10c81b840a08 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-4bf7658f-31d9-4d82-b8f7-10c81b840a08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:20:09.009932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:09.010850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:09.011750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:20:09.011750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:20:09.011750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:20:09.011750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:20:09.011750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:20:09.011750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:20:09.011750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:20:09.011750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:09.016145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 531/1073] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:20:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:09.016812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7658f-31d9-4d82-b8f7-10c81b840a08 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:09.030559 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:09.040736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfd0e4-f6ab-4b56-848b-1ddbaeccee3a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:09.081999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44e41-bb30-4cb7-9d87-f1d74aa64460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:09.082796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44e41-bb30-4cb7-9d87-f1d74aa64460 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:09.083147 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44e41-bb30-4cb7-9d87-f1d74aa64460 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:09.083516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44e41-bb30-4cb7-9d87-f1d74aa64460 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:09.084296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44e41-bb30-4cb7-9d87-f1d74aa64460 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:09.084693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44e41-bb30-4cb7-9d87-f1d74aa64460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:09.086122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44e41-bb30-4cb7-9d87-f1d74aa64460 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:09.094520 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 543/1074] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:20:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:09.095811 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:09.100401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44e41-bb30-4cb7-9d87-f1d74aa64460 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:09.132792 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7658f-31d9-4d82-b8f7-10c81b840a08 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:09.168220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf4843-383e-44fe-aa81-9361a6c81c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:09.168941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4843-383e-44fe-aa81-9361a6c81c44 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:09.169308 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4843-383e-44fe-aa81-9361a6c81c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:09.169650 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4843-383e-44fe-aa81-9361a6c81c44 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:09.170466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf4843-383e-44fe-aa81-9361a6c81c44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:09.170968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf4843-383e-44fe-aa81-9361a6c81c44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:09.172475 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf4843-383e-44fe-aa81-9361a6c81c44 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:09.185781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 532/1075] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:20:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:09.192234 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf4843-383e-44fe-aa81-9361a6c81c44 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:09.211011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44e41-bb30-4cb7-9d87-f1d74aa64460 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:09.247750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae5f2c-b8fe-4e40-828b-99af1f980f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:09.248381 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae5f2c-b8fe-4e40-828b-99af1f980f07 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:09.248665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae5f2c-b8fe-4e40-828b-99af1f980f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:09.248940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae5f2c-b8fe-4e40-828b-99af1f980f07 None admin] PATH_INFO: `/v3/users/9445d48503b549d2ba9bc221a2f7073d` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:09.250212 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae5f2c-b8fe-4e40-828b-99af1f980f07 None admin] RBAC: Authorizing `identity:get_user(user_id=9445d48503b549d2ba9bc221a2f7073d)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:09.251796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae5f2c-b8fe-4e40-828b-99af1f980f07 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:09.254310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 544/1076] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:09 2022] GET /identity/v3/users/9445d48503b549d2ba9bc221a2f7073d => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:09.259925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae5f2c-b8fe-4e40-828b-99af1f980f07 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:09.285555 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:09.298092 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf4843-383e-44fe-aa81-9361a6c81c44 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:09.328815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:09.337553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11890fe4-3f53-49ba-9bba-4565b9fc3880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:09.338225 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11890fe4-3f53-49ba-9bba-4565b9fc3880 None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:09.338524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11890fe4-3f53-49ba-9bba-4565b9fc3880 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:09.338807 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11890fe4-3f53-49ba-9bba-4565b9fc3880 None admin] PATH_INFO: `/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/c6d95db1228f48669e1985eb74306a25/roles/1de5c22423df4a2982b137a938cdd3d9` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:09.341142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11890fe4-3f53-49ba-9bba-4565b9fc3880 None admin] RBAC: Authorizing `identity:create_grant(project_id=fae65363f2fb415b834ac367a6c4b7ad, user_id=c6d95db1228f48669e1985eb74306a25, role_id=1de5c22423df4a2982b137a938cdd3d9)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:09.342727 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11890fe4-3f53-49ba-9bba-4565b9fc3880 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:09.365561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae5f2c-b8fe-4e40-828b-99af1f980f07 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:09.400701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f6420-c89d-4eaa-bfe4-33e37456e1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:09.401269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f6420-c89d-4eaa-bfe4-33e37456e1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:09.401715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f6420-c89d-4eaa-bfe4-33e37456e1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:09.401839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 533/1077] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:20:09 2022] PUT /identity/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/c6d95db1228f48669e1985eb74306a25/roles/1de5c22423df4a2982b137a938cdd3d9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:20:09.401922 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f6420-c89d-4eaa-bfe4-33e37456e1f7 None admin] PATH_INFO: `/v3/projects/c438dc80942a44539e73df15ab29909a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:09.402995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f6420-c89d-4eaa-bfe4-33e37456e1f7 None admin] RBAC: Authorizing `identity:get_project(project_id=c438dc80942a44539e73df15ab29909a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:09.404483 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f6420-c89d-4eaa-bfe4-33e37456e1f7 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:09.411818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 545/1078] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:20:09 2022] GET /identity/v3/projects/c438dc80942a44539e73df15ab29909a => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:09.415608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11890fe4-3f53-49ba-9bba-4565b9fc3880 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:09.527852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11890fe4-3f53-49ba-9bba-4565b9fc3880 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:09.568158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46742-4183-4505-a9e5-b03acc98d7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:09.568835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46742-4183-4505-a9e5-b03acc98d7a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:09.569114 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46742-4183-4505-a9e5-b03acc98d7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:09.569387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46742-4183-4505-a9e5-b03acc98d7a4 None admin] PATH_INFO: `/v3/projects/c438dc80942a44539e73df15ab29909a/users/9445d48503b549d2ba9bc221a2f7073d/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:09.571377 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c46742-4183-4505-a9e5-b03acc98d7a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c438dc80942a44539e73df15ab29909a, user_id=9445d48503b549d2ba9bc221a2f7073d, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:09.572804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c46742-4183-4505-a9e5-b03acc98d7a4 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:09.636926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 534/1079] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:20:09 2022] PUT /identity/v3/projects/c438dc80942a44539e73df15ab29909a/users/9445d48503b549d2ba9bc221a2f7073d/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:20:09.832363 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec355c3-c8a0-4008-bc5d-20404b594fde None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:09.832698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec355c3-c8a0-4008-bc5d-20404b594fde None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:09.832937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec355c3-c8a0-4008-bc5d-20404b594fde None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:09.834460 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 546/1080] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:09.839621 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4432bd2-963a-465b-bff3-916559181a3b None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:09.839984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4432bd2-963a-465b-bff3-916559181a3b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:09.840339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4432bd2-963a-465b-bff3-916559181a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:09.868252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c4432bd2-963a-465b-bff3-916559181a3b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:09.869447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c4432bd2-963a-465b-bff3-916559181a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:09.916628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:09.940867 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 535/1081] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:09.963848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec355c3-c8a0-4008-bc5d-20404b594fde None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:10.066711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:10.077417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec355c3-c8a0-4008-bc5d-20404b594fde None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:10.114911 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113cd6c-ee31-4143-b440-1a212beaf689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:10.115456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113cd6c-ee31-4143-b440-1a212beaf689 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:10.115741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113cd6c-ee31-4143-b440-1a212beaf689 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:10.116016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113cd6c-ee31-4143-b440-1a212beaf689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:10.185364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113cd6c-ee31-4143-b440-1a212beaf689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:10.186846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113cd6c-ee31-4143-b440-1a212beaf689 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:10.274480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:10.285968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 547/1082] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:20:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:10.291766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4432bd2-963a-465b-bff3-916559181a3b None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:10.391294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4432bd2-963a-465b-bff3-916559181a3b None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:10.424901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394cb76-0621-407a-9ac0-cc38ffb7af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:10.425564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394cb76-0621-407a-9ac0-cc38ffb7af6c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:10.425846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394cb76-0621-407a-9ac0-cc38ffb7af6c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:10.426120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394cb76-0621-407a-9ac0-cc38ffb7af6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:10.436320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394cb76-0621-407a-9ac0-cc38ffb7af6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:10.437762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394cb76-0621-407a-9ac0-cc38ffb7af6c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-3394cb76-0621-407a-9ac0-cc38ffb7af6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:20:10.452635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:10.453541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:10.454474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:20:10.454474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:20:10.454474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:10.454474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:10.458574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 536/1083] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:10.460451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113cd6c-ee31-4143-b440-1a212beaf689 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:10.562597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113cd6c-ee31-4143-b440-1a212beaf689 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:10.598419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0911348-7414-41ed-90d5-987b3ed761ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:10.599072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0911348-7414-41ed-90d5-987b3ed761ce None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:10.599357 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0911348-7414-41ed-90d5-987b3ed761ce None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:10.599633 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0911348-7414-41ed-90d5-987b3ed761ce None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:10.600324 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0911348-7414-41ed-90d5-987b3ed761ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:10.600637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0911348-7414-41ed-90d5-987b3ed761ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:10.602029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0911348-7414-41ed-90d5-987b3ed761ce None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:10.622511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 548/1084] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:11.441760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc67e6-bdf5-443a-a891-17b88d5c9b0f None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:11.442320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc67e6-bdf5-443a-a891-17b88d5c9b0f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:11.442320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc67e6-bdf5-443a-a891-17b88d5c9b0f None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:11.443726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 537/1085] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:11.448846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5efa9-01bf-416b-b0ad-a9a08ec98937 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:11.449245 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5efa9-01bf-416b-b0ad-a9a08ec98937 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:11.449402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5efa9-01bf-416b-b0ad-a9a08ec98937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:11.467868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-aba5efa9-01bf-416b-b0ad-a9a08ec98937 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:11.469054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-aba5efa9-01bf-416b-b0ad-a9a08ec98937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:11.515032 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:11.535074 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 549/1086] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:11.558813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc67e6-bdf5-443a-a891-17b88d5c9b0f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:11.590731 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:11.652086 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f309f-ca89-41af-8066-d09dbcfbe79c None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:11.652389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f309f-ca89-41af-8066-d09dbcfbe79c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:11.652670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f309f-ca89-41af-8066-d09dbcfbe79c None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:11.654075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 550/1087] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:20:11.659169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7363c78-0a4a-4120-aaee-eb7ef42d6d23 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:11.659628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7363c78-0a4a-4120-aaee-eb7ef42d6d23 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:11.659881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7363c78-0a4a-4120-aaee-eb7ef42d6d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:11.662219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc67e6-bdf5-443a-a891-17b88d5c9b0f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:11.677989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b7363c78-0a4a-4120-aaee-eb7ef42d6d23 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:11.679243 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b7363c78-0a4a-4120-aaee-eb7ef42d6d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:11.698890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a11bd-5d40-46da-ba5a-5ae444283b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:11.699464 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a11bd-5d40-46da-ba5a-5ae444283b8f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:11.699744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a11bd-5d40-46da-ba5a-5ae444283b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:11.700016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a11bd-5d40-46da-ba5a-5ae444283b8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:11.710012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a11bd-5d40-46da-ba5a-5ae444283b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-f60a11bd-5d40-46da-ba5a-5ae444283b8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:20:11.714992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:11.716011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:11.716879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 538/1088] 10.222.0.60 () {56 vars in 1120 bytes} [Thu Aug 4 02:20:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:11.722242 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a11bd-5d40-46da-ba5a-5ae444283b8f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:11.750408 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 551/1089] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:20:11.774519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7363c78-0a4a-4120-aaee-eb7ef42d6d23 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:11.811357 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:11.821266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a11bd-5d40-46da-ba5a-5ae444283b8f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:11.855547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81411bb6-3dd9-4872-90bc-b599393c5186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:11.856159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81411bb6-3dd9-4872-90bc-b599393c5186 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:11.856438 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81411bb6-3dd9-4872-90bc-b599393c5186 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:11.856709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81411bb6-3dd9-4872-90bc-b599393c5186 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:11.857415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81411bb6-3dd9-4872-90bc-b599393c5186 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:11.857714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81411bb6-3dd9-4872-90bc-b599393c5186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:11.859110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81411bb6-3dd9-4872-90bc-b599393c5186 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:11.867856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 539/1090] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Aug 4 02:20:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:11.873514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81411bb6-3dd9-4872-90bc-b599393c5186 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:11.873914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7363c78-0a4a-4120-aaee-eb7ef42d6d23 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:11.884709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:11.907386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e51c11-0247-4b71-92d2-ef672ed7dd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:11.908033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e51c11-0247-4b71-92d2-ef672ed7dd45 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:11.908320 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e51c11-0247-4b71-92d2-ef672ed7dd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:11.908598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e51c11-0247-4b71-92d2-ef672ed7dd45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:11.920261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e51c11-0247-4b71-92d2-ef672ed7dd45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-70e51c11-0247-4b71-92d2-ef672ed7dd45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:20:11.925760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:11.926908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:11.927787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 552/1091] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:20:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:20:11.933085 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e51c11-0247-4b71-92d2-ef672ed7dd45 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:11.976741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81411bb6-3dd9-4872-90bc-b599393c5186 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:12.010740 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ff1aa-9397-48d8-b1d3-14cb8b1eedff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:12.011367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ff1aa-9397-48d8-b1d3-14cb8b1eedff None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:12.011647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ff1aa-9397-48d8-b1d3-14cb8b1eedff None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:12.011946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ff1aa-9397-48d8-b1d3-14cb8b1eedff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:12.022681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ff1aa-9397-48d8-b1d3-14cb8b1eedff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:12.024123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ff1aa-9397-48d8-b1d3-14cb8b1eedff None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:12.033893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e51c11-0247-4b71-92d2-ef672ed7dd45 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-945ff1aa-9397-48d8-b1d3-14cb8b1eedff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:20:12.041072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:12.042031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:12.042997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:20:12.042997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:20:12.042997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:12.042997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:12.044597 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 540/1092] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:12.045859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ff1aa-9397-48d8-b1d3-14cb8b1eedff None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:12.049553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:12.070513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f12e-712d-420d-81fb-311bb65917fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:12.071137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f12e-712d-420d-81fb-311bb65917fb None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:12.071421 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f12e-712d-420d-81fb-311bb65917fb None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:12.071700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f12e-712d-420d-81fb-311bb65917fb None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:12.072417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43f12e-712d-420d-81fb-311bb65917fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:12.072736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43f12e-712d-420d-81fb-311bb65917fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:12.074243 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43f12e-712d-420d-81fb-311bb65917fb None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:12.082505 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 553/1093] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:20:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:12.088532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f12e-712d-420d-81fb-311bb65917fb None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:12.120186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:12.149397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ff1aa-9397-48d8-b1d3-14cb8b1eedff None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:12.183684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e24f4-b6e9-4ec8-852d-3eba1e283bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:12.184301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e24f4-b6e9-4ec8-852d-3eba1e283bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:12.184587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e24f4-b6e9-4ec8-852d-3eba1e283bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:12.184864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e24f4-b6e9-4ec8-852d-3eba1e283bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:12.185551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e24f4-b6e9-4ec8-852d-3eba1e283bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:12.185856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e24f4-b6e9-4ec8-852d-3eba1e283bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:12.187253 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e24f4-b6e9-4ec8-852d-3eba1e283bf9 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:12.187881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f12e-712d-420d-81fb-311bb65917fb None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:12.198709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 541/1094] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:12.204372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e24f4-b6e9-4ec8-852d-3eba1e283bf9 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:12.223338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2693f6-ae40-4695-bae0-b05a3478d9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:12.223984 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2693f6-ae40-4695-bae0-b05a3478d9ea None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:12.224267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2693f6-ae40-4695-bae0-b05a3478d9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:12.224546 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2693f6-ae40-4695-bae0-b05a3478d9ea None admin] PATH_INFO: `/v3/users/9445d48503b549d2ba9bc221a2f7073d` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:12.225721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2693f6-ae40-4695-bae0-b05a3478d9ea None admin] RBAC: Authorizing `identity:get_user(user_id=9445d48503b549d2ba9bc221a2f7073d)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:12.227254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2693f6-ae40-4695-bae0-b05a3478d9ea None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:12.229103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 554/1095] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:12 2022] GET /identity/v3/users/9445d48503b549d2ba9bc221a2f7073d => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:12.234355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2693f6-ae40-4695-bae0-b05a3478d9ea None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:12.265483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:12.303581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e24f4-b6e9-4ec8-852d-3eba1e283bf9 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:12.329278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:12.333019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2693f6-ae40-4695-bae0-b05a3478d9ea None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:12.337997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071fc37-3efd-4bd6-a00e-fa8770bb5373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:12.338664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071fc37-3efd-4bd6-a00e-fa8770bb5373 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:12.338950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071fc37-3efd-4bd6-a00e-fa8770bb5373 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:12.339222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071fc37-3efd-4bd6-a00e-fa8770bb5373 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:12.346172 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071fc37-3efd-4bd6-a00e-fa8770bb5373 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:12.348229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071fc37-3efd-4bd6-a00e-fa8770bb5373 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-d071fc37-3efd-4bd6-a00e-fa8770bb5373 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:20:12.359946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:12.360886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:12.361839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:12.361839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:12.361839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:20:12.361839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:20:12.361839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:20:12.361839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:20:12.361839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:20:12.361839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:20:12.361839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:20:12.361839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:12.361839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 542/1096] 10.222.0.60 () {56 vars in 1093 bytes} [Thu Aug 4 02:20:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:20:12.366903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071fc37-3efd-4bd6-a00e-fa8770bb5373 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:12.367992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364646d0-70aa-4d1e-a487-fe8ea595e427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:12.368615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364646d0-70aa-4d1e-a487-fe8ea595e427 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:12.368902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364646d0-70aa-4d1e-a487-fe8ea595e427 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:12.369178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364646d0-70aa-4d1e-a487-fe8ea595e427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:12.436371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364646d0-70aa-4d1e-a487-fe8ea595e427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:12.437827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364646d0-70aa-4d1e-a487-fe8ea595e427 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:12.465261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071fc37-3efd-4bd6-a00e-fa8770bb5373 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:12.488757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:12.499053 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2d532-06eb-4ad5-84a8-b859c62a1cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:12.499682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2d532-06eb-4ad5-84a8-b859c62a1cdd None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:12.499965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2d532-06eb-4ad5-84a8-b859c62a1cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:12.500245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2d532-06eb-4ad5-84a8-b859c62a1cdd None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:12.501037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2d532-06eb-4ad5-84a8-b859c62a1cdd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:12.501347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2d532-06eb-4ad5-84a8-b859c62a1cdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:12.502816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2d532-06eb-4ad5-84a8-b859c62a1cdd None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:12.520458 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 543/1097] 10.222.0.60 () {56 vars in 1133 bytes} [Thu Aug 4 02:20:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:12.526401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2d532-06eb-4ad5-84a8-b859c62a1cdd None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:12.531491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:12.535908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 555/1098] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:20:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 02:20:12.541562 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364646d0-70aa-4d1e-a487-fe8ea595e427 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:12.625951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2d532-06eb-4ad5-84a8-b859c62a1cdd None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:12.641236 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364646d0-70aa-4d1e-a487-fe8ea595e427 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:12.660254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bcd85-59cb-42f7-b023-3c36b9b8bcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:12.660875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bcd85-59cb-42f7-b023-3c36b9b8bcdf None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:12.661163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bcd85-59cb-42f7-b023-3c36b9b8bcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:12.661442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bcd85-59cb-42f7-b023-3c36b9b8bcdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:12.677556 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3727c-3f39-4f86-8c0b-67a3e5e3bc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:12.678191 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3727c-3f39-4f86-8c0b-67a3e5e3bc0e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:12.678476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3727c-3f39-4f86-8c0b-67a3e5e3bc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:12.678781 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3727c-3f39-4f86-8c0b-67a3e5e3bc0e None admin] PATH_INFO: `/v3/projects/c438dc80942a44539e73df15ab29909a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:12.679925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3727c-3f39-4f86-8c0b-67a3e5e3bc0e None admin] RBAC: Authorizing `identity:get_project(project_id=c438dc80942a44539e73df15ab29909a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:12.681370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3727c-3f39-4f86-8c0b-67a3e5e3bc0e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:12.683325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 556/1099] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:20:12 2022] GET /identity/v3/projects/c438dc80942a44539e73df15ab29909a => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:12.689465 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3727c-3f39-4f86-8c0b-67a3e5e3bc0e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:12.711461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:12.730022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bcd85-59cb-42f7-b023-3c36b9b8bcdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:12.731495 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bcd85-59cb-42f7-b023-3c36b9b8bcdf None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:12.757069 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:12.790716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3727c-3f39-4f86-8c0b-67a3e5e3bc0e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:12.825693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc532a5-3fdc-4485-aa9c-6f2eed14d252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:12.826315 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc532a5-3fdc-4485-aa9c-6f2eed14d252 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:12.826630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc532a5-3fdc-4485-aa9c-6f2eed14d252 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:12.826908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc532a5-3fdc-4485-aa9c-6f2eed14d252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:12.827724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc532a5-3fdc-4485-aa9c-6f2eed14d252 None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=c438dc80942a44539e73df15ab29909a, user.id=9445d48503b549d2ba9bc221a2f7073d) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:12.828008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc532a5-3fdc-4485-aa9c-6f2eed14d252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:12.829445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc532a5-3fdc-4485-aa9c-6f2eed14d252 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:12.832239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 544/1100] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:20:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 02:20:12.835667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 557/1101] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:20:12 2022] GET /identity/v3/role_assignments?user.id=9445d48503b549d2ba9bc221a2f7073d&scope.project.id=c438dc80942a44539e73df15ab29909a&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:12.839731 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bcd85-59cb-42f7-b023-3c36b9b8bcdf None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:12.928557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:12.947556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bcd85-59cb-42f7-b023-3c36b9b8bcdf None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:12.984758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f7ab3-ec1f-4b73-b579-4feafe115bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:12.985398 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f7ab3-ec1f-4b73-b579-4feafe115bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:12.985677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f7ab3-ec1f-4b73-b579-4feafe115bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:12.985946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f7ab3-ec1f-4b73-b579-4feafe115bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:12.997247 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f7ab3-ec1f-4b73-b579-4feafe115bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:12.998739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f7ab3-ec1f-4b73-b579-4feafe115bd7 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-129f7ab3-ec1f-4b73-b579-4feafe115bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:20:13.013277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:13.014382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:13.015542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:20:13.015542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:20:13.015542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:20:13.015542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:13.015542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 545/1102] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:20:13.021029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc532a5-3fdc-4485-aa9c-6f2eed14d252 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:13.123102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc532a5-3fdc-4485-aa9c-6f2eed14d252 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:13.151638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:13.156573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1067122-054b-41c4-9c42-dc2c303ba1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:13.157243 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1067122-054b-41c4-9c42-dc2c303ba1df None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:13.157531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1067122-054b-41c4-9c42-dc2c303ba1df None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:13.157813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1067122-054b-41c4-9c42-dc2c303ba1df None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:13.158530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1067122-054b-41c4-9c42-dc2c303ba1df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:13.161601 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1067122-054b-41c4-9c42-dc2c303ba1df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:13.161601 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1067122-054b-41c4-9c42-dc2c303ba1df None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:13.174156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 558/1103] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:13.179853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f7ab3-ec1f-4b73-b579-4feafe115bd7 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:13.283966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f7ab3-ec1f-4b73-b579-4feafe115bd7 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:13.312876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a313e0-efd1-4a3c-b992-ee8793ac9ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:13.313505 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a313e0-efd1-4a3c-b992-ee8793ac9ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:13.313791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a313e0-efd1-4a3c-b992-ee8793ac9ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:13.314150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a313e0-efd1-4a3c-b992-ee8793ac9ab9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:13.316732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:13.322440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a313e0-efd1-4a3c-b992-ee8793ac9ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:13.324037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a313e0-efd1-4a3c-b992-ee8793ac9ab9 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-19a313e0-efd1-4a3c-b992-ee8793ac9ab9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:20:13.336083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:13.337083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:13.337984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:20:13.337984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:20:13.337984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:20:13.337984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:20:13.337984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:20:13.337984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:20:13.337984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:20:13.337984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:13.337984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 546/1104] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:20:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:13.343246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1067122-054b-41c4-9c42-dc2c303ba1df None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:13.442706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1067122-054b-41c4-9c42-dc2c303ba1df None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:13.475742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302028b-9d17-4152-a530-f984130aafda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:13.476362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302028b-9d17-4152-a530-f984130aafda None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:13.476645 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302028b-9d17-4152-a530-f984130aafda None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:13.476919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302028b-9d17-4152-a530-f984130aafda None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:13.477666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302028b-9d17-4152-a530-f984130aafda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:13.477972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302028b-9d17-4152-a530-f984130aafda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:13.479456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302028b-9d17-4152-a530-f984130aafda None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:13.491370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 559/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:20:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:13.497313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a313e0-efd1-4a3c-b992-ee8793ac9ab9 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:13.596536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a313e0-efd1-4a3c-b992-ee8793ac9ab9 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:13.629696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b9e36-8c65-447d-beed-3ae73b394156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:13.630304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b9e36-8c65-447d-beed-3ae73b394156 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:13.630618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b9e36-8c65-447d-beed-3ae73b394156 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:13.630896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b9e36-8c65-447d-beed-3ae73b394156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:13.631680 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b9e36-8c65-447d-beed-3ae73b394156 None admin] RBAC: Adding query filter params (role.id=1de5c22423df4a2982b137a938cdd3d9, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=c6d95db1228f48669e1985eb74306a25) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:13.631991 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b9e36-8c65-447d-beed-3ae73b394156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:13.633420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b9e36-8c65-447d-beed-3ae73b394156 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:13.639084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 547/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:20:13 2022] GET /identity/v3/role_assignments?user.id=c6d95db1228f48669e1985eb74306a25&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=1de5c22423df4a2982b137a938cdd3d9 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:14.882188 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4b238-a8f3-4f57-bd44-d5450b18f827 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:14.882743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4b238-a8f3-4f57-bd44-d5450b18f827 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:14.882849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4b238-a8f3-4f57-bd44-d5450b18f827 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:14.884180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 560/1107] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:14.889388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931d58e-3281-4949-9339-b8112ccb28af None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:14.889825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931d58e-3281-4949-9339-b8112ccb28af None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:14.889920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931d58e-3281-4949-9339-b8112ccb28af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:14.907596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-1931d58e-3281-4949-9339-b8112ccb28af None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:14.908777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1931d58e-3281-4949-9339-b8112ccb28af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:14.961296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:14.975086 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 548/1108] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:15.000144 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4b238-a8f3-4f57-bd44-d5450b18f827 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:15.053978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:15.101664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4b238-a8f3-4f57-bd44-d5450b18f827 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:15.134383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb0917-80d4-45eb-9c93-f911c69b0c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:15.134977 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb0917-80d4-45eb-9c93-f911c69b0c80 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:15.135262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb0917-80d4-45eb-9c93-f911c69b0c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:15.135541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb0917-80d4-45eb-9c93-f911c69b0c80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:15.136673 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb0917-80d4-45eb-9c93-f911c69b0c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:15.138106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb0917-80d4-45eb-9c93-f911c69b0c80 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:15.139716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 561/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:15.145728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931d58e-3281-4949-9339-b8112ccb28af None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:15.242636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931d58e-3281-4949-9339-b8112ccb28af None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:15.275618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f032b06-6e13-4d67-8e6b-1df58b4cc642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:15.276223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f032b06-6e13-4d67-8e6b-1df58b4cc642 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:15.276510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f032b06-6e13-4d67-8e6b-1df58b4cc642 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:15.276789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f032b06-6e13-4d67-8e6b-1df58b4cc642 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:15.277466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f032b06-6e13-4d67-8e6b-1df58b4cc642 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:15.278943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f032b06-6e13-4d67-8e6b-1df58b4cc642 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:15.382212 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 549/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:20:15 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:20:17.399185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c0e2f-e1a3-4ea8-b356-9b0c61c1bdd3 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:17.399709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c0e2f-e1a3-4ea8-b356-9b0c61c1bdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:17.399709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c0e2f-e1a3-4ea8-b356-9b0c61c1bdd3 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:17.401079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 562/1111] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:17.406126 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea1a26-80d9-4589-89d9-cc0a1088bade None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:17.406527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea1a26-80d9-4589-89d9-cc0a1088bade None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:17.406729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea1a26-80d9-4589-89d9-cc0a1088bade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:17.425595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6eea1a26-80d9-4589-89d9-cc0a1088bade None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:17.426805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6eea1a26-80d9-4589-89d9-cc0a1088bade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:17.466351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:17.492245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 550/1112] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:17.515539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c0e2f-e1a3-4ea8-b356-9b0c61c1bdd3 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:17.616477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c0e2f-e1a3-4ea8-b356-9b0c61c1bdd3 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:17.635572 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:17.649522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c80a0a-5221-4eeb-aeda-53acf01c8323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:17.650098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80a0a-5221-4eeb-aeda-53acf01c8323 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:17.650384 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80a0a-5221-4eeb-aeda-53acf01c8323 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:17.650693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80a0a-5221-4eeb-aeda-53acf01c8323 None admin] PATH_INFO: `/v3/roles/d2d09ac7138145968d31dde4d5b9ee5a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:17.652133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c80a0a-5221-4eeb-aeda-53acf01c8323 None admin] RBAC: Authorizing `identity:get_role(role_id=d2d09ac7138145968d31dde4d5b9ee5a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:17.653506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c80a0a-5221-4eeb-aeda-53acf01c8323 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:17.654905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 563/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:17 2022] GET /identity/v3/roles/d2d09ac7138145968d31dde4d5b9ee5a => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:20:17.661540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea1a26-80d9-4589-89d9-cc0a1088bade None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:17.757484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea1a26-80d9-4589-89d9-cc0a1088bade None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:17.790920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf769874-a316-4fcc-b592-aa08bb357561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:17.791544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf769874-a316-4fcc-b592-aa08bb357561 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:17.791828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf769874-a316-4fcc-b592-aa08bb357561 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:17.792107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf769874-a316-4fcc-b592-aa08bb357561 None admin] PATH_INFO: `/v3/users/1e46141f2d714b1ca453b8928beeb8d9` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:17.804961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf769874-a316-4fcc-b592-aa08bb357561 None admin] RBAC: Authorizing `identity:get_user(user_id=1e46141f2d714b1ca453b8928beeb8d9)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:17.806394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf769874-a316-4fcc-b592-aa08bb357561 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:17.808299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 551/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:17 2022] GET /identity/v3/users/1e46141f2d714b1ca453b8928beeb8d9 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:17.814066 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c80a0a-5221-4eeb-aeda-53acf01c8323 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:17.912107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c80a0a-5221-4eeb-aeda-53acf01c8323 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:17.945074 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796407f-740e-4eca-83d4-5530be003116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:17.945676 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796407f-740e-4eca-83d4-5530be003116 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:17.945962 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796407f-740e-4eca-83d4-5530be003116 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:17.946239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796407f-740e-4eca-83d4-5530be003116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:17.999638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:18.012570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796407f-740e-4eca-83d4-5530be003116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:18.014068 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796407f-740e-4eca-83d4-5530be003116 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:18.114202 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 564/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:20:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:18.120102 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf769874-a316-4fcc-b592-aa08bb357561 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:18.151057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:18.218025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf769874-a316-4fcc-b592-aa08bb357561 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:18.250669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d248d3-3368-4774-b28a-714d77e58afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:18.251292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d248d3-3368-4774-b28a-714d77e58afa None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:18.251574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d248d3-3368-4774-b28a-714d77e58afa None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:18.251845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d248d3-3368-4774-b28a-714d77e58afa None admin] PATH_INFO: `/v3/projects/c438dc80942a44539e73df15ab29909a` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:18.253565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d248d3-3368-4774-b28a-714d77e58afa None admin] RBAC: Authorizing `identity:get_project(project_id=c438dc80942a44539e73df15ab29909a)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:18.255025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d248d3-3368-4774-b28a-714d77e58afa None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:18.256669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 552/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:20:18 2022] GET /identity/v3/projects/c438dc80942a44539e73df15ab29909a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:18.262734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796407f-740e-4eca-83d4-5530be003116 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:18.347806 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:18.359529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796407f-740e-4eca-83d4-5530be003116 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:18.394658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6f05-8c4f-477a-8388-63451dac4240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:18.395261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6f05-8c4f-477a-8388-63451dac4240 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:18.395545 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6f05-8c4f-477a-8388-63451dac4240 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:18.395821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6f05-8c4f-477a-8388-63451dac4240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:18.396597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6f05-8c4f-477a-8388-63451dac4240 None admin] RBAC: Adding query filter params (role.id=d2d09ac7138145968d31dde4d5b9ee5a, scope.project.id=c438dc80942a44539e73df15ab29909a, user.id=1e46141f2d714b1ca453b8928beeb8d9) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:18.396912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6f05-8c4f-477a-8388-63451dac4240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:18.398348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad6f05-8c4f-477a-8388-63451dac4240 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:18.403710 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 565/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:20:18 2022] GET /identity/v3/role_assignments?user.id=1e46141f2d714b1ca453b8928beeb8d9&scope.project.id=c438dc80942a44539e73df15ab29909a&role.id=d2d09ac7138145968d31dde4d5b9ee5a => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:20.374828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1678a-a3fd-4312-966c-6b5b5c021129 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:20.375395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1678a-a3fd-4312-966c-6b5b5c021129 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:20.375395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1678a-a3fd-4312-966c-6b5b5c021129 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:20.376731 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 553/1118] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:20.381884 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edbda6-fcc0-4b66-b896-9d0adb319b3b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:20.382316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edbda6-fcc0-4b66-b896-9d0adb319b3b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:20.382447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edbda6-fcc0-4b66-b896-9d0adb319b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:20.400211 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-74edbda6-fcc0-4b66-b896-9d0adb319b3b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:20.401411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-74edbda6-fcc0-4b66-b896-9d0adb319b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:20.467386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 566/1119] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:20.490007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1678a-a3fd-4312-966c-6b5b5c021129 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:20.586567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:20.590277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1678a-a3fd-4312-966c-6b5b5c021129 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:20.623943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de9479-1e19-4516-b1d2-a9a941b94411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:20.624570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de9479-1e19-4516-b1d2-a9a941b94411 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:20.624903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de9479-1e19-4516-b1d2-a9a941b94411 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:20.625134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de9479-1e19-4516-b1d2-a9a941b94411 None admin] PATH_INFO: `/v3/roles/d2d09ac7138145968d31dde4d5b9ee5a` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:20.626604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de9479-1e19-4516-b1d2-a9a941b94411 None admin] RBAC: Authorizing `identity:get_role(role_id=d2d09ac7138145968d31dde4d5b9ee5a)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:20.628039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de9479-1e19-4516-b1d2-a9a941b94411 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:20.629545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 554/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:20 2022] GET /identity/v3/roles/d2d09ac7138145968d31dde4d5b9ee5a => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:20.635321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edbda6-fcc0-4b66-b896-9d0adb319b3b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:20.713738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:20.732809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edbda6-fcc0-4b66-b896-9d0adb319b3b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:20.765523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc74fe-0421-4568-aa69-d68c47a3cfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:20.766152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc74fe-0421-4568-aa69-d68c47a3cfda None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:20.766450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc74fe-0421-4568-aa69-d68c47a3cfda None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:20.766741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc74fe-0421-4568-aa69-d68c47a3cfda None admin] PATH_INFO: `/v3/users/1e46141f2d714b1ca453b8928beeb8d9` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:20.767878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc74fe-0421-4568-aa69-d68c47a3cfda None admin] RBAC: Authorizing `identity:get_user(user_id=1e46141f2d714b1ca453b8928beeb8d9)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:20.770001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc74fe-0421-4568-aa69-d68c47a3cfda None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:20.771626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 567/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:20 2022] GET /identity/v3/users/1e46141f2d714b1ca453b8928beeb8d9 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:20.777274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de9479-1e19-4516-b1d2-a9a941b94411 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:20.878506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de9479-1e19-4516-b1d2-a9a941b94411 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:20.912714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7f14a-3e46-4235-8229-a6bf48c29e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:20.913342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7f14a-3e46-4235-8229-a6bf48c29e48 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:20.913627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7f14a-3e46-4235-8229-a6bf48c29e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:20.913975 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7f14a-3e46-4235-8229-a6bf48c29e48 None admin] PATH_INFO: `/v3/projects/c438dc80942a44539e73df15ab29909a` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:20.915225 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7f14a-3e46-4235-8229-a6bf48c29e48 None admin] RBAC: Authorizing `identity:get_project(project_id=c438dc80942a44539e73df15ab29909a)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:20.919922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7f14a-3e46-4235-8229-a6bf48c29e48 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:20.919922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 555/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:20:20 2022] GET /identity/v3/projects/c438dc80942a44539e73df15ab29909a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:20.924347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc74fe-0421-4568-aa69-d68c47a3cfda None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:21.023418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc74fe-0421-4568-aa69-d68c47a3cfda None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:21.057613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55639f-03fd-4595-a3f2-542f8b8607cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:21.058299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55639f-03fd-4595-a3f2-542f8b8607cc None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:21.058620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55639f-03fd-4595-a3f2-542f8b8607cc None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:21.058904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55639f-03fd-4595-a3f2-542f8b8607cc None admin] PATH_INFO: `/v3/projects/c438dc80942a44539e73df15ab29909a/users/1e46141f2d714b1ca453b8928beeb8d9/roles/d2d09ac7138145968d31dde4d5b9ee5a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:21.061061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55639f-03fd-4595-a3f2-542f8b8607cc None admin] RBAC: Authorizing `identity:create_grant(project_id=c438dc80942a44539e73df15ab29909a, user_id=1e46141f2d714b1ca453b8928beeb8d9, role_id=d2d09ac7138145968d31dde4d5b9ee5a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:21.062560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55639f-03fd-4595-a3f2-542f8b8607cc None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:21.126242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 568/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:20:20 2022] PUT /identity/v3/projects/c438dc80942a44539e73df15ab29909a/users/1e46141f2d714b1ca453b8928beeb8d9/roles/d2d09ac7138145968d31dde4d5b9ee5a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:20:23.072935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a70714-91e8-4d0e-9a5c-e4fdfa061926 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:23.073383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a70714-91e8-4d0e-9a5c-e4fdfa061926 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:23.073496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a70714-91e8-4d0e-9a5c-e4fdfa061926 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:23.074895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 556/1124] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:23.079976 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180d2f-bb9e-4d36-98f8-7d8eca5f0e5f None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:23.080356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180d2f-bb9e-4d36-98f8-7d8eca5f0e5f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:23.080533 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180d2f-bb9e-4d36-98f8-7d8eca5f0e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:23.098955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2d180d2f-bb9e-4d36-98f8-7d8eca5f0e5f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:23.100155 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2d180d2f-bb9e-4d36-98f8-7d8eca5f0e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:23.102858 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:23.166308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 569/1125] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:23.189907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a70714-91e8-4d0e-9a5c-e4fdfa061926 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:23.226148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:23.290719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a70714-91e8-4d0e-9a5c-e4fdfa061926 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:23.324587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81d9cd-1422-4a33-8afb-e82bde3da057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:23.325221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81d9cd-1422-4a33-8afb-e82bde3da057 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:23.325506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81d9cd-1422-4a33-8afb-e82bde3da057 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:23.325785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81d9cd-1422-4a33-8afb-e82bde3da057 None admin] PATH_INFO: `/v3/roles/d2d09ac7138145968d31dde4d5b9ee5a` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:23.327254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81d9cd-1422-4a33-8afb-e82bde3da057 None admin] RBAC: Authorizing `identity:get_role(role_id=d2d09ac7138145968d31dde4d5b9ee5a)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:23.328656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81d9cd-1422-4a33-8afb-e82bde3da057 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:23.330004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 557/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:23 2022] GET /identity/v3/roles/d2d09ac7138145968d31dde4d5b9ee5a => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:23.335838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180d2f-bb9e-4d36-98f8-7d8eca5f0e5f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:23.432546 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180d2f-bb9e-4d36-98f8-7d8eca5f0e5f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:23.467219 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ce6ee-234b-4457-afe4-04d11e66005f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:23.467848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ce6ee-234b-4457-afe4-04d11e66005f None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:23.468136 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ce6ee-234b-4457-afe4-04d11e66005f None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:23.468415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ce6ee-234b-4457-afe4-04d11e66005f None admin] PATH_INFO: `/v3/users/1e46141f2d714b1ca453b8928beeb8d9` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:23.469572 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ce6ee-234b-4457-afe4-04d11e66005f None admin] RBAC: Authorizing `identity:get_user(user_id=1e46141f2d714b1ca453b8928beeb8d9)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:23.471048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ce6ee-234b-4457-afe4-04d11e66005f None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:23.472642 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 570/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:23 2022] GET /identity/v3/users/1e46141f2d714b1ca453b8928beeb8d9 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:23.478293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81d9cd-1422-4a33-8afb-e82bde3da057 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:23.576656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81d9cd-1422-4a33-8afb-e82bde3da057 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:23.578864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:23.609544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae86f3a-2773-456d-b08c-db095db710c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:23.610149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae86f3a-2773-456d-b08c-db095db710c5 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:23.610433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae86f3a-2773-456d-b08c-db095db710c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:23.610739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae86f3a-2773-456d-b08c-db095db710c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:23.676584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae86f3a-2773-456d-b08c-db095db710c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:23.678032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae86f3a-2773-456d-b08c-db095db710c5 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:23.773199 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 558/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:20:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:23.779120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ce6ee-234b-4457-afe4-04d11e66005f None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:23.789649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:23.877763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ce6ee-234b-4457-afe4-04d11e66005f None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:23.910723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c053832-17b8-48e5-a2e1-c7bb80861a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:23.911348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c053832-17b8-48e5-a2e1-c7bb80861a2e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:23.911634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c053832-17b8-48e5-a2e1-c7bb80861a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:23.911912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c053832-17b8-48e5-a2e1-c7bb80861a2e None admin] PATH_INFO: `/v3/projects/c438dc80942a44539e73df15ab29909a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:23.913050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c053832-17b8-48e5-a2e1-c7bb80861a2e None admin] RBAC: Authorizing `identity:get_project(project_id=c438dc80942a44539e73df15ab29909a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:23.914479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c053832-17b8-48e5-a2e1-c7bb80861a2e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:23.916153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 571/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:20:23 2022] GET /identity/v3/projects/c438dc80942a44539e73df15ab29909a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:23.922136 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae86f3a-2773-456d-b08c-db095db710c5 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:23.925841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:24.017797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae86f3a-2773-456d-b08c-db095db710c5 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:24.053479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb4c1-9403-422f-8f41-6f479d69ed62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:24.054090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb4c1-9403-422f-8f41-6f479d69ed62 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:24.054370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb4c1-9403-422f-8f41-6f479d69ed62 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:24.054672 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb4c1-9403-422f-8f41-6f479d69ed62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:24.055452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeb4c1-9403-422f-8f41-6f479d69ed62 None admin] RBAC: Adding query filter params (role.id=d2d09ac7138145968d31dde4d5b9ee5a, scope.project.id=c438dc80942a44539e73df15ab29909a, user.id=1e46141f2d714b1ca453b8928beeb8d9) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:24.055760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeb4c1-9403-422f-8f41-6f479d69ed62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:24.057425 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeb4c1-9403-422f-8f41-6f479d69ed62 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:24.063038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 559/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:20:23 2022] GET /identity/v3/role_assignments?user.id=1e46141f2d714b1ca453b8928beeb8d9&scope.project.id=c438dc80942a44539e73df15ab29909a&role.id=d2d09ac7138145968d31dde4d5b9ee5a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:26.096464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb883907-f9d2-4ea4-99cf-ea771bf0fd97 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:26.096944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb883907-f9d2-4ea4-99cf-ea771bf0fd97 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:26.097063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb883907-f9d2-4ea4-99cf-ea771bf0fd97 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:26.098553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 572/1131] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:26.103749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc02a78-aa16-4cd4-8ce9-b1259cf11cda None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:26.104196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc02a78-aa16-4cd4-8ce9-b1259cf11cda None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:26.104299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc02a78-aa16-4cd4-8ce9-b1259cf11cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:26.122195 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-4cc02a78-aa16-4cd4-8ce9-b1259cf11cda None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:26.123417 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4cc02a78-aa16-4cd4-8ce9-b1259cf11cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:26.183652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:26.188984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 560/1132] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:26.212897 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb883907-f9d2-4ea4-99cf-ea771bf0fd97 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:26.289186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:26.312446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb883907-f9d2-4ea4-99cf-ea771bf0fd97 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:26.349003 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525b7b-aa59-4560-9c17-00dc18a28fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:26.349650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525b7b-aa59-4560-9c17-00dc18a28fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:26.349930 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525b7b-aa59-4560-9c17-00dc18a28fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:26.350221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525b7b-aa59-4560-9c17-00dc18a28fa5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:26.351438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05525b7b-aa59-4560-9c17-00dc18a28fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:26.352879 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05525b7b-aa59-4560-9c17-00dc18a28fa5 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:26.354468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 573/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:26.360596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc02a78-aa16-4cd4-8ce9-b1259cf11cda None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:26.461868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc02a78-aa16-4cd4-8ce9-b1259cf11cda None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:26.496440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f071-f122-484b-aa7c-2c75d264c292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:26.497064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f071-f122-484b-aa7c-2c75d264c292 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:26.497349 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f071-f122-484b-aa7c-2c75d264c292 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:26.497623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f071-f122-484b-aa7c-2c75d264c292 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:26.498336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808f071-f122-484b-aa7c-2c75d264c292 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:26.499806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808f071-f122-484b-aa7c-2c75d264c292 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:26.591360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 561/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:20:26 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:20:28.606792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d851-439b-47ee-9256-8b3927599957 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:28.607333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d851-439b-47ee-9256-8b3927599957 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:28.607333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d851-439b-47ee-9256-8b3927599957 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:28.608711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 574/1135] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:28.614006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c959e2-3f99-4ebc-9b76-be6bf199372e None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:28.614438 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c959e2-3f99-4ebc-9b76-be6bf199372e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:28.614602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c959e2-3f99-4ebc-9b76-be6bf199372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:28.632844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-72c959e2-3f99-4ebc-9b76-be6bf199372e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:28.634020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-72c959e2-3f99-4ebc-9b76-be6bf199372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:28.679150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:28.699640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 562/1136] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:28.724677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6d851-439b-47ee-9256-8b3927599957 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:28.826506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6d851-439b-47ee-9256-8b3927599957 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:28.859868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638b1f2-fbfe-48db-a172-310be6a97cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:28.860441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b1f2-fbfe-48db-a172-310be6a97cdc None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:28.860729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b1f2-fbfe-48db-a172-310be6a97cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:28.861008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638b1f2-fbfe-48db-a172-310be6a97cdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:28.862152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638b1f2-fbfe-48db-a172-310be6a97cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:28.864187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638b1f2-fbfe-48db-a172-310be6a97cdc None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:28.865768 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 575/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:20:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:28.871497 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c959e2-3f99-4ebc-9b76-be6bf199372e None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:28.968387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c959e2-3f99-4ebc-9b76-be6bf199372e None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:29.001166 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac281bb0-9571-418c-8981-fb737352a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:29.001778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac281bb0-9571-418c-8981-fb737352a961 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:29.002061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac281bb0-9571-418c-8981-fb737352a961 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:29.002337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac281bb0-9571-418c-8981-fb737352a961 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:29.003103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac281bb0-9571-418c-8981-fb737352a961 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:29.005026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac281bb0-9571-418c-8981-fb737352a961 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:29.110161 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 563/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:20:28 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:20:31.137768 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47099c-d5f0-4afe-9c1e-f4d7b12c17a8 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:31.138274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47099c-d5f0-4afe-9c1e-f4d7b12c17a8 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:31.138389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47099c-d5f0-4afe-9c1e-f4d7b12c17a8 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:31.139705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 576/1139] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:31.145393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c03e0-ec2a-4bb6-8d9f-2048c52c69d2 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:31.145822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c03e0-ec2a-4bb6-8d9f-2048c52c69d2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:31.145948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c03e0-ec2a-4bb6-8d9f-2048c52c69d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:31.164294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-fc8c03e0-ec2a-4bb6-8d9f-2048c52c69d2 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:31.165477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-fc8c03e0-ec2a-4bb6-8d9f-2048c52c69d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:31.193190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:31.230659 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 564/1140] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:31.253664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47099c-d5f0-4afe-9c1e-f4d7b12c17a8 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:31.268451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:31.356372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47099c-d5f0-4afe-9c1e-f4d7b12c17a8 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:31.389110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40ed79-7492-41e1-87f5-2ea2490f83cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:31.389738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40ed79-7492-41e1-87f5-2ea2490f83cf None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:31.390020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40ed79-7492-41e1-87f5-2ea2490f83cf None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:31.390294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40ed79-7492-41e1-87f5-2ea2490f83cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:31.400843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40ed79-7492-41e1-87f5-2ea2490f83cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-fa40ed79-7492-41e1-87f5-2ea2490f83cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:20:31.405677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:31.406906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:31.407836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 577/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:20:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:31.413042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c03e0-ec2a-4bb6-8d9f-2048c52c69d2 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:31.507608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c03e0-ec2a-4bb6-8d9f-2048c52c69d2 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:31.540335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bca9b-d951-4e99-9972-e6d72bb1dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:31.540941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bca9b-d951-4e99-9972-e6d72bb1dd3d None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:31.541226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bca9b-d951-4e99-9972-e6d72bb1dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:31.541500 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bca9b-d951-4e99-9972-e6d72bb1dd3d None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:31.542208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bca9b-d951-4e99-9972-e6d72bb1dd3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:31.542540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bca9b-d951-4e99-9972-e6d72bb1dd3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:31.543910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bca9b-d951-4e99-9972-e6d72bb1dd3d None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:31.551881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 565/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:20:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:31.557752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40ed79-7492-41e1-87f5-2ea2490f83cf None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:31.626957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:31.656191 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40ed79-7492-41e1-87f5-2ea2490f83cf None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:31.689357 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2919467-3ae2-44c9-ab8e-ada57c5e12ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:31.689983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2919467-3ae2-44c9-ab8e-ada57c5e12ce None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:31.690267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2919467-3ae2-44c9-ab8e-ada57c5e12ce None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:31.691081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2919467-3ae2-44c9-ab8e-ada57c5e12ce None admin] PATH_INFO: `/v3/users/2071cfb832d94bfc992abd2d5eb6d01a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:31.705840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2919467-3ae2-44c9-ab8e-ada57c5e12ce None admin] RBAC: Authorizing `identity:get_user(user_id=2071cfb832d94bfc992abd2d5eb6d01a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:31.707940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2919467-3ae2-44c9-ab8e-ada57c5e12ce None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:31.709607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 578/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:31 2022] GET /identity/v3/users/2071cfb832d94bfc992abd2d5eb6d01a => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:31.715347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bca9b-d951-4e99-9972-e6d72bb1dd3d None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:31.743470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:31.814975 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bca9b-d951-4e99-9972-e6d72bb1dd3d None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:31.848335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6fd1c-4c98-44f5-9ec0-269e670b9dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:31.848941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6fd1c-4c98-44f5-9ec0-269e670b9dbb None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:31.849315 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6fd1c-4c98-44f5-9ec0-269e670b9dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:31.849601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6fd1c-4c98-44f5-9ec0-269e670b9dbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:31.914364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6fd1c-4c98-44f5-9ec0-269e670b9dbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:31.915773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6fd1c-4c98-44f5-9ec0-269e670b9dbb None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:31.942321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:32.012040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 566/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:20:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:32.017930 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2919467-3ae2-44c9-ab8e-ada57c5e12ce None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:32.117488 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2919467-3ae2-44c9-ab8e-ada57c5e12ce None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:32.146061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:32.151692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981374d-6d7f-4959-8119-a851f7a0a17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:32.152323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981374d-6d7f-4959-8119-a851f7a0a17b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:32.152606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981374d-6d7f-4959-8119-a851f7a0a17b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:32.152883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981374d-6d7f-4959-8119-a851f7a0a17b None admin] PATH_INFO: `/v3/projects/a1cb00c38aea4751bb9b418cf478ddd7` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:32.154018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981374d-6d7f-4959-8119-a851f7a0a17b None admin] RBAC: Authorizing `identity:get_project(project_id=a1cb00c38aea4751bb9b418cf478ddd7)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:32.155543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981374d-6d7f-4959-8119-a851f7a0a17b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:32.157197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 579/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:20:32 2022] GET /identity/v3/projects/a1cb00c38aea4751bb9b418cf478ddd7 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:32.163418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6fd1c-4c98-44f5-9ec0-269e670b9dbb None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:32.259574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6fd1c-4c98-44f5-9ec0-269e670b9dbb None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:32.284589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:32.292151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7353962-d5a9-4100-b048-6d79c90c6221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:32.295221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7353962-d5a9-4100-b048-6d79c90c6221 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:32.295221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7353962-d5a9-4100-b048-6d79c90c6221 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:32.295221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7353962-d5a9-4100-b048-6d79c90c6221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:32.295221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7353962-d5a9-4100-b048-6d79c90c6221 None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=a1cb00c38aea4751bb9b418cf478ddd7, user.id=2071cfb832d94bfc992abd2d5eb6d01a) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:32.295221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7353962-d5a9-4100-b048-6d79c90c6221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:32.295846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7353962-d5a9-4100-b048-6d79c90c6221 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:32.301077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 567/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:20:32 2022] GET /identity/v3/role_assignments?user.id=2071cfb832d94bfc992abd2d5eb6d01a&scope.project.id=a1cb00c38aea4751bb9b418cf478ddd7&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:34.262296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6559-b16e-4609-93c2-0ec429f5fa76 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:34.262837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6559-b16e-4609-93c2-0ec429f5fa76 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:34.262944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6559-b16e-4609-93c2-0ec429f5fa76 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:34.264262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 580/1147] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:34.269474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f6306-0aad-42cb-b6a8-3e1f63227d4f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:34.269888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f6306-0aad-42cb-b6a8-3e1f63227d4f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:34.270032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f6306-0aad-42cb-b6a8-3e1f63227d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:34.287779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-206f6306-0aad-42cb-b6a8-3e1f63227d4f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:34.288964 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-206f6306-0aad-42cb-b6a8-3e1f63227d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:34.354099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 568/1148] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:34.376131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a6559-b16e-4609-93c2-0ec429f5fa76 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:34.475293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a6559-b16e-4609-93c2-0ec429f5fa76 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:34.507961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b1aff-a5a6-4ee9-af87-89f5607407d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:34.508583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b1aff-a5a6-4ee9-af87-89f5607407d5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:34.508869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b1aff-a5a6-4ee9-af87-89f5607407d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:34.509146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b1aff-a5a6-4ee9-af87-89f5607407d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:34.518967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b1aff-a5a6-4ee9-af87-89f5607407d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-c97b1aff-a5a6-4ee9-af87-89f5607407d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:20:34.523969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:34.524892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:34.525789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 581/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:20:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:34.530996 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f6306-0aad-42cb-b6a8-3e1f63227d4f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:34.627076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f6306-0aad-42cb-b6a8-3e1f63227d4f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:34.648750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:34.660469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f1fee-c465-40cc-8b32-7c4e77c2f85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:34.664017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f1fee-c465-40cc-8b32-7c4e77c2f85c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:34.664017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f1fee-c465-40cc-8b32-7c4e77c2f85c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:34.664017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f1fee-c465-40cc-8b32-7c4e77c2f85c None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:34.664017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f1fee-c465-40cc-8b32-7c4e77c2f85c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:34.664017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f1fee-c465-40cc-8b32-7c4e77c2f85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:34.664017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f1fee-c465-40cc-8b32-7c4e77c2f85c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:34.671744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 569/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:20:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:34.678168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b1aff-a5a6-4ee9-af87-89f5607407d5 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:34.735984 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:34.776042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b1aff-a5a6-4ee9-af87-89f5607407d5 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:34.808805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2c084-e2a4-44a0-91bc-8ab32af2466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:34.809426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2c084-e2a4-44a0-91bc-8ab32af2466b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:34.809712 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2c084-e2a4-44a0-91bc-8ab32af2466b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:34.809989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2c084-e2a4-44a0-91bc-8ab32af2466b None admin] PATH_INFO: `/v3/users/2071cfb832d94bfc992abd2d5eb6d01a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:34.811137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2c084-e2a4-44a0-91bc-8ab32af2466b None admin] RBAC: Authorizing `identity:get_user(user_id=2071cfb832d94bfc992abd2d5eb6d01a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:34.812564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2c084-e2a4-44a0-91bc-8ab32af2466b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:34.814134 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 582/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:34 2022] GET /identity/v3/users/2071cfb832d94bfc992abd2d5eb6d01a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:34.819742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f1fee-c465-40cc-8b32-7c4e77c2f85c None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:34.918728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f1fee-c465-40cc-8b32-7c4e77c2f85c None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:34.951315 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e79333-51a1-474b-9932-9eb80d354a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:34.951944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e79333-51a1-474b-9932-9eb80d354a66 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:34.952230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e79333-51a1-474b-9932-9eb80d354a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:34.952509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e79333-51a1-474b-9932-9eb80d354a66 None admin] PATH_INFO: `/v3/projects/a1cb00c38aea4751bb9b418cf478ddd7` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:34.953665 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e79333-51a1-474b-9932-9eb80d354a66 None admin] RBAC: Authorizing `identity:get_project(project_id=a1cb00c38aea4751bb9b418cf478ddd7)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:34.955132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e79333-51a1-474b-9932-9eb80d354a66 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:34.957497 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 570/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:20:34 2022] GET /identity/v3/projects/a1cb00c38aea4751bb9b418cf478ddd7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:34.963259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2c084-e2a4-44a0-91bc-8ab32af2466b None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:35.061605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2c084-e2a4-44a0-91bc-8ab32af2466b None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:35.086549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:35.094913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd124fe-1124-4c8b-903b-4e9fab199e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:35.095577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd124fe-1124-4c8b-903b-4e9fab199e68 None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:35.095864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd124fe-1124-4c8b-903b-4e9fab199e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:35.101510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd124fe-1124-4c8b-903b-4e9fab199e68 None admin] PATH_INFO: `/v3/projects/a1cb00c38aea4751bb9b418cf478ddd7/users/2071cfb832d94bfc992abd2d5eb6d01a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:35.101510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd124fe-1124-4c8b-903b-4e9fab199e68 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1cb00c38aea4751bb9b418cf478ddd7, user_id=2071cfb832d94bfc992abd2d5eb6d01a, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:35.101510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd124fe-1124-4c8b-903b-4e9fab199e68 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:35.207265 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 583/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:20:34 2022] PUT /identity/v3/projects/a1cb00c38aea4751bb9b418cf478ddd7/users/2071cfb832d94bfc992abd2d5eb6d01a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:20:37.175644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833962d-0901-4b5c-ab5f-5a2735e98e9f None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:37.176160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833962d-0901-4b5c-ab5f-5a2735e98e9f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:37.176255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833962d-0901-4b5c-ab5f-5a2735e98e9f None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:37.177566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 571/1154] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:37.183095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163efdce-bed2-4230-b172-2b0fe024be8f None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:37.183477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163efdce-bed2-4230-b172-2b0fe024be8f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:37.183649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163efdce-bed2-4230-b172-2b0fe024be8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:37.201503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-163efdce-bed2-4230-b172-2b0fe024be8f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:37.202724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-163efdce-bed2-4230-b172-2b0fe024be8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:37.267082 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 584/1155] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:37.291485 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833962d-0901-4b5c-ab5f-5a2735e98e9f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:37.344414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:37.391494 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833962d-0901-4b5c-ab5f-5a2735e98e9f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:37.424094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54c230-8c4c-452e-9774-05b7a56aa5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:37.424719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54c230-8c4c-452e-9774-05b7a56aa5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:37.425030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54c230-8c4c-452e-9774-05b7a56aa5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:37.425332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54c230-8c4c-452e-9774-05b7a56aa5d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:37.436020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54c230-8c4c-452e-9774-05b7a56aa5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-ae54c230-8c4c-452e-9774-05b7a56aa5d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:20:37.441479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:37.442596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:37.443704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 572/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:20:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:37.448746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163efdce-bed2-4230-b172-2b0fe024be8f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:37.545565 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163efdce-bed2-4230-b172-2b0fe024be8f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:37.561598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:37.579494 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecac07-0417-4ed6-9dfe-36fe0e47c02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:37.580105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecac07-0417-4ed6-9dfe-36fe0e47c02a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:37.580388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecac07-0417-4ed6-9dfe-36fe0e47c02a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:37.580664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecac07-0417-4ed6-9dfe-36fe0e47c02a None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:37.581967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecac07-0417-4ed6-9dfe-36fe0e47c02a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:37.582436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecac07-0417-4ed6-9dfe-36fe0e47c02a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:37.583844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecac07-0417-4ed6-9dfe-36fe0e47c02a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:37.591657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 585/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:20:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:37.597608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54c230-8c4c-452e-9774-05b7a56aa5d4 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:37.695911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54c230-8c4c-452e-9774-05b7a56aa5d4 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:37.708908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:37.729038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87d511-36a3-4c26-b3a1-a64e9cef3adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:37.729667 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87d511-36a3-4c26-b3a1-a64e9cef3adf None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:37.729953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87d511-36a3-4c26-b3a1-a64e9cef3adf None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:37.730228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87d511-36a3-4c26-b3a1-a64e9cef3adf None admin] PATH_INFO: `/v3/users/2071cfb832d94bfc992abd2d5eb6d01a` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:37.731443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87d511-36a3-4c26-b3a1-a64e9cef3adf None admin] RBAC: Authorizing `identity:get_user(user_id=2071cfb832d94bfc992abd2d5eb6d01a)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:37.732871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87d511-36a3-4c26-b3a1-a64e9cef3adf None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:37.734459 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 573/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:37 2022] GET /identity/v3/users/2071cfb832d94bfc992abd2d5eb6d01a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:37.740740 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecac07-0417-4ed6-9dfe-36fe0e47c02a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:37.837691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecac07-0417-4ed6-9dfe-36fe0e47c02a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:37.871681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170d843-cb1a-4bf0-9795-27f4bba65606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:37.872228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170d843-cb1a-4bf0-9795-27f4bba65606 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:37.872540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170d843-cb1a-4bf0-9795-27f4bba65606 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:37.872869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170d843-cb1a-4bf0-9795-27f4bba65606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:37.918254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:37.944878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170d843-cb1a-4bf0-9795-27f4bba65606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:37.946948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170d843-cb1a-4bf0-9795-27f4bba65606 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:38.044827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 586/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:20:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:38.051449 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87d511-36a3-4c26-b3a1-a64e9cef3adf None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:38.149340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87d511-36a3-4c26-b3a1-a64e9cef3adf None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:38.182988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acde36-e54c-47c9-84c3-3a7e1aeccf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:38.183620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acde36-e54c-47c9-84c3-3a7e1aeccf22 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:38.183902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acde36-e54c-47c9-84c3-3a7e1aeccf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:38.184175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acde36-e54c-47c9-84c3-3a7e1aeccf22 None admin] PATH_INFO: `/v3/projects/a1cb00c38aea4751bb9b418cf478ddd7` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:38.185330 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acde36-e54c-47c9-84c3-3a7e1aeccf22 None admin] RBAC: Authorizing `identity:get_project(project_id=a1cb00c38aea4751bb9b418cf478ddd7)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:38.186781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acde36-e54c-47c9-84c3-3a7e1aeccf22 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:38.188602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 574/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:20:38 2022] GET /identity/v3/projects/a1cb00c38aea4751bb9b418cf478ddd7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:38.194694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170d843-cb1a-4bf0-9795-27f4bba65606 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:38.272916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:38.296833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170d843-cb1a-4bf0-9795-27f4bba65606 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:38.331013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea84775-b13f-4015-bc16-0772f1ef057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:38.331911 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea84775-b13f-4015-bc16-0772f1ef057e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:38.332394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea84775-b13f-4015-bc16-0772f1ef057e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:38.332859 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea84775-b13f-4015-bc16-0772f1ef057e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:38.333649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea84775-b13f-4015-bc16-0772f1ef057e None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=a1cb00c38aea4751bb9b418cf478ddd7, user.id=2071cfb832d94bfc992abd2d5eb6d01a) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:38.333964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea84775-b13f-4015-bc16-0772f1ef057e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:38.335429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea84775-b13f-4015-bc16-0772f1ef057e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:38.341048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 587/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:20:38 2022] GET /identity/v3/role_assignments?user.id=2071cfb832d94bfc992abd2d5eb6d01a&scope.project.id=a1cb00c38aea4751bb9b418cf478ddd7&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:40.348276 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1634766-b0df-4592-ab72-08e19b5531f6 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:40.348809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1634766-b0df-4592-ab72-08e19b5531f6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:40.348809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1634766-b0df-4592-ab72-08e19b5531f6 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:40.350197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 575/1162] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:40.355379 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adcc87-1b3a-4146-b543-6b6faec3444a None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:40.355795 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adcc87-1b3a-4146-b543-6b6faec3444a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:40.355934 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adcc87-1b3a-4146-b543-6b6faec3444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:40.374354 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-c5adcc87-1b3a-4146-b543-6b6faec3444a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:40.375560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c5adcc87-1b3a-4146-b543-6b6faec3444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:40.440941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 588/1163] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:40.462618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1634766-b0df-4592-ab72-08e19b5531f6 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:40.511787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:40.563873 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1634766-b0df-4592-ab72-08e19b5531f6 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:40.596807 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbee44-0785-41ce-9859-e45b1ef6255b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:40.597570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbee44-0785-41ce-9859-e45b1ef6255b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:40.597854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbee44-0785-41ce-9859-e45b1ef6255b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:40.598128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbee44-0785-41ce-9859-e45b1ef6255b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:40.662560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbee44-0785-41ce-9859-e45b1ef6255b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:40.663954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbee44-0785-41ce-9859-e45b1ef6255b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:40.709966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:40.760049 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 576/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:20:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:40.765984 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adcc87-1b3a-4146-b543-6b6faec3444a None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:40.833385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:40.863155 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adcc87-1b3a-4146-b543-6b6faec3444a None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:40.897327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8428dea-91e7-47a0-bc2c-db1fb5503cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:40.897958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8428dea-91e7-47a0-bc2c-db1fb5503cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:40.898239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8428dea-91e7-47a0-bc2c-db1fb5503cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:40.898534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8428dea-91e7-47a0-bc2c-db1fb5503cb1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:40.905258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8428dea-91e7-47a0-bc2c-db1fb5503cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:40.906734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8428dea-91e7-47a0-bc2c-db1fb5503cb1 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-c8428dea-91e7-47a0-bc2c-db1fb5503cb1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:40.918717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:40.919951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:40.921013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 589/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Aug 4 02:20:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:40.926064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbee44-0785-41ce-9859-e45b1ef6255b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:41.023723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbee44-0785-41ce-9859-e45b1ef6255b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:41.057200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec497312-14da-40ab-abb9-982948e64a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:41.058064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec497312-14da-40ab-abb9-982948e64a47 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:41.058345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec497312-14da-40ab-abb9-982948e64a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:41.058660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec497312-14da-40ab-abb9-982948e64a47 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:41.059350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec497312-14da-40ab-abb9-982948e64a47 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:41.059657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec497312-14da-40ab-abb9-982948e64a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:41.061023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec497312-14da-40ab-abb9-982948e64a47 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:41.068688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 577/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Thu Aug 4 02:20:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:43.040683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7716a0-0553-47af-809f-bd6cc44245bf None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:43.041231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7716a0-0553-47af-809f-bd6cc44245bf None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:43.041231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7716a0-0553-47af-809f-bd6cc44245bf None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:43.043277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 590/1167] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:43.047816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4148d31-8c77-4435-a772-1f812ba150d1 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:43.048250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4148d31-8c77-4435-a772-1f812ba150d1 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:43.048354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4148d31-8c77-4435-a772-1f812ba150d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:43.067654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-d4148d31-8c77-4435-a772-1f812ba150d1 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:43.068822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d4148d31-8c77-4435-a772-1f812ba150d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:43.076149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:43.135616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 578/1168] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:43.158061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7716a0-0553-47af-809f-bd6cc44245bf None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:43.258413 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7716a0-0553-47af-809f-bd6cc44245bf None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:43.286605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:43.291323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7c7b7-d3cc-41b6-8a0c-162d90105b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:43.291875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7c7b7-d3cc-41b6-8a0c-162d90105b04 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:43.292159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7c7b7-d3cc-41b6-8a0c-162d90105b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:43.292436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7c7b7-d3cc-41b6-8a0c-162d90105b04 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:43.293128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7c7b7-d3cc-41b6-8a0c-162d90105b04 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:43.294511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7c7b7-d3cc-41b6-8a0c-162d90105b04 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:43.408405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 591/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Thu Aug 4 02:20:43 2022] POST /identity/v3/domains => generated 267 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:20:45.411198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c3c31-d9a1-411e-9097-a455ba515323 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:45.411714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c3c31-d9a1-411e-9097-a455ba515323 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:45.411802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c3c31-d9a1-411e-9097-a455ba515323 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:45.413121 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 579/1170] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:45.418317 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d823b3-0071-4840-93fe-8bd0ad978a6e None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:45.418848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d823b3-0071-4840-93fe-8bd0ad978a6e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:45.418940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d823b3-0071-4840-93fe-8bd0ad978a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:45.436844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-62d823b3-0071-4840-93fe-8bd0ad978a6e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:45.438016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-62d823b3-0071-4840-93fe-8bd0ad978a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:45.502122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 592/1171] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:45.525491 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c3c31-d9a1-411e-9097-a455ba515323 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:45.629662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c3c31-d9a1-411e-9097-a455ba515323 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:45.662881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730751d-5571-4e6f-80b1-59337cc4ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:45.663452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730751d-5571-4e6f-80b1-59337cc4ec32 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:45.663738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730751d-5571-4e6f-80b1-59337cc4ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:45.664018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730751d-5571-4e6f-80b1-59337cc4ec32 None admin] PATH_INFO: `/v3/domains/cbbb5237d7ce46dea0f519dfd6f3ac37` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:45.674249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730751d-5571-4e6f-80b1-59337cc4ec32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cbbb5237d7ce46dea0f519dfd6f3ac37)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:45.675939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730751d-5571-4e6f-80b1-59337cc4ec32 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:45.677540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 580/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Thu Aug 4 02:20:45 2022] GET /identity/v3/domains/cbbb5237d7ce46dea0f519dfd6f3ac37 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:45.683648 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d823b3-0071-4840-93fe-8bd0ad978a6e None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:45.780724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d823b3-0071-4840-93fe-8bd0ad978a6e None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:45.803086 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:45.814771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b983e-c91c-4d99-9e53-e387ec770c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:45.815388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b983e-c91c-4d99-9e53-e387ec770c93 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:45.815674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b983e-c91c-4d99-9e53-e387ec770c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:45.816551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b983e-c91c-4d99-9e53-e387ec770c93 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:45.817219 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b983e-c91c-4d99-9e53-e387ec770c93 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:45.818779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b983e-c91c-4d99-9e53-e387ec770c93 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:45.963646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 593/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:20:45 2022] POST /identity/v3/projects => generated 361 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:20:47.968779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e795a7c-9a04-4aab-81a0-037bb313fdfa None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:47.969311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e795a7c-9a04-4aab-81a0-037bb313fdfa None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:47.969311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e795a7c-9a04-4aab-81a0-037bb313fdfa None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:47.970716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 581/1174] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:47.976027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8090c-d07f-4230-adff-df46fcc0a9d6 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:47.976426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8090c-d07f-4230-adff-df46fcc0a9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:47.976583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8090c-d07f-4230-adff-df46fcc0a9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:47.994035 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-1fc8090c-d07f-4230-adff-df46fcc0a9d6 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:47.995235 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1fc8090c-d07f-4230-adff-df46fcc0a9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:48.061778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 594/1175] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:20:48.086957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e795a7c-9a04-4aab-81a0-037bb313fdfa None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:48.089793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:48.185897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e795a7c-9a04-4aab-81a0-037bb313fdfa None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:48.219367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d705b-dc34-4e45-8ee6-8bf8cdf576d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:48.219939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d705b-dc34-4e45-8ee6-8bf8cdf576d7 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:48.220223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d705b-dc34-4e45-8ee6-8bf8cdf576d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:48.220498 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d705b-dc34-4e45-8ee6-8bf8cdf576d7 None admin] PATH_INFO: `/v3/domains/cbbb5237d7ce46dea0f519dfd6f3ac37` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:48.221640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d705b-dc34-4e45-8ee6-8bf8cdf576d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cbbb5237d7ce46dea0f519dfd6f3ac37)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:48.223192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d705b-dc34-4e45-8ee6-8bf8cdf576d7 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:48.224768 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 582/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Thu Aug 4 02:20:48 2022] GET /identity/v3/domains/cbbb5237d7ce46dea0f519dfd6f3ac37 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:48.230618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8090c-d07f-4230-adff-df46fcc0a9d6 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:48.329508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8090c-d07f-4230-adff-df46fcc0a9d6 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:48.331810 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:48.361990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413c54f-b669-4d11-aad6-07caf390cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:48.363201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413c54f-b669-4d11-aad6-07caf390cc14 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:48.363491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413c54f-b669-4d11-aad6-07caf390cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:48.363774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413c54f-b669-4d11-aad6-07caf390cc14 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:48.364857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413c54f-b669-4d11-aad6-07caf390cc14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:48.366289 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413c54f-b669-4d11-aad6-07caf390cc14 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:48.446580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 595/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:20:48 2022] POST /identity/v3/users => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:20:50.477146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e52f2-d1fe-4be2-874c-4655a279aebe None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:50.477729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e52f2-d1fe-4be2-874c-4655a279aebe None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:50.477729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e52f2-d1fe-4be2-874c-4655a279aebe None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:50.479107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 583/1178] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:50.484281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518346b3-22cc-4418-8ddb-8db5ac6b9c1a None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:50.484694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518346b3-22cc-4418-8ddb-8db5ac6b9c1a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:50.484835 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518346b3-22cc-4418-8ddb-8db5ac6b9c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:50.504008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-518346b3-22cc-4418-8ddb-8db5ac6b9c1a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:50.505221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-518346b3-22cc-4418-8ddb-8db5ac6b9c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:50.570007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 596/1179] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:50.592700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e52f2-d1fe-4be2-874c-4655a279aebe None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:50.661809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:50.693485 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e52f2-d1fe-4be2-874c-4655a279aebe None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:50.726817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dc9a8-ef11-49e8-bc73-d90a3e2ac73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:50.727486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dc9a8-ef11-49e8-bc73-d90a3e2ac73b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:50.727726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dc9a8-ef11-49e8-bc73-d90a3e2ac73b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:50.728003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dc9a8-ef11-49e8-bc73-d90a3e2ac73b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:50.738473 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38dc9a8-ef11-49e8-bc73-d90a3e2ac73b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-a38dc9a8-ef11-49e8-bc73-d90a3e2ac73b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:20:50.743369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:50.744529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:50.745481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 584/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:20:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:50.750655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518346b3-22cc-4418-8ddb-8db5ac6b9c1a None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:50.837935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:50.847481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518346b3-22cc-4418-8ddb-8db5ac6b9c1a None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:50.880910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79da370-4049-492a-88fe-f95c526c3cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:50.881515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79da370-4049-492a-88fe-f95c526c3cff None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:50.881800 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79da370-4049-492a-88fe-f95c526c3cff None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:50.882078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79da370-4049-492a-88fe-f95c526c3cff None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:50.882819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79da370-4049-492a-88fe-f95c526c3cff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:50.883128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79da370-4049-492a-88fe-f95c526c3cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:50.884499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79da370-4049-492a-88fe-f95c526c3cff None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:50.892394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 597/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:20:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:50.898269 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dc9a8-ef11-49e8-bc73-d90a3e2ac73b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:50.996210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dc9a8-ef11-49e8-bc73-d90a3e2ac73b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:51.022630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:51.028113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48623d-9c34-4563-84a6-5ee5f59aac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:51.028734 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48623d-9c34-4563-84a6-5ee5f59aac7b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:51.029016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48623d-9c34-4563-84a6-5ee5f59aac7b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:51.029294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48623d-9c34-4563-84a6-5ee5f59aac7b None admin] PATH_INFO: `/v3/users/6a9f2ad3b9004dffbf1940056c628acd` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:51.043664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48623d-9c34-4563-84a6-5ee5f59aac7b None admin] RBAC: Authorizing `identity:get_user(user_id=6a9f2ad3b9004dffbf1940056c628acd)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:51.045134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48623d-9c34-4563-84a6-5ee5f59aac7b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:51.046873 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 585/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:50 2022] GET /identity/v3/users/6a9f2ad3b9004dffbf1940056c628acd => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:51.053413 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79da370-4049-492a-88fe-f95c526c3cff None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:51.152417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79da370-4049-492a-88fe-f95c526c3cff None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:51.186284 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52aac6-7904-4763-b649-73cdd7b039c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:51.186915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52aac6-7904-4763-b649-73cdd7b039c2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:51.187203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52aac6-7904-4763-b649-73cdd7b039c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:51.187481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52aac6-7904-4763-b649-73cdd7b039c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:51.209948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:51.256522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52aac6-7904-4763-b649-73cdd7b039c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:51.257915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52aac6-7904-4763-b649-73cdd7b039c2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:51.351996 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 598/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:20:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:51.357952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48623d-9c34-4563-84a6-5ee5f59aac7b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:51.456571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48623d-9c34-4563-84a6-5ee5f59aac7b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:51.490200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bc107-5a57-402f-908a-153161c4ae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:51.490861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bc107-5a57-402f-908a-153161c4ae16 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:51.491147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bc107-5a57-402f-908a-153161c4ae16 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:51.491426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bc107-5a57-402f-908a-153161c4ae16 None admin] PATH_INFO: `/v3/projects/31b95974fb8c4d02846fc37668733449` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:51.492583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bc107-5a57-402f-908a-153161c4ae16 None admin] RBAC: Authorizing `identity:get_project(project_id=31b95974fb8c4d02846fc37668733449)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:51.494022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bc107-5a57-402f-908a-153161c4ae16 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:51.495717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 586/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:20:51 2022] GET /identity/v3/projects/31b95974fb8c4d02846fc37668733449 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:51.501772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52aac6-7904-4763-b649-73cdd7b039c2 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:51.553014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:51.599720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52aac6-7904-4763-b649-73cdd7b039c2 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:51.632028 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af671e-cfe9-4a7c-97a3-c6adfb8d7629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:51.632629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af671e-cfe9-4a7c-97a3-c6adfb8d7629 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:51.632912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af671e-cfe9-4a7c-97a3-c6adfb8d7629 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:51.633186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af671e-cfe9-4a7c-97a3-c6adfb8d7629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:51.633961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af671e-cfe9-4a7c-97a3-c6adfb8d7629 None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=31b95974fb8c4d02846fc37668733449, user.id=6a9f2ad3b9004dffbf1940056c628acd) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:51.634270 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af671e-cfe9-4a7c-97a3-c6adfb8d7629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:51.635734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af671e-cfe9-4a7c-97a3-c6adfb8d7629 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:51.640912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 599/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:20:51 2022] GET /identity/v3/role_assignments?user.id=6a9f2ad3b9004dffbf1940056c628acd&scope.project.id=31b95974fb8c4d02846fc37668733449&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:53.640218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6f480-0e0e-47ce-be63-fbdb5223e78d None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:53.640749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6f480-0e0e-47ce-be63-fbdb5223e78d None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:53.640749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6f480-0e0e-47ce-be63-fbdb5223e78d None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:53.642151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 587/1186] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:53.647415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0441-551b-4aaf-b7b4-16cd4da082ef None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:53.647838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0441-551b-4aaf-b7b4-16cd4da082ef None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:53.647973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0441-551b-4aaf-b7b4-16cd4da082ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:53.681600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-5d6b0441-551b-4aaf-b7b4-16cd4da082ef None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:53.683551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5d6b0441-551b-4aaf-b7b4-16cd4da082ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:53.754397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 600/1187] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:53.778267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6f480-0e0e-47ce-be63-fbdb5223e78d None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:53.839551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:53.898468 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6f480-0e0e-47ce-be63-fbdb5223e78d None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:53.938938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b6761-e83b-4799-a30c-6ab4d4e114f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:53.939580 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b6761-e83b-4799-a30c-6ab4d4e114f3 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:53.939868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b6761-e83b-4799-a30c-6ab4d4e114f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:53.940147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b6761-e83b-4799-a30c-6ab4d4e114f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:53.957627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b6761-e83b-4799-a30c-6ab4d4e114f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-5b1b6761-e83b-4799-a30c-6ab4d4e114f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:20:53.962613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:53.963818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:20:53.964696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 588/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:20:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:53.969861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b0441-551b-4aaf-b7b4-16cd4da082ef None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:54.018455 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:54.072091 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b0441-551b-4aaf-b7b4-16cd4da082ef None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:54.105033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc529294-36b7-4dbb-9be8-907a23c24326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:54.105645 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc529294-36b7-4dbb-9be8-907a23c24326 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:54.105932 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc529294-36b7-4dbb-9be8-907a23c24326 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:54.106212 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc529294-36b7-4dbb-9be8-907a23c24326 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:54.106964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc529294-36b7-4dbb-9be8-907a23c24326 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:54.107275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc529294-36b7-4dbb-9be8-907a23c24326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:54.108654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc529294-36b7-4dbb-9be8-907a23c24326 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:54.117293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 601/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:20:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:54.123374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b6761-e83b-4799-a30c-6ab4d4e114f3 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:54.223379 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b6761-e83b-4799-a30c-6ab4d4e114f3 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:54.239643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:54.256800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f0dc7-a5e4-43d0-afba-ddd044bc0cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:54.257433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f0dc7-a5e4-43d0-afba-ddd044bc0cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:54.257721 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f0dc7-a5e4-43d0-afba-ddd044bc0cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:54.257995 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f0dc7-a5e4-43d0-afba-ddd044bc0cb1 None admin] PATH_INFO: `/v3/users/6a9f2ad3b9004dffbf1940056c628acd` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:54.259168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f0dc7-a5e4-43d0-afba-ddd044bc0cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=6a9f2ad3b9004dffbf1940056c628acd)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:54.260625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f0dc7-a5e4-43d0-afba-ddd044bc0cb1 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:54.262226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 589/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:54 2022] GET /identity/v3/users/6a9f2ad3b9004dffbf1940056c628acd => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:54.268167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc529294-36b7-4dbb-9be8-907a23c24326 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:54.368351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc529294-36b7-4dbb-9be8-907a23c24326 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:54.376946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:54.401241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9798dde-dbfe-4e10-b142-7d0235ba0841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:54.401993 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9798dde-dbfe-4e10-b142-7d0235ba0841 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:54.402277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9798dde-dbfe-4e10-b142-7d0235ba0841 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:54.402577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9798dde-dbfe-4e10-b142-7d0235ba0841 None admin] PATH_INFO: `/v3/projects/31b95974fb8c4d02846fc37668733449` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:54.403714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9798dde-dbfe-4e10-b142-7d0235ba0841 None admin] RBAC: Authorizing `identity:get_project(project_id=31b95974fb8c4d02846fc37668733449)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:54.405140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9798dde-dbfe-4e10-b142-7d0235ba0841 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:54.407274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 602/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:20:54 2022] GET /identity/v3/projects/31b95974fb8c4d02846fc37668733449 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:54.413592 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f0dc7-a5e4-43d0-afba-ddd044bc0cb1 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:54.509701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f0dc7-a5e4-43d0-afba-ddd044bc0cb1 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:54.542960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8618281-d241-4f5b-a1bf-e08e5906b181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:54.543612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8618281-d241-4f5b-a1bf-e08e5906b181 None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:54.543894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8618281-d241-4f5b-a1bf-e08e5906b181 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:54.544168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8618281-d241-4f5b-a1bf-e08e5906b181 None admin] PATH_INFO: `/v3/projects/31b95974fb8c4d02846fc37668733449/users/6a9f2ad3b9004dffbf1940056c628acd/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:54.546067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8618281-d241-4f5b-a1bf-e08e5906b181 None admin] RBAC: Authorizing `identity:create_grant(project_id=31b95974fb8c4d02846fc37668733449, user_id=6a9f2ad3b9004dffbf1940056c628acd, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:54.547524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8618281-d241-4f5b-a1bf-e08e5906b181 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:54.630872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 590/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:20:54 2022] PUT /identity/v3/projects/31b95974fb8c4d02846fc37668733449/users/6a9f2ad3b9004dffbf1940056c628acd/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:20:56.617118 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a82a79-cd7e-449c-9e57-05be681a176a None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:56.617672 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a82a79-cd7e-449c-9e57-05be681a176a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:56.617672 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a82a79-cd7e-449c-9e57-05be681a176a None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:56.619079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 603/1193] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:20:56.624278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e33f90-5c00-455d-8c2c-f80483891913 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:56.624712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e33f90-5c00-455d-8c2c-f80483891913 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:56.624842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e33f90-5c00-455d-8c2c-f80483891913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:56.643322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e7e33f90-5c00-455d-8c2c-f80483891913 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:20:56.645078 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e7e33f90-5c00-455d-8c2c-f80483891913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:20:56.683934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:56.709362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 591/1194] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:20:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:20:56.732916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a82a79-cd7e-449c-9e57-05be681a176a None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:56.835162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a82a79-cd7e-449c-9e57-05be681a176a None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:56.869138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a6030-bfd4-4161-934d-f5a495749268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:56.869712 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a6030-bfd4-4161-934d-f5a495749268 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:56.869998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a6030-bfd4-4161-934d-f5a495749268 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:56.870280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a6030-bfd4-4161-934d-f5a495749268 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:56.880722 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a6030-bfd4-4161-934d-f5a495749268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-fb9a6030-bfd4-4161-934d-f5a495749268 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:20:56.885618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:20:56.886714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:20:56.887894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 604/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:20:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:20:56.892820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e33f90-5c00-455d-8c2c-f80483891913 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:56.989404 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e33f90-5c00-455d-8c2c-f80483891913 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:57.022917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c121b-1bb9-4b4e-ae5c-786d5fc8a91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:57.023524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c121b-1bb9-4b4e-ae5c-786d5fc8a91e None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:57.023809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c121b-1bb9-4b4e-ae5c-786d5fc8a91e None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:57.024084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c121b-1bb9-4b4e-ae5c-786d5fc8a91e None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:57.024791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c121b-1bb9-4b4e-ae5c-786d5fc8a91e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:57.025098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c121b-1bb9-4b4e-ae5c-786d5fc8a91e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:57.026467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c121b-1bb9-4b4e-ae5c-786d5fc8a91e None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:57.034300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 592/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:20:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:57.040118 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a6030-bfd4-4161-934d-f5a495749268 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:57.076107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:57.140464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a6030-bfd4-4161-934d-f5a495749268 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:57.173444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f9336-3857-4934-9bd0-0d67fa8a9ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:57.174068 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f9336-3857-4934-9bd0-0d67fa8a9ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:57.174348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f9336-3857-4934-9bd0-0d67fa8a9ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:57.174655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f9336-3857-4934-9bd0-0d67fa8a9ed3 None admin] PATH_INFO: `/v3/users/6a9f2ad3b9004dffbf1940056c628acd` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:57.175810 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f9336-3857-4934-9bd0-0d67fa8a9ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=6a9f2ad3b9004dffbf1940056c628acd)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:57.177224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f9336-3857-4934-9bd0-0d67fa8a9ed3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:57.178833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 605/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Thu Aug 4 02:20:57 2022] GET /identity/v3/users/6a9f2ad3b9004dffbf1940056c628acd => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:57.184811 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c121b-1bb9-4b4e-ae5c-786d5fc8a91e None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:57.220758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:57.282671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c121b-1bb9-4b4e-ae5c-786d5fc8a91e None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:57.315342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb68c4-c2fa-4142-88ee-56c29a61d0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:57.316584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb68c4-c2fa-4142-88ee-56c29a61d0ea None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:57.316903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb68c4-c2fa-4142-88ee-56c29a61d0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:57.317170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb68c4-c2fa-4142-88ee-56c29a61d0ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:57.381460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb68c4-c2fa-4142-88ee-56c29a61d0ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:57.382935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb68c4-c2fa-4142-88ee-56c29a61d0ea None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:57.414570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:57.476873 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 593/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:20:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:20:57.482872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f9336-3857-4934-9bd0-0d67fa8a9ed3 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:57.579759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f9336-3857-4934-9bd0-0d67fa8a9ed3 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:57.582112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:57.612181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9a6be-6460-4521-b03d-b48c4528fd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:57.613543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9a6be-6460-4521-b03d-b48c4528fd47 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:57.614021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9a6be-6460-4521-b03d-b48c4528fd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:57.614536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9a6be-6460-4521-b03d-b48c4528fd47 None admin] PATH_INFO: `/v3/projects/31b95974fb8c4d02846fc37668733449` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:57.615966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9a6be-6460-4521-b03d-b48c4528fd47 None admin] RBAC: Authorizing `identity:get_project(project_id=31b95974fb8c4d02846fc37668733449)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:57.617449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9a6be-6460-4521-b03d-b48c4528fd47 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:57.619151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 606/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Thu Aug 4 02:20:57 2022] GET /identity/v3/projects/31b95974fb8c4d02846fc37668733449 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:20:57.625161 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb68c4-c2fa-4142-88ee-56c29a61d0ea None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:20:57.721507 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb68c4-c2fa-4142-88ee-56c29a61d0ea None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:20:57.754348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e5fc2-8c33-4d44-90c1-a8f38d30d711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:20:57.754978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e5fc2-8c33-4d44-90c1-a8f38d30d711 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:20:57.755262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e5fc2-8c33-4d44-90c1-a8f38d30d711 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:20:57.755543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e5fc2-8c33-4d44-90c1-a8f38d30d711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:20:57.756321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e5fc2-8c33-4d44-90c1-a8f38d30d711 None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=31b95974fb8c4d02846fc37668733449, user.id=6a9f2ad3b9004dffbf1940056c628acd) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:20:57.756633 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e5fc2-8c33-4d44-90c1-a8f38d30d711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:20:57.758047 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e5fc2-8c33-4d44-90c1-a8f38d30d711 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:20:57.760776 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:20:57.763967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 594/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:20:57 2022] GET /identity/v3/role_assignments?user.id=6a9f2ad3b9004dffbf1940056c628acd&scope.project.id=31b95974fb8c4d02846fc37668733449&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:21:07.615792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=14 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:08.892234 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22031-918f-4a87-9286-93e7db108652 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:08.892935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22031-918f-4a87-9286-93e7db108652 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:08.892935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22031-918f-4a87-9286-93e7db108652 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:08.894160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 607/1201] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:08.899396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99450110-edf1-42f6-b47a-49c8e265ffcf None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:08.900321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99450110-edf1-42f6-b47a-49c8e265ffcf None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:08.900572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99450110-edf1-42f6-b47a-49c8e265ffcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:08.919018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-99450110-edf1-42f6-b47a-49c8e265ffcf None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:08.920328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-99450110-edf1-42f6-b47a-49c8e265ffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:08.985955 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 595/1202] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:22:09.010957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df22031-918f-4a87-9286-93e7db108652 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:09.114029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df22031-918f-4a87-9286-93e7db108652 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:09.147726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cc552-8570-4193-ab6e-10be02355329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:09.148297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cc552-8570-4193-ab6e-10be02355329 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:09.148583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cc552-8570-4193-ab6e-10be02355329 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:09.148864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cc552-8570-4193-ab6e-10be02355329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:09.158908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cc552-8570-4193-ab6e-10be02355329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:09.160348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cc552-8570-4193-ab6e-10be02355329 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-d09cc552-8570-4193-ab6e-10be02355329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:09.175388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:09.176527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:09.177825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:09.177825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:09.177825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:09.177825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:09.177825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 608/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:09.183412 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99450110-edf1-42f6-b47a-49c8e265ffcf None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:09.280008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99450110-edf1-42f6-b47a-49c8e265ffcf None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:09.309290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:09.315079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa01965-ed93-49cb-bb41-9b2b3b74a4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:09.315694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa01965-ed93-49cb-bb41-9b2b3b74a4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:09.316035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa01965-ed93-49cb-bb41-9b2b3b74a4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:09.316290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa01965-ed93-49cb-bb41-9b2b3b74a4b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:09.316989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa01965-ed93-49cb-bb41-9b2b3b74a4b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:09.317290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa01965-ed93-49cb-bb41-9b2b3b74a4b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:09.318705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa01965-ed93-49cb-bb41-9b2b3b74a4b2 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:09.329671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 596/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:09.335508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cc552-8570-4193-ab6e-10be02355329 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:09.388658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:09.436984 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cc552-8570-4193-ab6e-10be02355329 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:09.470403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2951f8-9708-4351-a251-a234615e2271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:09.471058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2951f8-9708-4351-a251-a234615e2271 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:09.471343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2951f8-9708-4351-a251-a234615e2271 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:09.471621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2951f8-9708-4351-a251-a234615e2271 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:09.472289 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2951f8-9708-4351-a251-a234615e2271 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:09.473748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2951f8-9708-4351-a251-a234615e2271 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:09.546281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 609/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Thu Aug 4 02:22:09 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:11.577533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430f967-ce7a-4aff-b978-f2f51e468a5c None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:11.578108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430f967-ce7a-4aff-b978-f2f51e468a5c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:11.578108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430f967-ce7a-4aff-b978-f2f51e468a5c None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:11.579544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 597/1206] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:11.585016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed337661-9b18-4d62-a0a3-e2a0e3a44309 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:11.585457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed337661-9b18-4d62-a0a3-e2a0e3a44309 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:11.585579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed337661-9b18-4d62-a0a3-e2a0e3a44309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:11.604330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-ed337661-9b18-4d62-a0a3-e2a0e3a44309 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:11.605517 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-ed337661-9b18-4d62-a0a3-e2a0e3a44309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:11.671955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 610/1207] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:22:11.695734 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430f967-ce7a-4aff-b978-f2f51e468a5c None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:11.800466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430f967-ce7a-4aff-b978-f2f51e468a5c None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:11.833709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e2ccd-5a02-4a98-a904-311d52abf57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:11.834287 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e2ccd-5a02-4a98-a904-311d52abf57b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:11.834602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e2ccd-5a02-4a98-a904-311d52abf57b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:11.834881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e2ccd-5a02-4a98-a904-311d52abf57b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:11.846226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e2ccd-5a02-4a98-a904-311d52abf57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-903e2ccd-5a02-4a98-a904-311d52abf57b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:11.851201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:11.854774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:11.855826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 598/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:22:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:11.859256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed337661-9b18-4d62-a0a3-e2a0e3a44309 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:11.898154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:11.957376 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed337661-9b18-4d62-a0a3-e2a0e3a44309 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:11.991693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ddf56-6693-4b74-8749-a7c773a79aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:11.992308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ddf56-6693-4b74-8749-a7c773a79aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:11.992594 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ddf56-6693-4b74-8749-a7c773a79aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:11.992872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ddf56-6693-4b74-8749-a7c773a79aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:11.993734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ddf56-6693-4b74-8749-a7c773a79aa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:11.994041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ddf56-6693-4b74-8749-a7c773a79aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:11.995444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ddf56-6693-4b74-8749-a7c773a79aa5 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:12.003896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 611/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:22:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:12.009691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e2ccd-5a02-4a98-a904-311d52abf57b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:12.062274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:12.111281 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e2ccd-5a02-4a98-a904-311d52abf57b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:12.144244 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166af161-aa03-46c9-800f-c2676262cd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:12.144879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166af161-aa03-46c9-800f-c2676262cd2c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:12.145165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166af161-aa03-46c9-800f-c2676262cd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:12.145438 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166af161-aa03-46c9-800f-c2676262cd2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:12.156394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166af161-aa03-46c9-800f-c2676262cd2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:12.157840 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166af161-aa03-46c9-800f-c2676262cd2c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-166af161-aa03-46c9-800f-c2676262cd2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:12.172030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:12.176354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:12.177484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:12.177484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:12.177484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:12.177484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:12.177484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 599/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:12.179160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ddf56-6693-4b74-8749-a7c773a79aa5 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:12.278313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:12.281210 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ddf56-6693-4b74-8749-a7c773a79aa5 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:12.314791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239408c6-13dd-4480-a636-4efc382bff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:12.315401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239408c6-13dd-4480-a636-4efc382bff40 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:12.316565 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239408c6-13dd-4480-a636-4efc382bff40 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:12.316565 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239408c6-13dd-4480-a636-4efc382bff40 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:12.316740 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239408c6-13dd-4480-a636-4efc382bff40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:12.317044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239408c6-13dd-4480-a636-4efc382bff40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:12.318409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239408c6-13dd-4480-a636-4efc382bff40 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:12.330563 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 612/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:12.336311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166af161-aa03-46c9-800f-c2676262cd2c None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:12.438042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166af161-aa03-46c9-800f-c2676262cd2c None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:12.439549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:12.472716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8ff40-30ee-4ed7-b0da-8edac07f716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:12.473342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8ff40-30ee-4ed7-b0da-8edac07f716a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:12.473621 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8ff40-30ee-4ed7-b0da-8edac07f716a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:12.473918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8ff40-30ee-4ed7-b0da-8edac07f716a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:12.481175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8ff40-30ee-4ed7-b0da-8edac07f716a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:12.482693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8ff40-30ee-4ed7-b0da-8edac07f716a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-05e8ff40-30ee-4ed7-b0da-8edac07f716a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:22:12.495469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:12.496539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:12.497518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:12.497518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:12.497518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:22:12.497518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:22:12.497518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:22:12.497518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:22:12.497518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:22:12.497518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:22:12.497518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:22:12.497518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:12.497518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 600/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:12.503019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239408c6-13dd-4480-a636-4efc382bff40 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:12.601683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239408c6-13dd-4480-a636-4efc382bff40 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:12.636939 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f17ef-2d4b-4ff9-bdbd-59355b8c34d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:12.637724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f17ef-2d4b-4ff9-bdbd-59355b8c34d4 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:12.638009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f17ef-2d4b-4ff9-bdbd-59355b8c34d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:12.638288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f17ef-2d4b-4ff9-bdbd-59355b8c34d4 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:12.639117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f17ef-2d4b-4ff9-bdbd-59355b8c34d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:12.639429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f17ef-2d4b-4ff9-bdbd-59355b8c34d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:12.640882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f17ef-2d4b-4ff9-bdbd-59355b8c34d4 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:12.657972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 613/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Thu Aug 4 02:22:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:12.663791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8ff40-30ee-4ed7-b0da-8edac07f716a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:12.766778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8ff40-30ee-4ed7-b0da-8edac07f716a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:12.800310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ce97a-eafb-4ec4-9c40-6b93339a23ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:12.800920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ce97a-eafb-4ec4-9c40-6b93339a23ca None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:12.801202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ce97a-eafb-4ec4-9c40-6b93339a23ca None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:12.801477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ce97a-eafb-4ec4-9c40-6b93339a23ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:12.831865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:12.869817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ce97a-eafb-4ec4-9c40-6b93339a23ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:12.871452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ce97a-eafb-4ec4-9c40-6b93339a23ca None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:12.967910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 601/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:22:12.973945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f17ef-2d4b-4ff9-bdbd-59355b8c34d4 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:12.993272 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:13.074979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f17ef-2d4b-4ff9-bdbd-59355b8c34d4 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:13.109229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f468b9-9bf6-429d-9cff-b1042cc961ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:13.109867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f468b9-9bf6-429d-9cff-b1042cc961ed None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:13.110164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f468b9-9bf6-429d-9cff-b1042cc961ed None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:13.110419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f468b9-9bf6-429d-9cff-b1042cc961ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:13.120776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f468b9-9bf6-429d-9cff-b1042cc961ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:13.122218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f468b9-9bf6-429d-9cff-b1042cc961ed None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-70f468b9-9bf6-429d-9cff-b1042cc961ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:13.136799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:13.145062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:13.146160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:13.146160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:13.146160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:13.146160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:13.146160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 614/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:13.146530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ce97a-eafb-4ec4-9c40-6b93339a23ca None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:13.205106 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:13.243581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ce97a-eafb-4ec4-9c40-6b93339a23ca None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:13.276850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd34f1-2251-4edc-a48e-117a7f8c2ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:13.277477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd34f1-2251-4edc-a48e-117a7f8c2ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:13.277966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd34f1-2251-4edc-a48e-117a7f8c2ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:13.278773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd34f1-2251-4edc-a48e-117a7f8c2ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:13.279485 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd34f1-2251-4edc-a48e-117a7f8c2ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:13.279802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd34f1-2251-4edc-a48e-117a7f8c2ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:13.281305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd34f1-2251-4edc-a48e-117a7f8c2ee3 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:13.293737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 602/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:13.299568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f468b9-9bf6-429d-9cff-b1042cc961ed None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:13.370479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:13.401218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f468b9-9bf6-429d-9cff-b1042cc961ed None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:13.437539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb6f78-de66-404b-b14b-c043586c3a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:13.438178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb6f78-de66-404b-b14b-c043586c3a43 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:13.438466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb6f78-de66-404b-b14b-c043586c3a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:13.438779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb6f78-de66-404b-b14b-c043586c3a43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:13.445365 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb6f78-de66-404b-b14b-c043586c3a43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:13.446862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb6f78-de66-404b-b14b-c043586c3a43 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-d0bb6f78-de66-404b-b14b-c043586c3a43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:22:13.458411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:13.459626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:13.460724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:22:13.460724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:22:13.460724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:22:13.460724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:22:13.460724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:22:13.460724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:22:13.460724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:22:13.460724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:13.460724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 615/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:13.466879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd34f1-2251-4edc-a48e-117a7f8c2ee3 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:13.564791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd34f1-2251-4edc-a48e-117a7f8c2ee3 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:13.587149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:13.599190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b12802-ae5f-47af-bf6f-3db96a620581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:13.599800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b12802-ae5f-47af-bf6f-3db96a620581 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:13.600086 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b12802-ae5f-47af-bf6f-3db96a620581 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:13.600364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b12802-ae5f-47af-bf6f-3db96a620581 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:13.601102 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b12802-ae5f-47af-bf6f-3db96a620581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:13.601410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b12802-ae5f-47af-bf6f-3db96a620581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:13.602871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b12802-ae5f-47af-bf6f-3db96a620581 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:13.614104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 603/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:22:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:13.620503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb6f78-de66-404b-b14b-c043586c3a43 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:13.720258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb6f78-de66-404b-b14b-c043586c3a43 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:13.750448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:13.756252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cfab2-af00-4e38-9d16-bb7c0bf595b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:13.756870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cfab2-af00-4e38-9d16-bb7c0bf595b1 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:13.757158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cfab2-af00-4e38-9d16-bb7c0bf595b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:13.757436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cfab2-af00-4e38-9d16-bb7c0bf595b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:13.758216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cfab2-af00-4e38-9d16-bb7c0bf595b1 None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=423ac00601f84e3d9c6cc6ee20eee6ae) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:13.758563 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cfab2-af00-4e38-9d16-bb7c0bf595b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:13.760531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8cfab2-af00-4e38-9d16-bb7c0bf595b1 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:13.765883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 616/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:13 2022] GET /identity/v3/role_assignments?user.id=423ac00601f84e3d9c6cc6ee20eee6ae&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:15.759921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984192b-99da-45e0-9f2e-ec587974e1b2 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:15.760527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984192b-99da-45e0-9f2e-ec587974e1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:15.760527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984192b-99da-45e0-9f2e-ec587974e1b2 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:15.761897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 604/1220] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:15.767175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf25fb-5310-4075-9f67-e23853ed99d0 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:15.767604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf25fb-5310-4075-9f67-e23853ed99d0 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:15.767734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf25fb-5310-4075-9f67-e23853ed99d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:15.786662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-00cf25fb-5310-4075-9f67-e23853ed99d0 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:15.787864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-00cf25fb-5310-4075-9f67-e23853ed99d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:15.855957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 617/1221] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:22:15.878717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984192b-99da-45e0-9f2e-ec587974e1b2 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:15.981022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984192b-99da-45e0-9f2e-ec587974e1b2 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.014284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1aa4f-bf83-4dbf-8de4-8eaaa6ac7395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.014878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1aa4f-bf83-4dbf-8de4-8eaaa6ac7395 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.015160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1aa4f-bf83-4dbf-8de4-8eaaa6ac7395 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.015431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1aa4f-bf83-4dbf-8de4-8eaaa6ac7395 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.025180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1aa4f-bf83-4dbf-8de4-8eaaa6ac7395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-0cb1aa4f-bf83-4dbf-8de4-8eaaa6ac7395 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:16.030742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:16.031876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:16.032758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 605/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:22:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:22:16.037908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf25fb-5310-4075-9f67-e23853ed99d0 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.134461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf25fb-5310-4075-9f67-e23853ed99d0 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.158617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:16.169288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2d3bc-540a-4f52-aee3-747ea8623405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.169904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2d3bc-540a-4f52-aee3-747ea8623405 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.170191 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2d3bc-540a-4f52-aee3-747ea8623405 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.170471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2d3bc-540a-4f52-aee3-747ea8623405 None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.171216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2d3bc-540a-4f52-aee3-747ea8623405 None admin] RBAC: Adding query filter params (name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:16.171524 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2d3bc-540a-4f52-aee3-747ea8623405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:16.173032 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2d3bc-540a-4f52-aee3-747ea8623405 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:16.180878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 618/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:16.187709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1aa4f-bf83-4dbf-8de4-8eaaa6ac7395 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.231410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:16.286689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1aa4f-bf83-4dbf-8de4-8eaaa6ac7395 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.323435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62086365-469f-4f66-a38d-45f1549adc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.324075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62086365-469f-4f66-a38d-45f1549adc99 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.324360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62086365-469f-4f66-a38d-45f1549adc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.324640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62086365-469f-4f66-a38d-45f1549adc99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.334986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62086365-469f-4f66-a38d-45f1549adc99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:16.336443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62086365-469f-4f66-a38d-45f1549adc99 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-62086365-469f-4f66-a38d-45f1549adc99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:16.351211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:16.352306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:16.353574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:16.353574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:16.353574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:16.353574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:16.353574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 606/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:16.358336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2d3bc-540a-4f52-aee3-747ea8623405 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.459496 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2d3bc-540a-4f52-aee3-747ea8623405 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.493433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2499e0-f64b-4a66-89fc-fd5875b742a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.494051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2499e0-f64b-4a66-89fc-fd5875b742a5 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.494338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2499e0-f64b-4a66-89fc-fd5875b742a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.494649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2499e0-f64b-4a66-89fc-fd5875b742a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.495331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2499e0-f64b-4a66-89fc-fd5875b742a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:16.495674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2499e0-f64b-4a66-89fc-fd5875b742a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:16.497054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2499e0-f64b-4a66-89fc-fd5875b742a5 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:16.508629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 619/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:16.514652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62086365-469f-4f66-a38d-45f1549adc99 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.607841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:16.614082 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62086365-469f-4f66-a38d-45f1549adc99 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.646897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb37a5-25de-411f-917b-59862ecb66dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.647521 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb37a5-25de-411f-917b-59862ecb66dc None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.647805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb37a5-25de-411f-917b-59862ecb66dc None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.648081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb37a5-25de-411f-917b-59862ecb66dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.655602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb37a5-25de-411f-917b-59862ecb66dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:16.657030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb37a5-25de-411f-917b-59862ecb66dc None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-8bdb37a5-25de-411f-917b-59862ecb66dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:22:16.668254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:16.669285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:16.670815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:16.670815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:16.670815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:22:16.670815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:22:16.670815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:22:16.670815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:22:16.670815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:22:16.670815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:22:16.670815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:22:16.670815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:16.670815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 607/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:16.675487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2499e0-f64b-4a66-89fc-fd5875b742a5 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.724634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:16.778947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2499e0-f64b-4a66-89fc-fd5875b742a5 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.812817 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61941a35-5d84-4414-b76e-76a19f2cb2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.813494 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61941a35-5d84-4414-b76e-76a19f2cb2fe None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.813778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61941a35-5d84-4414-b76e-76a19f2cb2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.814060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61941a35-5d84-4414-b76e-76a19f2cb2fe None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.814882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61941a35-5d84-4414-b76e-76a19f2cb2fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:16.815200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61941a35-5d84-4414-b76e-76a19f2cb2fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:16.816641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61941a35-5d84-4414-b76e-76a19f2cb2fe None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:16.833925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 620/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:16.840504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb37a5-25de-411f-917b-59862ecb66dc None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.941460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb37a5-25de-411f-917b-59862ecb66dc None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.975649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c3743-3bec-4f21-abe4-2fa5c8f283a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.976285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c3743-3bec-4f21-abe4-2fa5c8f283a9 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.976573 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c3743-3bec-4f21-abe4-2fa5c8f283a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.976854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c3743-3bec-4f21-abe4-2fa5c8f283a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.987652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c3743-3bec-4f21-abe4-2fa5c8f283a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:16.989115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c3743-3bec-4f21-abe4-2fa5c8f283a9 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-8c3c3743-3bec-4f21-abe4-2fa5c8f283a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:17.004090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:17.005143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:17.015230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:17.015230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:17.015230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:17.015230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:17.015230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 608/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:17.015598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61941a35-5d84-4414-b76e-76a19f2cb2fe None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.111810 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61941a35-5d84-4414-b76e-76a19f2cb2fe None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.114049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.145785 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22f15a-0ebc-49d6-bde1-4d38b161750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.146440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22f15a-0ebc-49d6-bde1-4d38b161750c None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.146760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22f15a-0ebc-49d6-bde1-4d38b161750c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.147047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22f15a-0ebc-49d6-bde1-4d38b161750c None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.147741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22f15a-0ebc-49d6-bde1-4d38b161750c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:17.148050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22f15a-0ebc-49d6-bde1-4d38b161750c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.149426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22f15a-0ebc-49d6-bde1-4d38b161750c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.160767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 621/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:17.166563 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c3743-3bec-4f21-abe4-2fa5c8f283a9 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.176273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.264691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c3743-3bec-4f21-abe4-2fa5c8f283a9 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.298066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997564a-2b1d-4667-b9c1-0d9df5e899a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.298735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997564a-2b1d-4667-b9c1-0d9df5e899a8 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.299066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997564a-2b1d-4667-b9c1-0d9df5e899a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.299342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997564a-2b1d-4667-b9c1-0d9df5e899a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.305914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997564a-2b1d-4667-b9c1-0d9df5e899a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.308039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997564a-2b1d-4667-b9c1-0d9df5e899a8 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-f997564a-2b1d-4667-b9c1-0d9df5e899a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:22:17.319669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:17.320622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:17.321712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:22:17.321712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:22:17.321712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:22:17.321712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:22:17.321712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:22:17.321712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:22:17.321712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:22:17.321712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:17.321712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 609/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:17.326889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22f15a-0ebc-49d6-bde1-4d38b161750c None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.428303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22f15a-0ebc-49d6-bde1-4d38b161750c None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.462022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14054f-77b6-43ef-92a3-397c30b7a0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.462691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14054f-77b6-43ef-92a3-397c30b7a0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.462977 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14054f-77b6-43ef-92a3-397c30b7a0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.463257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14054f-77b6-43ef-92a3-397c30b7a0e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.464130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14054f-77b6-43ef-92a3-397c30b7a0e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:17.464440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14054f-77b6-43ef-92a3-397c30b7a0e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.465875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14054f-77b6-43ef-92a3-397c30b7a0e3 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.477688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 622/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:22:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:17.484325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997564a-2b1d-4667-b9c1-0d9df5e899a8 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.550642 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.584925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997564a-2b1d-4667-b9c1-0d9df5e899a8 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.618200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8354-46f1-44b0-9167-384d586d5749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.618893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8354-46f1-44b0-9167-384d586d5749 None admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.619182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8354-46f1-44b0-9167-384d586d5749 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.619460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8354-46f1-44b0-9167-384d586d5749 None admin] PATH_INFO: `/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/423ac00601f84e3d9c6cc6ee20eee6ae/roles/f71c9be92ae0492884ac931960b85e94` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.634338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa8354-46f1-44b0-9167-384d586d5749 None admin] RBAC: Authorizing `identity:create_grant(project_id=fae65363f2fb415b834ac367a6c4b7ad, user_id=423ac00601f84e3d9c6cc6ee20eee6ae, role_id=f71c9be92ae0492884ac931960b85e94)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.635927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa8354-46f1-44b0-9167-384d586d5749 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.790981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 610/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:22:17 2022] PUT /identity/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/423ac00601f84e3d9c6cc6ee20eee6ae/roles/f71c9be92ae0492884ac931960b85e94 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:19.777166 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923381e1-6c2f-4f02-8da8-d68bf8f48dc7 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:19.777695 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923381e1-6c2f-4f02-8da8-d68bf8f48dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:19.777821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923381e1-6c2f-4f02-8da8-d68bf8f48dc7 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:19.779202 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 623/1233] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:19.784698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b842dab-3f26-4075-bbed-c634ba0d475b None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:19.785102 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b842dab-3f26-4075-bbed-c634ba0d475b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:19.785244 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b842dab-3f26-4075-bbed-c634ba0d475b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:19.803656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-3b842dab-3f26-4075-bbed-c634ba0d475b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:19.804835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-3b842dab-3f26-4075-bbed-c634ba0d475b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:19.872119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 611/1234] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:22:19.895316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923381e1-6c2f-4f02-8da8-d68bf8f48dc7 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:19.922009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:19.995866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923381e1-6c2f-4f02-8da8-d68bf8f48dc7 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:20.029804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed3be6-15f9-48f7-bf72-eb203fc5ab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:20.030385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed3be6-15f9-48f7-bf72-eb203fc5ab51 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:20.030710 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed3be6-15f9-48f7-bf72-eb203fc5ab51 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:20.030989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed3be6-15f9-48f7-bf72-eb203fc5ab51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:20.042668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed3be6-15f9-48f7-bf72-eb203fc5ab51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-a9ed3be6-15f9-48f7-bf72-eb203fc5ab51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:20.050097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:20.051246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:20.052312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 624/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Thu Aug 4 02:22:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:20.055129 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b842dab-3f26-4075-bbed-c634ba0d475b None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:20.102115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:20.153035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b842dab-3f26-4075-bbed-c634ba0d475b None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:20.186162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02f28e-6b4b-4b43-8e2f-6527701a4705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:20.186822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02f28e-6b4b-4b43-8e2f-6527701a4705 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:20.187107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02f28e-6b4b-4b43-8e2f-6527701a4705 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:20.187384 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02f28e-6b4b-4b43-8e2f-6527701a4705 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:20.188096 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02f28e-6b4b-4b43-8e2f-6527701a4705 None admin] RBAC: Adding query filter params (name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:20.188402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02f28e-6b4b-4b43-8e2f-6527701a4705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:20.189768 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02f28e-6b4b-4b43-8e2f-6527701a4705 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:20.197962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 612/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Thu Aug 4 02:22:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:20.203866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed3be6-15f9-48f7-bf72-eb203fc5ab51 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:20.290108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:20.306417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed3be6-15f9-48f7-bf72-eb203fc5ab51 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:20.341674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f8543-3c46-48f3-b752-3ec418a5929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:20.342336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f8543-3c46-48f3-b752-3ec418a5929b None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:20.342660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f8543-3c46-48f3-b752-3ec418a5929b None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:20.342939 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f8543-3c46-48f3-b752-3ec418a5929b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:20.353052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f8543-3c46-48f3-b752-3ec418a5929b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:20.354598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f8543-3c46-48f3-b752-3ec418a5929b None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-e18f8543-3c46-48f3-b752-3ec418a5929b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:20.369378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:20.375595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:20.376715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:20.376715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:20.376715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:20.376715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:20.376715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 625/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:20.377066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02f28e-6b4b-4b43-8e2f-6527701a4705 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:20.478127 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02f28e-6b4b-4b43-8e2f-6527701a4705 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:20.487065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:20.511220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0849a-1e72-4157-bbad-53945f561ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:20.511825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0849a-1e72-4157-bbad-53945f561ebb None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:20.512104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0849a-1e72-4157-bbad-53945f561ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:20.512375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0849a-1e72-4157-bbad-53945f561ebb None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:20.513055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0849a-1e72-4157-bbad-53945f561ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:20.513356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0849a-1e72-4157-bbad-53945f561ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:20.514803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0849a-1e72-4157-bbad-53945f561ebb None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:20.526083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 613/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:20.532639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f8543-3c46-48f3-b752-3ec418a5929b None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:20.633050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f8543-3c46-48f3-b752-3ec418a5929b None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:20.667360 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552014b-044c-41a5-8aba-f84cab533598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:20.667976 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552014b-044c-41a5-8aba-f84cab533598 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:20.668261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552014b-044c-41a5-8aba-f84cab533598 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:20.668574 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552014b-044c-41a5-8aba-f84cab533598 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:20.671766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:20.677597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552014b-044c-41a5-8aba-f84cab533598 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:20.679086 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552014b-044c-41a5-8aba-f84cab533598 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-0552014b-044c-41a5-8aba-f84cab533598 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:22:20.691184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:20.692278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:20.693345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:20.693345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:20.693345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:22:20.693345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:22:20.693345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:22:20.693345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:22:20.693345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:22:20.693345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:22:20.693345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:22:20.693345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:20.693345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 626/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:20.699173 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0849a-1e72-4157-bbad-53945f561ebb None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:20.797313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0849a-1e72-4157-bbad-53945f561ebb None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:20.832513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134efb33-7d6c-457c-98ad-1b014a9b4efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:20.833131 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134efb33-7d6c-457c-98ad-1b014a9b4efb None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:20.833416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134efb33-7d6c-457c-98ad-1b014a9b4efb None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:20.833694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134efb33-7d6c-457c-98ad-1b014a9b4efb None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:20.834514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134efb33-7d6c-457c-98ad-1b014a9b4efb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:20.834829 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134efb33-7d6c-457c-98ad-1b014a9b4efb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:20.836295 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134efb33-7d6c-457c-98ad-1b014a9b4efb None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:20.854278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 614/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Thu Aug 4 02:22:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:20.860213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552014b-044c-41a5-8aba-f84cab533598 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:20.958539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552014b-044c-41a5-8aba-f84cab533598 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:20.990593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62931d-14d6-4c33-83f0-0fc5898cb6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:20.991203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62931d-14d6-4c33-83f0-0fc5898cb6ee None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:20.991481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62931d-14d6-4c33-83f0-0fc5898cb6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:20.991752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62931d-14d6-4c33-83f0-0fc5898cb6ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.052412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:21.060011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62931d-14d6-4c33-83f0-0fc5898cb6ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:21.061470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62931d-14d6-4c33-83f0-0fc5898cb6ee None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:21.156389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 627/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:22:21.162031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134efb33-7d6c-457c-98ad-1b014a9b4efb None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.190189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:21.261060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134efb33-7d6c-457c-98ad-1b014a9b4efb None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.295141 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177112d-f016-4044-be2e-1f790f11f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.295776 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177112d-f016-4044-be2e-1f790f11f91a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.296059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177112d-f016-4044-be2e-1f790f11f91a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.296333 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177112d-f016-4044-be2e-1f790f11f91a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.306229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177112d-f016-4044-be2e-1f790f11f91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:21.308446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177112d-f016-4044-be2e-1f790f11f91a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-e177112d-f016-4044-be2e-1f790f11f91a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:21.323072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:21.324149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:21.325369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:21.325369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:21.325369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:21.325369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:21.325369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 615/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:21.329941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62931d-14d6-4c33-83f0-0fc5898cb6ee None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.429540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:21.435877 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62931d-14d6-4c33-83f0-0fc5898cb6ee None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.468806 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d697a-142e-4465-a346-d36809505ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.469457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d697a-142e-4465-a346-d36809505ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.469744 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d697a-142e-4465-a346-d36809505ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.470021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d697a-142e-4465-a346-d36809505ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.470734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d697a-142e-4465-a346-d36809505ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:21.471041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d697a-142e-4465-a346-d36809505ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:21.472428 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d697a-142e-4465-a346-d36809505ab7 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:21.483983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 628/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:21.489609 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177112d-f016-4044-be2e-1f790f11f91a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.568606 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:21.589910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177112d-f016-4044-be2e-1f790f11f91a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.622208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c14a5-5cd2-4347-a285-5351f2024860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.622868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c14a5-5cd2-4347-a285-5351f2024860 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.623150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c14a5-5cd2-4347-a285-5351f2024860 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.623424 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c14a5-5cd2-4347-a285-5351f2024860 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.629863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c14a5-5cd2-4347-a285-5351f2024860 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:21.633928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c14a5-5cd2-4347-a285-5351f2024860 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-179c14a5-5cd2-4347-a285-5351f2024860 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:22:21.642350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:21.646423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:21.647651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:22:21.647651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:22:21.647651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:22:21.647651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:22:21.647651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:22:21.647651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:22:21.647651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:22:21.647651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:21.647651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 616/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:21.649446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d697a-142e-4465-a346-d36809505ab7 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.750009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d697a-142e-4465-a346-d36809505ab7 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.784220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198ace0-6329-484c-b00d-e7166abb5181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.784836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198ace0-6329-484c-b00d-e7166abb5181 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.785133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198ace0-6329-484c-b00d-e7166abb5181 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.785396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198ace0-6329-484c-b00d-e7166abb5181 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.786175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198ace0-6329-484c-b00d-e7166abb5181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:21.786480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198ace0-6329-484c-b00d-e7166abb5181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:21.788017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198ace0-6329-484c-b00d-e7166abb5181 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:21.801514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 629/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:21.808059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c14a5-5cd2-4347-a285-5351f2024860 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.909602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c14a5-5cd2-4347-a285-5351f2024860 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.943025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793fb43-841b-4e0f-a235-d605282a073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.943647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793fb43-841b-4e0f-a235-d605282a073b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.943929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793fb43-841b-4e0f-a235-d605282a073b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.944201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793fb43-841b-4e0f-a235-d605282a073b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.944985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793fb43-841b-4e0f-a235-d605282a073b None admin] RBAC: Adding query filter params (role.id=f71c9be92ae0492884ac931960b85e94, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=423ac00601f84e3d9c6cc6ee20eee6ae) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:21.945294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793fb43-841b-4e0f-a235-d605282a073b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:21.946741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793fb43-841b-4e0f-a235-d605282a073b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:21.953022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 617/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/role_assignments?user.id=423ac00601f84e3d9c6cc6ee20eee6ae&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=f71c9be92ae0492884ac931960b85e94 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:24.038617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d97d5-0ca2-4d71-834f-decce9369eaa None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:24.039184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d97d5-0ca2-4d71-834f-decce9369eaa None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:24.039184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d97d5-0ca2-4d71-834f-decce9369eaa None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:24.040522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 630/1247] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:24.046573 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d3fd1-ee09-4598-be83-aef25729d98c None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:24.047071 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d3fd1-ee09-4598-be83-aef25729d98c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:24.047190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d3fd1-ee09-4598-be83-aef25729d98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:24.053375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:24.066109 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-a70d3fd1-ee09-4598-be83-aef25729d98c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:24.067329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a70d3fd1-ee09-4598-be83-aef25729d98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:24.130687 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 618/1248] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:22:24.153548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d97d5-0ca2-4d71-834f-decce9369eaa None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:24.172226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:24.255677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d97d5-0ca2-4d71-834f-decce9369eaa None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:24.289552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041987e-29b1-4cde-a6c2-d9d0970e21c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:24.290125 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041987e-29b1-4cde-a6c2-d9d0970e21c6 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:24.290412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041987e-29b1-4cde-a6c2-d9d0970e21c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:24.290722 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041987e-29b1-4cde-a6c2-d9d0970e21c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:24.301857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041987e-29b1-4cde-a6c2-d9d0970e21c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-6041987e-29b1-4cde-a6c2-d9d0970e21c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:24.306838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:24.308649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:24.309804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 631/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:24.315022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d3fd1-ee09-4598-be83-aef25729d98c None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:24.413582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d3fd1-ee09-4598-be83-aef25729d98c None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:24.444110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:24.449681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496ef91-e9c4-4272-b85e-10bd260a7842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:24.450302 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496ef91-e9c4-4272-b85e-10bd260a7842 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:24.450632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496ef91-e9c4-4272-b85e-10bd260a7842 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:24.450900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496ef91-e9c4-4272-b85e-10bd260a7842 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:24.451620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496ef91-e9c4-4272-b85e-10bd260a7842 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:24.451927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496ef91-e9c4-4272-b85e-10bd260a7842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:24.453311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496ef91-e9c4-4272-b85e-10bd260a7842 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:24.461541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 619/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:24.467313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041987e-29b1-4cde-a6c2-d9d0970e21c6 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:24.544904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:24.567640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041987e-29b1-4cde-a6c2-d9d0970e21c6 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:24.601079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df825160-239c-4096-9257-d8153bb8ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:24.601714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df825160-239c-4096-9257-d8153bb8ea19 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:24.602003 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df825160-239c-4096-9257-d8153bb8ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:24.602289 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df825160-239c-4096-9257-d8153bb8ea19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:24.612182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df825160-239c-4096-9257-d8153bb8ea19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:24.613682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df825160-239c-4096-9257-d8153bb8ea19 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-df825160-239c-4096-9257-d8153bb8ea19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:24.628771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:24.636724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:24.637657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:24.637657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:24.637657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:24.637657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:24.637657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 632/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:24.637971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496ef91-e9c4-4272-b85e-10bd260a7842 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:24.734836 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496ef91-e9c4-4272-b85e-10bd260a7842 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:24.768321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8bfb-36c5-4ac6-aab5-1bdf60a62e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:24.768930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8bfb-36c5-4ac6-aab5-1bdf60a62e17 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:24.769212 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8bfb-36c5-4ac6-aab5-1bdf60a62e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:24.769488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d8bfb-36c5-4ac6-aab5-1bdf60a62e17 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:24.770168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8bfb-36c5-4ac6-aab5-1bdf60a62e17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:24.770474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8bfb-36c5-4ac6-aab5-1bdf60a62e17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:24.771878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d8bfb-36c5-4ac6-aab5-1bdf60a62e17 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:24.783936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 620/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:24.789814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df825160-239c-4096-9257-d8153bb8ea19 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:24.889222 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df825160-239c-4096-9257-d8153bb8ea19 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:24.914325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:24.922764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83bd79-8c75-4e4c-a76e-d5de8df4b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:24.923395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83bd79-8c75-4e4c-a76e-d5de8df4b10d None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:24.923682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83bd79-8c75-4e4c-a76e-d5de8df4b10d None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:24.923959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83bd79-8c75-4e4c-a76e-d5de8df4b10d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:24.931205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83bd79-8c75-4e4c-a76e-d5de8df4b10d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:24.933658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83bd79-8c75-4e4c-a76e-d5de8df4b10d None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-6d83bd79-8c75-4e4c-a76e-d5de8df4b10d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:22:24.944904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:24.946077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:24.947334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:24.947334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:24.947334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:22:24.947334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:22:24.947334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:22:24.947334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:22:24.947334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:22:24.947334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:22:24.947334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:22:24.947334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:24.947334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 633/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:24.952103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8bfb-36c5-4ac6-aab5-1bdf60a62e17 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:25.006693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:25.050931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d8bfb-36c5-4ac6-aab5-1bdf60a62e17 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:25.085614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbae29e-c2ec-4ec2-8feb-5c7179b8931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:25.086231 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbae29e-c2ec-4ec2-8feb-5c7179b8931e None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:25.086551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbae29e-c2ec-4ec2-8feb-5c7179b8931e None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:25.086836 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbae29e-c2ec-4ec2-8feb-5c7179b8931e None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:25.087740 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbae29e-c2ec-4ec2-8feb-5c7179b8931e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:25.088314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbae29e-c2ec-4ec2-8feb-5c7179b8931e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:25.090294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbae29e-c2ec-4ec2-8feb-5c7179b8931e None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:25.110542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 621/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Thu Aug 4 02:22:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:25.116322 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83bd79-8c75-4e4c-a76e-d5de8df4b10d None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:25.216635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83bd79-8c75-4e4c-a76e-d5de8df4b10d None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:25.251505 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b53e3-cbc3-4b69-9998-30c1ea20cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:25.252120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b53e3-cbc3-4b69-9998-30c1ea20cb5e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:25.252407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b53e3-cbc3-4b69-9998-30c1ea20cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:25.252702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b53e3-cbc3-4b69-9998-30c1ea20cb5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:25.307574 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:25.319432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b53e3-cbc3-4b69-9998-30c1ea20cb5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:25.320903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b53e3-cbc3-4b69-9998-30c1ea20cb5e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:25.420394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 634/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:22:25.426268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbae29e-c2ec-4ec2-8feb-5c7179b8931e None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:25.529990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbae29e-c2ec-4ec2-8feb-5c7179b8931e None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:25.543566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:25.564227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4655e3-066e-4903-9213-4d23cef020fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:25.564860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4655e3-066e-4903-9213-4d23cef020fb None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:25.565139 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4655e3-066e-4903-9213-4d23cef020fb None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:25.565411 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4655e3-066e-4903-9213-4d23cef020fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:25.575689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4655e3-066e-4903-9213-4d23cef020fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:25.580714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4655e3-066e-4903-9213-4d23cef020fb None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-0d4655e3-066e-4903-9213-4d23cef020fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:25.591730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:25.592751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:25.593710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:25.593710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:25.593710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:25.593710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:25.593710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 622/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:25.599109 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b53e3-cbc3-4b69-9998-30c1ea20cb5e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:25.684562 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:25.696596 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b53e3-cbc3-4b69-9998-30c1ea20cb5e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:25.731088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1c446-3d78-4fdc-b3cb-182ca7264137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:25.731702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1c446-3d78-4fdc-b3cb-182ca7264137 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:25.731991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1c446-3d78-4fdc-b3cb-182ca7264137 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:25.732272 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1c446-3d78-4fdc-b3cb-182ca7264137 None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:25.733005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1c446-3d78-4fdc-b3cb-182ca7264137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:25.733319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1c446-3d78-4fdc-b3cb-182ca7264137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:25.734731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1c446-3d78-4fdc-b3cb-182ca7264137 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:25.745881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 635/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:25.751582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4655e3-066e-4903-9213-4d23cef020fb None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:25.853655 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4655e3-066e-4903-9213-4d23cef020fb None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:25.887525 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8473f-ca77-4016-99fd-bfcc7ef08202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:25.888170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8473f-ca77-4016-99fd-bfcc7ef08202 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:25.888456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8473f-ca77-4016-99fd-bfcc7ef08202 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:25.888734 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8473f-ca77-4016-99fd-bfcc7ef08202 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:25.895652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8473f-ca77-4016-99fd-bfcc7ef08202 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:25.897160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8473f-ca77-4016-99fd-bfcc7ef08202 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-b3e8473f-ca77-4016-99fd-bfcc7ef08202 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:22:25.910395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:25.911551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:25.912781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:22:25.912781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:22:25.912781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:22:25.912781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:22:25.912781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:22:25.912781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:22:25.912781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:22:25.912781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:25.912781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 623/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:25.917564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1c446-3d78-4fdc-b3cb-182ca7264137 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:26.017972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1c446-3d78-4fdc-b3cb-182ca7264137 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:26.053215 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e3762-5ad8-44cc-b288-380f3fad6d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:26.053837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e3762-5ad8-44cc-b288-380f3fad6d67 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.054122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e3762-5ad8-44cc-b288-380f3fad6d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.054397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e3762-5ad8-44cc-b288-380f3fad6d67 None admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.055177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e3762-5ad8-44cc-b288-380f3fad6d67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:26.055487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e3762-5ad8-44cc-b288-380f3fad6d67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:26.056927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e3762-5ad8-44cc-b288-380f3fad6d67 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:26.069786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 636/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:22:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:26.076580 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8473f-ca77-4016-99fd-bfcc7ef08202 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:26.101546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:26.178860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8473f-ca77-4016-99fd-bfcc7ef08202 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:26.216102 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8f290-a498-4c45-a37e-ae775f719fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:26.216712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8f290-a498-4c45-a37e-ae775f719fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.216995 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8f290-a498-4c45-a37e-ae775f719fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.217267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8f290-a498-4c45-a37e-ae775f719fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.218043 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8f290-a498-4c45-a37e-ae775f719fe7 None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=423ac00601f84e3d9c6cc6ee20eee6ae) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:26.218350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8f290-a498-4c45-a37e-ae775f719fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:26.219815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8f290-a498-4c45-a37e-ae775f719fe7 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:26.225017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 624/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:26 2022] GET /identity/v3/role_assignments?user.id=423ac00601f84e3d9c6cc6ee20eee6ae&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:28.210372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb4aec-c71d-4448-9508-87ecdd06cf82 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.210952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb4aec-c71d-4448-9508-87ecdd06cf82 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.210952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb4aec-c71d-4448-9508-87ecdd06cf82 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.212314 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 637/1261] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:28.218170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24d8f-6d91-40bb-82ff-264b077a4547 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.218596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24d8f-6d91-40bb-82ff-264b077a4547 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.218767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24d8f-6d91-40bb-82ff-264b077a4547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.237433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-d9b24d8f-6d91-40bb-82ff-264b077a4547 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:28.238689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d9b24d8f-6d91-40bb-82ff-264b077a4547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:28.304914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 625/1262] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:22:28.326952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb4aec-c71d-4448-9508-87ecdd06cf82 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:28.337766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:28.428755 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb4aec-c71d-4448-9508-87ecdd06cf82 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:28.461314 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f15909-7ba3-41e7-aeab-514728cc1189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:28.461969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15909-7ba3-41e7-aeab-514728cc1189 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.462248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15909-7ba3-41e7-aeab-514728cc1189 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.462544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15909-7ba3-41e7-aeab-514728cc1189 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.473014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f15909-7ba3-41e7-aeab-514728cc1189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-d1f15909-7ba3-41e7-aeab-514728cc1189 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:28.477816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:28.483424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:28.484492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 638/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:28.485795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b24d8f-6d91-40bb-82ff-264b077a4547 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:28.504508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:28.584140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b24d8f-6d91-40bb-82ff-264b077a4547 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:28.618010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b22dc-0aa2-44c7-ad79-742a67a97108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:28.618657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b22dc-0aa2-44c7-ad79-742a67a97108 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.618945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b22dc-0aa2-44c7-ad79-742a67a97108 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.619224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b22dc-0aa2-44c7-ad79-742a67a97108 None admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.620588 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b22dc-0aa2-44c7-ad79-742a67a97108 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:28.620934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b22dc-0aa2-44c7-ad79-742a67a97108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:28.622345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b22dc-0aa2-44c7-ad79-742a67a97108 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:28.630288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 626/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:28.636368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f15909-7ba3-41e7-aeab-514728cc1189 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:28.704213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:28.737076 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f15909-7ba3-41e7-aeab-514728cc1189 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:28.771108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656c216-86f0-42b6-af93-86ed6237c710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:28.771737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656c216-86f0-42b6-af93-86ed6237c710 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.772019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656c216-86f0-42b6-af93-86ed6237c710 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.772290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656c216-86f0-42b6-af93-86ed6237c710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.782895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656c216-86f0-42b6-af93-86ed6237c710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:28.784762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656c216-86f0-42b6-af93-86ed6237c710 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-3656c216-86f0-42b6-af93-86ed6237c710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:28.799279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:28.800355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:28.801473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:28.801473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:28.801473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:28.801473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:28.801473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 639/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:28.806831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b22dc-0aa2-44c7-ad79-742a67a97108 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:28.891453 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:28.910176 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b22dc-0aa2-44c7-ad79-742a67a97108 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:28.942795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844efd08-ba57-4847-b774-16c94b80eb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:28.943406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844efd08-ba57-4847-b774-16c94b80eb0f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.943689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844efd08-ba57-4847-b774-16c94b80eb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.943964 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844efd08-ba57-4847-b774-16c94b80eb0f None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.944653 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844efd08-ba57-4847-b774-16c94b80eb0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:28.944952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844efd08-ba57-4847-b774-16c94b80eb0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:28.946321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844efd08-ba57-4847-b774-16c94b80eb0f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:28.957085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 627/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:28.962852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656c216-86f0-42b6-af93-86ed6237c710 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:29.064231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656c216-86f0-42b6-af93-86ed6237c710 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:29.083538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:29.098070 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76a0b2-668a-4434-8748-9b5efc2f1149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:29.098746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76a0b2-668a-4434-8748-9b5efc2f1149 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:29.099030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76a0b2-668a-4434-8748-9b5efc2f1149 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:29.099305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76a0b2-668a-4434-8748-9b5efc2f1149 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:29.107426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76a0b2-668a-4434-8748-9b5efc2f1149 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:29.108869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76a0b2-668a-4434-8748-9b5efc2f1149 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-ec76a0b2-668a-4434-8748-9b5efc2f1149 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:22:29.120316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:29.121429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:29.122495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:29.122495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:29.122495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:22:29.122495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:22:29.122495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:22:29.122495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:22:29.122495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:22:29.122495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:22:29.122495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:22:29.122495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:29.122495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 640/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:29.127884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844efd08-ba57-4847-b774-16c94b80eb0f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:29.229804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844efd08-ba57-4847-b774-16c94b80eb0f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:29.262677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abfc8a-61f5-40bc-ac07-e220d13271b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:29.263308 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abfc8a-61f5-40bc-ac07-e220d13271b0 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:29.263593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abfc8a-61f5-40bc-ac07-e220d13271b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:29.263873 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abfc8a-61f5-40bc-ac07-e220d13271b0 None admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:29.264665 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abfc8a-61f5-40bc-ac07-e220d13271b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:29.264979 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abfc8a-61f5-40bc-ac07-e220d13271b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:29.266413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abfc8a-61f5-40bc-ac07-e220d13271b0 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:29.276714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:29.284569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 628/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Thu Aug 4 02:22:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:29.290318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76a0b2-668a-4434-8748-9b5efc2f1149 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:29.394057 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76a0b2-668a-4434-8748-9b5efc2f1149 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:29.427015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d7326-b5ca-4f99-9c10-35dea15dbe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:29.427648 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d7326-b5ca-4f99-9c10-35dea15dbe60 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:29.427934 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d7326-b5ca-4f99-9c10-35dea15dbe60 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:29.428208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d7326-b5ca-4f99-9c10-35dea15dbe60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:29.439878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d7326-b5ca-4f99-9c10-35dea15dbe60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:29.441395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d7326-b5ca-4f99-9c10-35dea15dbe60 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-2d6d7326-b5ca-4f99-9c10-35dea15dbe60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:29.455233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:29.458306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:29.459479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:29.459479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:29.459479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:29.459479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:29.459479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 641/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:29.462223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abfc8a-61f5-40bc-ac07-e220d13271b0 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:29.563186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abfc8a-61f5-40bc-ac07-e220d13271b0 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:29.595717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e61bc7-c7ef-4dd4-9f71-8fb977d7484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:29.596326 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61bc7-c7ef-4dd4-9f71-8fb977d7484a None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:29.596612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61bc7-c7ef-4dd4-9f71-8fb977d7484a None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:29.596887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e61bc7-c7ef-4dd4-9f71-8fb977d7484a None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:29.597565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e61bc7-c7ef-4dd4-9f71-8fb977d7484a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:29.597871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e61bc7-c7ef-4dd4-9f71-8fb977d7484a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:29.599261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e61bc7-c7ef-4dd4-9f71-8fb977d7484a None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:29.610818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 629/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:29.616631 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d7326-b5ca-4f99-9c10-35dea15dbe60 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:29.649163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:29.718298 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d7326-b5ca-4f99-9c10-35dea15dbe60 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:29.753655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677794-20b4-44cf-8aeb-07809df2c4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:29.754290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677794-20b4-44cf-8aeb-07809df2c4fc None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:29.754604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677794-20b4-44cf-8aeb-07809df2c4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:29.754885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677794-20b4-44cf-8aeb-07809df2c4fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:29.761647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca677794-20b4-44cf-8aeb-07809df2c4fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:29.763125 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca677794-20b4-44cf-8aeb-07809df2c4fc None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-ca677794-20b4-44cf-8aeb-07809df2c4fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:22:29.774213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:29.775277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:29.777160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:22:29.777160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:22:29.777160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:22:29.777160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:22:29.777160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:22:29.777160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:22:29.777160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:22:29.777160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:29.777160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 642/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:29.781866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e61bc7-c7ef-4dd4-9f71-8fb977d7484a None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:29.840507 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:29.882296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e61bc7-c7ef-4dd4-9f71-8fb977d7484a None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:29.917390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a0e65-d91a-4a99-9dd9-a86338c23943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:29.918019 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a0e65-d91a-4a99-9dd9-a86338c23943 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:29.918306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a0e65-d91a-4a99-9dd9-a86338c23943 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:29.918624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a0e65-d91a-4a99-9dd9-a86338c23943 None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:29.919379 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a0e65-d91a-4a99-9dd9-a86338c23943 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:29.919690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a0e65-d91a-4a99-9dd9-a86338c23943 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:29.921130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a0e65-d91a-4a99-9dd9-a86338c23943 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:29.933122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 630/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:22:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:29.939456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677794-20b4-44cf-8aeb-07809df2c4fc None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:30.031273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:30.039924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677794-20b4-44cf-8aeb-07809df2c4fc None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:30.076158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afed98-2533-40fd-a88b-5b72f7f6dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:30.076828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afed98-2533-40fd-a88b-5b72f7f6dd5c None admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:30.077120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afed98-2533-40fd-a88b-5b72f7f6dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:30.077395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afed98-2533-40fd-a88b-5b72f7f6dd5c None admin] PATH_INFO: `/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/423ac00601f84e3d9c6cc6ee20eee6ae/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:30.079345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afed98-2533-40fd-a88b-5b72f7f6dd5c None admin] RBAC: Authorizing `identity:create_grant(project_id=fae65363f2fb415b834ac367a6c4b7ad, user_id=423ac00601f84e3d9c6cc6ee20eee6ae, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:30.080777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afed98-2533-40fd-a88b-5b72f7f6dd5c None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:30.191926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 643/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Thu Aug 4 02:22:29 2022] PUT /identity/v3/projects/fae65363f2fb415b834ac367a6c4b7ad/users/423ac00601f84e3d9c6cc6ee20eee6ae/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:32.187387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dbf7c-7cf9-499b-89e5-7e3f43af30df None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.187946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dbf7c-7cf9-499b-89e5-7e3f43af30df None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.187946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dbf7c-7cf9-499b-89e5-7e3f43af30df None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.189321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 631/1274] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:32.194451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff4a97-381f-4450-b64d-027871326f4a None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.194903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff4a97-381f-4450-b64d-027871326f4a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.195034 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff4a97-381f-4450-b64d-027871326f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.213842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-75ff4a97-381f-4450-b64d-027871326f4a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:32.215096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-75ff4a97-381f-4450-b64d-027871326f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:32.281826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 644/1275] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:22:32.305762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dbf7c-7cf9-499b-89e5-7e3f43af30df None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:32.409047 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dbf7c-7cf9-499b-89e5-7e3f43af30df None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:32.427029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:32.444286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb9df3-c5bf-427a-a730-dd14ba606907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:32.444922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb9df3-c5bf-427a-a730-dd14ba606907 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.445217 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb9df3-c5bf-427a-a730-dd14ba606907 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.445555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb9df3-c5bf-427a-a730-dd14ba606907 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.455477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb9df3-c5bf-427a-a730-dd14ba606907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-fdfb9df3-c5bf-427a-a730-dd14ba606907 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:32.460624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:32.461752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:32.462760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 632/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:32.468333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff4a97-381f-4450-b64d-027871326f4a None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:32.550623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:32.569272 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff4a97-381f-4450-b64d-027871326f4a None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:32.602410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989db3df-80f9-488e-813e-1eacb8a3791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:32.603057 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989db3df-80f9-488e-813e-1eacb8a3791a None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.603334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989db3df-80f9-488e-813e-1eacb8a3791a None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.603606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989db3df-80f9-488e-813e-1eacb8a3791a None admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.604932 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989db3df-80f9-488e-813e-1eacb8a3791a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:32.605232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989db3df-80f9-488e-813e-1eacb8a3791a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:32.606626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989db3df-80f9-488e-813e-1eacb8a3791a None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:32.614529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 645/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:32.621074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb9df3-c5bf-427a-a730-dd14ba606907 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:32.722144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb9df3-c5bf-427a-a730-dd14ba606907 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:32.757128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d355261-f842-407f-a834-09ea569c2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:32.757769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d355261-f842-407f-a834-09ea569c2a2b None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.758056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d355261-f842-407f-a834-09ea569c2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.758336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d355261-f842-407f-a834-09ea569c2a2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.768444 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d355261-f842-407f-a834-09ea569c2a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:32.769896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d355261-f842-407f-a834-09ea569c2a2b None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-3d355261-f842-407f-a834-09ea569c2a2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:32.785616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:32.790897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:32.792810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:32.792810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:32.792810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:32.792810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:32.792810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 633/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:32.793513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989db3df-80f9-488e-813e-1eacb8a3791a None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:32.893500 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989db3df-80f9-488e-813e-1eacb8a3791a None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:32.928194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3006a-3409-4f88-aaaa-da7727da4a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:32.928849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3006a-3409-4f88-aaaa-da7727da4a9e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.929135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3006a-3409-4f88-aaaa-da7727da4a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.929412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3006a-3409-4f88-aaaa-da7727da4a9e None admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.930094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3006a-3409-4f88-aaaa-da7727da4a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:32.930403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3006a-3409-4f88-aaaa-da7727da4a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:32.931805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3006a-3409-4f88-aaaa-da7727da4a9e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:32.944242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 646/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:32.950207 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d355261-f842-407f-a834-09ea569c2a2b None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:32.982876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:33.053010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d355261-f842-407f-a834-09ea569c2a2b None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:33.086767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c481f1-5e22-4f0d-a805-fd6a04aa4b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:33.087459 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c481f1-5e22-4f0d-a805-fd6a04aa4b87 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:33.087734 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c481f1-5e22-4f0d-a805-fd6a04aa4b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:33.088004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c481f1-5e22-4f0d-a805-fd6a04aa4b87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:33.095954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c481f1-5e22-4f0d-a805-fd6a04aa4b87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:33.097385 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c481f1-5e22-4f0d-a805-fd6a04aa4b87 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-60c481f1-5e22-4f0d-a805-fd6a04aa4b87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:22:33.108524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:33.109647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:33.110724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:33.110724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:33.110724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:22:33.110724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:22:33.110724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:22:33.110724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:22:33.110724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:22:33.110724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:22:33.110724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:22:33.110724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:33.110724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 634/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:33.115589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3006a-3409-4f88-aaaa-da7727da4a9e None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:33.119439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:33.216352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3006a-3409-4f88-aaaa-da7727da4a9e None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:33.248475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede5191-9708-43ca-9a1b-6170013bbeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:33.249080 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede5191-9708-43ca-9a1b-6170013bbeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:33.249361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede5191-9708-43ca-9a1b-6170013bbeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:33.249636 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede5191-9708-43ca-9a1b-6170013bbeb6 None admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:33.250412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede5191-9708-43ca-9a1b-6170013bbeb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:33.250748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede5191-9708-43ca-9a1b-6170013bbeb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:33.252183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede5191-9708-43ca-9a1b-6170013bbeb6 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:33.269317 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 647/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Thu Aug 4 02:22:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:33.275143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c481f1-5e22-4f0d-a805-fd6a04aa4b87 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:33.365528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:33.374849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c481f1-5e22-4f0d-a805-fd6a04aa4b87 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:33.408581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb2751-1a6a-4db5-9a38-fb4c9a866545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:33.409192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb2751-1a6a-4db5-9a38-fb4c9a866545 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:33.409474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb2751-1a6a-4db5-9a38-fb4c9a866545 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:33.409748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb2751-1a6a-4db5-9a38-fb4c9a866545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:33.479151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb2751-1a6a-4db5-9a38-fb4c9a866545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:33.480534 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb2751-1a6a-4db5-9a38-fb4c9a866545 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:33.569039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:33.579250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 635/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:22:33.585449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede5191-9708-43ca-9a1b-6170013bbeb6 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:33.647258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:33.686101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede5191-9708-43ca-9a1b-6170013bbeb6 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:33.719952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf22a9-6e44-45d0-ab70-126cdcb573b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:33.720594 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf22a9-6e44-45d0-ab70-126cdcb573b2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:33.720908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf22a9-6e44-45d0-ab70-126cdcb573b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:33.721173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf22a9-6e44-45d0-ab70-126cdcb573b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:33.731745 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf22a9-6e44-45d0-ab70-126cdcb573b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:33.733132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf22a9-6e44-45d0-ab70-126cdcb573b2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-fdbf22a9-6e44-45d0-ab70-126cdcb573b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:33.747497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:33.748403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:33.749706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:33.749706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:33.749706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:33.749706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:33.749706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 648/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:33.754343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb2751-1a6a-4db5-9a38-fb4c9a866545 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:33.854820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb2751-1a6a-4db5-9a38-fb4c9a866545 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:33.888789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d7368-a2c6-4de8-bb8c-a9c230dbb098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:33.889428 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d7368-a2c6-4de8-bb8c-a9c230dbb098 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:33.889714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d7368-a2c6-4de8-bb8c-a9c230dbb098 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:33.889992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d7368-a2c6-4de8-bb8c-a9c230dbb098 None admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:33.890715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d7368-a2c6-4de8-bb8c-a9c230dbb098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:33.891027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d7368-a2c6-4de8-bb8c-a9c230dbb098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:33.892402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d7368-a2c6-4de8-bb8c-a9c230dbb098 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:33.905375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 636/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:33.911237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf22a9-6e44-45d0-ab70-126cdcb573b2 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:34.012072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf22a9-6e44-45d0-ab70-126cdcb573b2 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:34.025204 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:34.045560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964cb6d-2994-41bb-be98-ca3e8be81f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:34.046218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964cb6d-2994-41bb-be98-ca3e8be81f74 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.046520 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964cb6d-2994-41bb-be98-ca3e8be81f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.046801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964cb6d-2994-41bb-be98-ca3e8be81f74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.053549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964cb6d-2994-41bb-be98-ca3e8be81f74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:34.055022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964cb6d-2994-41bb-be98-ca3e8be81f74 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application [None req-6964cb6d-2994-41bb-be98-ca3e8be81f74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:22:34.067214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:34.068308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:34.069443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:22:34.069443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:22:34.069443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:22:34.069443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:22:34.069443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:22:34.069443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:22:34.069443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:22:34.069443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: ERROR keystone.server.flask.application Aug 04 02:22:34.069443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 649/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:34.074826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d7368-a2c6-4de8-bb8c-a9c230dbb098 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:34.125017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:34.174379 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d7368-a2c6-4de8-bb8c-a9c230dbb098 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:34.208227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46622cdd-b523-42d9-8ece-9196795b254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:34.208845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46622cdd-b523-42d9-8ece-9196795b254c None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.209137 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46622cdd-b523-42d9-8ece-9196795b254c None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.209413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46622cdd-b523-42d9-8ece-9196795b254c None admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.210159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46622cdd-b523-42d9-8ece-9196795b254c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:34.210472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46622cdd-b523-42d9-8ece-9196795b254c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:34.211951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46622cdd-b523-42d9-8ece-9196795b254c None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:34.224446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 637/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Thu Aug 4 02:22:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:34.231641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964cb6d-2994-41bb-be98-ca3e8be81f74 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:34.333385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964cb6d-2994-41bb-be98-ca3e8be81f74 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:34.367261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3fe6e-f172-48c3-a8b8-c2939c7c1c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:34.367941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3fe6e-f172-48c3-a8b8-c2939c7c1c0e None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.368229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3fe6e-f172-48c3-a8b8-c2939c7c1c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.368511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3fe6e-f172-48c3-a8b8-c2939c7c1c0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.369295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3fe6e-f172-48c3-a8b8-c2939c7c1c0e None admin] RBAC: Adding query filter params (role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c, scope.project.id=fae65363f2fb415b834ac367a6c4b7ad, user.id=423ac00601f84e3d9c6cc6ee20eee6ae) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:34.369705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3fe6e-f172-48c3-a8b8-c2939c7c1c0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:34.371259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3fe6e-f172-48c3-a8b8-c2939c7c1c0e None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:34.377041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 650/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:34 2022] GET /identity/v3/role_assignments?user.id=423ac00601f84e3d9c6cc6ee20eee6ae&scope.project.id=fae65363f2fb415b834ac367a6c4b7ad&role.id=3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:36.417032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c1aa8-e178-4c78-a19a-8cf78571038c None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:36.417604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c1aa8-e178-4c78-a19a-8cf78571038c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:36.417604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c1aa8-e178-4c78-a19a-8cf78571038c None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:36.419109 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 638/1288] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:36.424606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504fc9a-cb9a-4e63-9017-99d73387c7c6 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:36.425281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504fc9a-cb9a-4e63-9017-99d73387c7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:36.425539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504fc9a-cb9a-4e63-9017-99d73387c7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:36.443913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-5504fc9a-cb9a-4e63-9017-99d73387c7c6 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:36.445111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5504fc9a-cb9a-4e63-9017-99d73387c7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:36.475039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:36.512768 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 651/1289] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:22:36.535392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c1aa8-e178-4c78-a19a-8cf78571038c None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:36.637732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c1aa8-e178-4c78-a19a-8cf78571038c None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:36.648483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:36.672544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b0ffb-1ae2-44c1-a5cb-4bbc6c923da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:36.673117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b0ffb-1ae2-44c1-a5cb-4bbc6c923da8 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:36.673403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b0ffb-1ae2-44c1-a5cb-4bbc6c923da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:36.673681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b0ffb-1ae2-44c1-a5cb-4bbc6c923da8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:36.674304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b0ffb-1ae2-44c1-a5cb-4bbc6c923da8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:36.675705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b0ffb-1ae2-44c1-a5cb-4bbc6c923da8 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-af5b0ffb-1ae2-44c1-a5cb-4bbc6c923da8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:36.685066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:36.686288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:36.687713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 639/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Aug 4 02:22:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:36.692295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504fc9a-cb9a-4e63-9017-99d73387c7c6 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:36.790141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504fc9a-cb9a-4e63-9017-99d73387c7c6 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:36.824518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddcd5e-7707-4ec4-8372-a48fdf13fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:36.825124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddcd5e-7707-4ec4-8372-a48fdf13fd03 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:36.825404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddcd5e-7707-4ec4-8372-a48fdf13fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:36.825677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddcd5e-7707-4ec4-8372-a48fdf13fd03 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:36.826342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddcd5e-7707-4ec4-8372-a48fdf13fd03 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:36.826679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddcd5e-7707-4ec4-8372-a48fdf13fd03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:36.828038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddcd5e-7707-4ec4-8372-a48fdf13fd03 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:36.832742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 652/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Thu Aug 4 02:22:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:36.839111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b0ffb-1ae2-44c1-a5cb-4bbc6c923da8 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:36.937782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b0ffb-1ae2-44c1-a5cb-4bbc6c923da8 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:36.971845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87773c-0be8-4655-aac1-2668a008cecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:36.972461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87773c-0be8-4655-aac1-2668a008cecd None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:36.972748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87773c-0be8-4655-aac1-2668a008cecd None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:36.973061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87773c-0be8-4655-aac1-2668a008cecd None admin] PATH_INFO: `/v3/services` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:36.973729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87773c-0be8-4655-aac1-2668a008cecd None admin] RBAC: Adding query filter params (type=placement) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:36.974037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87773c-0be8-4655-aac1-2668a008cecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:36.975430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87773c-0be8-4655-aac1-2668a008cecd None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:36.979821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 640/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Thu Aug 4 02:22:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:39.016470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e69ff1-3546-4235-b9c4-e6361f786070 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:39.017021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e69ff1-3546-4235-b9c4-e6361f786070 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:39.017021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e69ff1-3546-4235-b9c4-e6361f786070 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:39.018375 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 653/1293] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:39.023510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a03f70-8086-425f-b6b1-472a7ffe4432 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:39.023937 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a03f70-8086-425f-b6b1-472a7ffe4432 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:39.024084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a03f70-8086-425f-b6b1-472a7ffe4432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:39.043912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-a9a03f70-8086-425f-b6b1-472a7ffe4432 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:39.045122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a9a03f70-8086-425f-b6b1-472a7ffe4432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:39.075664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:39.115191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 641/1294] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:22:39.139953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e69ff1-3546-4235-b9c4-e6361f786070 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:39.171499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:39.241757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e69ff1-3546-4235-b9c4-e6361f786070 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:39.275558 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e7e3a-418b-49be-bb72-b85c185427b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:39.276683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e7e3a-418b-49be-bb72-b85c185427b2 None admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:39.277086 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e7e3a-418b-49be-bb72-b85c185427b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:39.277465 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e7e3a-418b-49be-bb72-b85c185427b2 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:39.278171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e7e3a-418b-49be-bb72-b85c185427b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:39.279606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e7e3a-418b-49be-bb72-b85c185427b2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:39.341195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 654/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Thu Aug 4 02:22:39 2022] POST /identity/v3/services => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:41.385935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff12f28-1619-45ba-88fb-dc3e63061e7a None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.386681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff12f28-1619-45ba-88fb-dc3e63061e7a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.386681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff12f28-1619-45ba-88fb-dc3e63061e7a None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.387913 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 642/1296] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:22:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:41.393063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f172a18-ae98-4c23-97ae-ef6a6024362d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.393478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f172a18-ae98-4c23-97ae-ef6a6024362d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.393619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f172a18-ae98-4c23-97ae-ef6a6024362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.412710 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-3f172a18-ae98-4c23-97ae-ef6a6024362d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:41.414121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3f172a18-ae98-4c23-97ae-ef6a6024362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:41.490393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 655/1297] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:41 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:22:41.513688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff12f28-1619-45ba-88fb-dc3e63061e7a None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:41.628326 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff12f28-1619-45ba-88fb-dc3e63061e7a None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:41.663947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120bfb5-5e9d-438e-b0da-f8db9aca3412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:41.664549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120bfb5-5e9d-438e-b0da-f8db9aca3412 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.664868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120bfb5-5e9d-438e-b0da-f8db9aca3412 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.665149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120bfb5-5e9d-438e-b0da-f8db9aca3412 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.665779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120bfb5-5e9d-438e-b0da-f8db9aca3412 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:41.667236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120bfb5-5e9d-438e-b0da-f8db9aca3412 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-6120bfb5-5e9d-438e-b0da-f8db9aca3412 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:41.676130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:41.684103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:41.684992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 643/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Aug 4 02:22:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:41.685811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f172a18-ae98-4c23-97ae-ef6a6024362d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:41.703084 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:41.782963 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f172a18-ae98-4c23-97ae-ef6a6024362d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:41.816358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfda201-23be-440f-8322-c0985f1a3ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:41.816969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda201-23be-440f-8322-c0985f1a3ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.817255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda201-23be-440f-8322-c0985f1a3ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.817531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda201-23be-440f-8322-c0985f1a3ca2 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.818211 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfda201-23be-440f-8322-c0985f1a3ca2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:41.818576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfda201-23be-440f-8322-c0985f1a3ca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:41.819991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfda201-23be-440f-8322-c0985f1a3ca2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:41.825857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 656/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Thu Aug 4 02:22:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:41.832023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120bfb5-5e9d-438e-b0da-f8db9aca3412 None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:41.863997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:41.931201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120bfb5-5e9d-438e-b0da-f8db9aca3412 None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:41.967082 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120909cc-7193-4d6b-91b0-6b07042abc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:41.967699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120909cc-7193-4d6b-91b0-6b07042abc94 None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.967978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120909cc-7193-4d6b-91b0-6b07042abc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.968255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120909cc-7193-4d6b-91b0-6b07042abc94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.969001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120909cc-7193-4d6b-91b0-6b07042abc94 None admin] RBAC: Adding query filter params (interface=public, service_id=83878f2911f941d484e98492f97b2a99, region_id=RegionOne) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:41.969311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120909cc-7193-4d6b-91b0-6b07042abc94 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:41.970725 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120909cc-7193-4d6b-91b0-6b07042abc94 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:41.975682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 644/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Thu Aug 4 02:22:41 2022] GET /identity/v3/endpoints?service_id=83878f2911f941d484e98492f97b2a99&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:41.981611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfda201-23be-440f-8322-c0985f1a3ca2 None admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:42.066411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:42.083921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfda201-23be-440f-8322-c0985f1a3ca2 None admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:42.117797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a68a6-c005-4f31-9e8a-079498f98df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:42.118440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a68a6-c005-4f31-9e8a-079498f98df2 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:42.118754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a68a6-c005-4f31-9e8a-079498f98df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:42.119029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a68a6-c005-4f31-9e8a-079498f98df2 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:42.120282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a68a6-c005-4f31-9e8a-079498f98df2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:42.126260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a68a6-c005-4f31-9e8a-079498f98df2 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:42.128573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 657/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Thu Aug 4 02:22:41 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:22:44.149229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc0146-2009-4376-9de5-eb1fbe4b5d75 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:44.149744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc0146-2009-4376-9de5-eb1fbe4b5d75 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:44.149834 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc0146-2009-4376-9de5-eb1fbe4b5d75 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:44.151941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 645/1302] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:44.157189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31c90b-88ae-463a-94f5-e1043381bb8f None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:44.157608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31c90b-88ae-463a-94f5-e1043381bb8f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:44.157719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31c90b-88ae-463a-94f5-e1043381bb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:44.176501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-4e31c90b-88ae-463a-94f5-e1043381bb8f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:44.177926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4e31c90b-88ae-463a-94f5-e1043381bb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:44.243903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 658/1303] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:22:44.267050 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc0146-2009-4376-9de5-eb1fbe4b5d75 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:44.362446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:44.369206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc0146-2009-4376-9de5-eb1fbe4b5d75 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:44.404211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738ab5-15b6-49cb-b310-89721a36128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:44.404954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738ab5-15b6-49cb-b310-89721a36128f None admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:44.405271 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738ab5-15b6-49cb-b310-89721a36128f None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:44.405555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738ab5-15b6-49cb-b310-89721a36128f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:44.406277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3738ab5-15b6-49cb-b310-89721a36128f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:44.407881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3738ab5-15b6-49cb-b310-89721a36128f None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application [None req-f3738ab5-15b6-49cb-b310-89721a36128f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:44.416741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:44.417930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: ERROR keystone.server.flask.application Aug 04 02:22:44.423434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 646/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Thu Aug 4 02:22:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:44.424420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31c90b-88ae-463a-94f5-e1043381bb8f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:44.499919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:44.522803 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31c90b-88ae-463a-94f5-e1043381bb8f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:44.556945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d89a9d-fbb3-4707-8e72-2371dc223530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:44.557556 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89a9d-fbb3-4707-8e72-2371dc223530 None admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:44.557842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89a9d-fbb3-4707-8e72-2371dc223530 None admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:44.558119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89a9d-fbb3-4707-8e72-2371dc223530 None admin] PATH_INFO: `/v3/services` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:44.559083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d89a9d-fbb3-4707-8e72-2371dc223530 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:44.559391 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d89a9d-fbb3-4707-8e72-2371dc223530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:44.561008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d89a9d-fbb3-4707-8e72-2371dc223530 None admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:44.566044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 659/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Thu Aug 4 02:22:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:44.571828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738ab5-15b6-49cb-b310-89721a36128f None admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:44.674312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738ab5-15b6-49cb-b310-89721a36128f None admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:44.709305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf326a4-5ef6-44b3-acd1-a70aa6ed1316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:44.710005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf326a4-5ef6-44b3-acd1-a70aa6ed1316 None admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:44.710303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf326a4-5ef6-44b3-acd1-a70aa6ed1316 None admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:44.710613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf326a4-5ef6-44b3-acd1-a70aa6ed1316 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:44.711318 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf326a4-5ef6-44b3-acd1-a70aa6ed1316 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:44.712690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf326a4-5ef6-44b3-acd1-a70aa6ed1316 None admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:44.912436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 647/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:22:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:54.563054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=30 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:54.907606 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:24.606466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5759-da7a-4f59-ae63-20252bf923e2 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:24.607067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5759-da7a-4f59-ae63-20252bf923e2 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:24.607067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5759-da7a-4f59-ae63-20252bf923e2 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:24.613579 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f04c5-55cc-415c-9b4f-cbde28a66fae None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:24.614029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f04c5-55cc-415c-9b4f-cbde28a66fae None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:24.614113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f04c5-55cc-415c-9b4f-cbde28a66fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:24.619997 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 660/1307] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:28:24 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:24.704358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-ee9f04c5-55cc-415c-9b4f-cbde28a66fae None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:24.705570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ee9f04c5-55cc-415c-9b4f-cbde28a66fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:24.846874 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 648/1308] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:28:24.877442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c811-9b99-4be0-82e4-00248227cb8f None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:24.878173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c811-9b99-4be0-82e4-00248227cb8f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:24.878693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c811-9b99-4be0-82e4-00248227cb8f None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:24.880762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 661/1309] 10.222.0.60 () {54 vars in 965 bytes} [Thu Aug 4 02:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:24.891011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acadd16-10ad-4076-a863-f92b2e1fcf6a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:24.891246 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acadd16-10ad-4076-a863-f92b2e1fcf6a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:24.891689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acadd16-10ad-4076-a863-f92b2e1fcf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:25.015705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-1acadd16-10ad-4076-a863-f92b2e1fcf6a None None] MFA Rules not processed for user `1ac08ad57a8e442d89ba1881abf43cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:25.018104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1acadd16-10ad-4076-a863-f92b2e1fcf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:25.044286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:25.112285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 649/1310] 10.222.0.60 () {58 vars in 1062 bytes} [Thu Aug 4 02:28:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:25.122413 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c811-9b99-4be0-82e4-00248227cb8f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:25.124310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-acb4c811-9b99-4be0-82e4-00248227cb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:25.244576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c811-9b99-4be0-82e4-00248227cb8f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:25.323059 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fd7f1-ef16-4a16-8e09-3158a39c2177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:25.323774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fd7f1-ef16-4a16-8e09-3158a39c2177 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:25.324128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fd7f1-ef16-4a16-8e09-3158a39c2177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:25.324473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fd7f1-ef16-4a16-8e09-3158a39c2177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:25.326171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8c4fd7f1-ef16-4a16-8e09-3158a39c2177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:25.383006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:25.442792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fd7f1-ef16-4a16-8e09-3158a39c2177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:25.444257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fd7f1-ef16-4a16-8e09-3158a39c2177 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:25.465142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 662/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:27.772750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550615da-a6aa-4c99-8d6d-bba2e9a65abb None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:27.773283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550615da-a6aa-4c99-8d6d-bba2e9a65abb None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:27.773283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550615da-a6aa-4c99-8d6d-bba2e9a65abb None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:27.775149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 650/1312] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:27.780073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22cfb4-c390-4218-b182-6c7101d2ae10 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:27.780516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22cfb4-c390-4218-b182-6c7101d2ae10 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:27.780613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22cfb4-c390-4218-b182-6c7101d2ae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:27.860853 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-3d22cfb4-c390-4218-b182-6c7101d2ae10 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:27.862106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3d22cfb4-c390-4218-b182-6c7101d2ae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:27.969571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 663/1313] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:28:28.008951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550615da-a6aa-4c99-8d6d-bba2e9a65abb None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:28.010623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-550615da-a6aa-4c99-8d6d-bba2e9a65abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:28.116998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550615da-a6aa-4c99-8d6d-bba2e9a65abb None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:28.195871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33fb1f-1a62-45dd-b9e6-dac550a57cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:28.196961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33fb1f-1a62-45dd-b9e6-dac550a57cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:28.197711 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:28.198225 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33fb1f-1a62-45dd-b9e6-dac550a57cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:28.198897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33fb1f-1a62-45dd-b9e6-dac550a57cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:28.200805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2c33fb1f-1a62-45dd-b9e6-dac550a57cf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:28.321299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33fb1f-1a62-45dd-b9e6-dac550a57cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:28.322709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33fb1f-1a62-45dd-b9e6-dac550a57cf0 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:28.342814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 651/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:30.904317 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061a5fd-3d50-463c-b036-fed5678eb55d None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:30.904866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061a5fd-3d50-463c-b036-fed5678eb55d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:30.904866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061a5fd-3d50-463c-b036-fed5678eb55d None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:30.906299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 664/1315] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:30.911429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d30d8-eca6-4cb4-b768-2f0511a2f46a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:30.911841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d30d8-eca6-4cb4-b768-2f0511a2f46a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:30.911987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d30d8-eca6-4cb4-b768-2f0511a2f46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:30.982686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-938d30d8-eca6-4cb4-b768-2f0511a2f46a None None] MFA Rules not processed for user `d9d1524bdf514276aeb2826c6b3bb363`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:30.983945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-938d30d8-eca6-4cb4-b768-2f0511a2f46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:31.038236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:31.083746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 652/1316] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:31.124580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061a5fd-3d50-463c-b036-fed5678eb55d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:31.126128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d061a5fd-3d50-463c-b036-fed5678eb55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:31.136541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:31.230749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061a5fd-3d50-463c-b036-fed5678eb55d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:31.303606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164d756-f501-4f7f-bb54-5f6bb8a39ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:31.304226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d756-f501-4f7f-bb54-5f6bb8a39ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:31.304508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d756-f501-4f7f-bb54-5f6bb8a39ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:31.304783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164d756-f501-4f7f-bb54-5f6bb8a39ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:31.307133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7164d756-f501-4f7f-bb54-5f6bb8a39ed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:31.369634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:31.416687 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164d756-f501-4f7f-bb54-5f6bb8a39ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:31.418137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164d756-f501-4f7f-bb54-5f6bb8a39ed5 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:31.437539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 665/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:31 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:34.219038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd30af-8965-4f57-b5e3-dab5afe068af None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:34.219554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd30af-8965-4f57-b5e3-dab5afe068af None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:34.219643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd30af-8965-4f57-b5e3-dab5afe068af None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:34.220966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 653/1318] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:28:34.226016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ba372-257a-4097-a151-b0fd4d288db7 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:34.226394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ba372-257a-4097-a151-b0fd4d288db7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:34.226610 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ba372-257a-4097-a151-b0fd4d288db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:34.292983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b37ba372-257a-4097-a151-b0fd4d288db7 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:34.294258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b37ba372-257a-4097-a151-b0fd4d288db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:34.391410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 666/1319] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:34.443026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3860f-db5d-48d9-9f70-a67548494362 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:34.443315 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3860f-db5d-48d9-9f70-a67548494362 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:34.443595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3860f-db5d-48d9-9f70-a67548494362 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:34.444969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 654/1320] 10.222.0.60 () {54 vars in 965 bytes} [Thu Aug 4 02:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:34.451235 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1db189-2624-4504-841d-46f1b0522de3 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:34.451524 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1db189-2624-4504-841d-46f1b0522de3 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:34.451801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1db189-2624-4504-841d-46f1b0522de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:34.473753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:34.527979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-ad1db189-2624-4504-841d-46f1b0522de3 None None] MFA Rules not processed for user `1ac08ad57a8e442d89ba1881abf43cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:34.529184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-ad1db189-2624-4504-841d-46f1b0522de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:34.602750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 667/1321] 10.222.0.60 () {58 vars in 1062 bytes} [Thu Aug 4 02:28:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:34.611577 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3860f-db5d-48d9-9f70-a67548494362 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:34.613095 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-13b3860f-db5d-48d9-9f70-a67548494362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:34.714468 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3860f-db5d-48d9-9f70-a67548494362 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:34.785871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef4825-28ee-4d37-9b8c-22934763b356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:34.786471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef4825-28ee-4d37-9b8c-22934763b356 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:34.786780 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef4825-28ee-4d37-9b8c-22934763b356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:34.787048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef4825-28ee-4d37-9b8c-22934763b356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:34.788640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8fef4825-28ee-4d37-9b8c-22934763b356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:34.796533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:34.895499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef4825-28ee-4d37-9b8c-22934763b356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:34.896860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef4825-28ee-4d37-9b8c-22934763b356 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:34.915624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 655/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:28:38.386748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621aa50-f7c5-43d8-8fc1-2917f413269d None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:38.387281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621aa50-f7c5-43d8-8fc1-2917f413269d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:38.387401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621aa50-f7c5-43d8-8fc1-2917f413269d None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:38.388705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 668/1323] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:38.394073 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b5791-007a-4c6d-a458-a2917a307de5 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:38.394478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b5791-007a-4c6d-a458-a2917a307de5 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:38.394779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b5791-007a-4c6d-a458-a2917a307de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:38.461345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-100b5791-007a-4c6d-a458-a2917a307de5 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:38.462624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-100b5791-007a-4c6d-a458-a2917a307de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:38.520119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:38.561770 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 656/1324] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:38.599251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621aa50-f7c5-43d8-8fc1-2917f413269d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:38.600851 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1621aa50-f7c5-43d8-8fc1-2917f413269d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:38.715106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621aa50-f7c5-43d8-8fc1-2917f413269d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:38.729294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:38.793332 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5479d4-831e-40f5-b072-e54e129ce0a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:38.793955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5479d4-831e-40f5-b072-e54e129ce0a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:38.794236 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5479d4-831e-40f5-b072-e54e129ce0a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:38.794537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5479d4-831e-40f5-b072-e54e129ce0a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:38.798081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cb5479d4-831e-40f5-b072-e54e129ce0a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:38.909799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5479d4-831e-40f5-b072-e54e129ce0a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:38.911273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5479d4-831e-40f5-b072-e54e129ce0a8 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:38.929394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 669/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:40.972681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267ff7-877b-43b5-b025-8b86844381a3 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:40.973238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267ff7-877b-43b5-b025-8b86844381a3 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:40.973238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267ff7-877b-43b5-b025-8b86844381a3 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:40.974698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 657/1326] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:40.980907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446e83a-8831-4315-9f06-92a8e8a5226f None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:40.981286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446e83a-8831-4315-9f06-92a8e8a5226f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:40.981495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446e83a-8831-4315-9f06-92a8e8a5226f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:41.031005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:41.052124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b446e83a-8831-4315-9f06-92a8e8a5226f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:41.053277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b446e83a-8831-4315-9f06-92a8e8a5226f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:41.154651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 670/1327] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:41.190618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04267ff7-877b-43b5-b025-8b86844381a3 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:41.192182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-04267ff7-877b-43b5-b025-8b86844381a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:41.298298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04267ff7-877b-43b5-b025-8b86844381a3 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:41.371637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944066b6-398f-46b2-98d0-f8642be15351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:41.372264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944066b6-398f-46b2-98d0-f8642be15351 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:41.372550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944066b6-398f-46b2-98d0-f8642be15351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:41.372827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944066b6-398f-46b2-98d0-f8642be15351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:41.374466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-944066b6-398f-46b2-98d0-f8642be15351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:41.391665 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:41.489596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944066b6-398f-46b2-98d0-f8642be15351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:41.491108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944066b6-398f-46b2-98d0-f8642be15351 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:41.510812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 658/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:43.595445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c05ba4-a780-4de3-b5a8-364168969406 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:43.603019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c05ba4-a780-4de3-b5a8-364168969406 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:43.603019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c05ba4-a780-4de3-b5a8-364168969406 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:43.603019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 671/1329] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:43.604209 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6df3b-d4f9-4ac7-a1c9-8e3c935fb40f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:43.604642 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6df3b-d4f9-4ac7-a1c9-8e3c935fb40f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:43.604755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6df3b-d4f9-4ac7-a1c9-8e3c935fb40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:43.671146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-72c6df3b-d4f9-4ac7-a1c9-8e3c935fb40f None None] MFA Rules not processed for user `d9d1524bdf514276aeb2826c6b3bb363`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:43.672377 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-72c6df3b-d4f9-4ac7-a1c9-8e3c935fb40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:43.739070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:43.770765 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 659/1330] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:43.810753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c05ba4-a780-4de3-b5a8-364168969406 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:43.812304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d3c05ba4-a780-4de3-b5a8-364168969406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:43.921508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c05ba4-a780-4de3-b5a8-364168969406 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:43.942039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:43.996563 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec77520-0ef9-4483-8f91-2db9d0a1a491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:43.997181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec77520-0ef9-4483-8f91-2db9d0a1a491 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:43.997464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec77520-0ef9-4483-8f91-2db9d0a1a491 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:43.997739 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec77520-0ef9-4483-8f91-2db9d0a1a491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:43.999391 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4ec77520-0ef9-4483-8f91-2db9d0a1a491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:44.109635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec77520-0ef9-4483-8f91-2db9d0a1a491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:44.111185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec77520-0ef9-4483-8f91-2db9d0a1a491 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:44.131366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 672/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:46.636574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937da27-1859-4828-8c75-e1dc89016cba None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:46.637099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937da27-1859-4828-8c75-e1dc89016cba None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:46.637099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937da27-1859-4828-8c75-e1dc89016cba None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:46.638423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 660/1332] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:46.643423 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba2c59-2db2-4222-a592-352534daf60d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:46.643806 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba2c59-2db2-4222-a592-352534daf60d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:46.643987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba2c59-2db2-4222-a592-352534daf60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:46.708185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:46.711169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-15ba2c59-2db2-4222-a592-352534daf60d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:46.712401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-15ba2c59-2db2-4222-a592-352534daf60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:46.820865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 673/1333] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:46.859475 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937da27-1859-4828-8c75-e1dc89016cba None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:46.861027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c937da27-1859-4828-8c75-e1dc89016cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:46.964688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937da27-1859-4828-8c75-e1dc89016cba None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:47.035713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cf98f-376f-4cec-b2dc-acf6bfc1577b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:47.036324 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cf98f-376f-4cec-b2dc-acf6bfc1577b service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:47.036605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cf98f-376f-4cec-b2dc-acf6bfc1577b service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:47.036879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cf98f-376f-4cec-b2dc-acf6bfc1577b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:47.038615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ed9cf98f-376f-4cec-b2dc-acf6bfc1577b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:47.066202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:47.149962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cf98f-376f-4cec-b2dc-acf6bfc1577b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:47.151447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cf98f-376f-4cec-b2dc-acf6bfc1577b service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:47.169355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 661/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:49.227914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6371f3-b8dc-47ae-8847-16621c47e9c6 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:49.228478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6371f3-b8dc-47ae-8847-16621c47e9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:49.228478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6371f3-b8dc-47ae-8847-16621c47e9c6 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:49.229840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 674/1335] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:49.235002 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96fa4-9ab9-4677-a729-53d334e87327 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:49.235443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96fa4-9ab9-4677-a729-53d334e87327 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:49.235570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96fa4-9ab9-4677-a729-53d334e87327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:49.301201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b0b96fa4-9ab9-4677-a729-53d334e87327 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:49.302332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b0b96fa4-9ab9-4677-a729-53d334e87327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:49.375467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:49.397370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 662/1336] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:28:49.438046 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6371f3-b8dc-47ae-8847-16621c47e9c6 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:49.439650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8d6371f3-b8dc-47ae-8847-16621c47e9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:49.544156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6371f3-b8dc-47ae-8847-16621c47e9c6 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:49.572528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:49.618040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132350c-c045-43c4-8c81-25027b18caf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:49.618675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132350c-c045-43c4-8c81-25027b18caf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:49.618959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132350c-c045-43c4-8c81-25027b18caf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:49.619232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132350c-c045-43c4-8c81-25027b18caf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:49.620838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f132350c-c045-43c4-8c81-25027b18caf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:49.727249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132350c-c045-43c4-8c81-25027b18caf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:49.728689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132350c-c045-43c4-8c81-25027b18caf6 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:49.747525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 675/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:52.428316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f645-40d3-4b94-b478-6ce9f6b5a264 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:52.428896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f645-40d3-4b94-b478-6ce9f6b5a264 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:52.429064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f645-40d3-4b94-b478-6ce9f6b5a264 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:52.430409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 663/1338] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:52.435468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25cd4b-06e5-4410-bb8c-68aa7dbea23f None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:52.435889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25cd4b-06e5-4410-bb8c-68aa7dbea23f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:52.436001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25cd4b-06e5-4410-bb8c-68aa7dbea23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:52.501728 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-cf25cd4b-06e5-4410-bb8c-68aa7dbea23f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:52.502959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cf25cd4b-06e5-4410-bb8c-68aa7dbea23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:52.511617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:52.599190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 676/1339] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:52.636406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36f645-40d3-4b94-b478-6ce9f6b5a264 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:52.638021 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0f36f645-40d3-4b94-b478-6ce9f6b5a264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:52.740858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36f645-40d3-4b94-b478-6ce9f6b5a264 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:52.814951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faac55-6713-432b-a040-4953b18fceac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:52.815565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faac55-6713-432b-a040-4953b18fceac service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:52.815852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faac55-6713-432b-a040-4953b18fceac service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:52.816133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faac55-6713-432b-a040-4953b18fceac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:52.817758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-00faac55-6713-432b-a040-4953b18fceac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:52.973473 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:53.048165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faac55-6713-432b-a040-4953b18fceac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:53.049887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faac55-6713-432b-a040-4953b18fceac service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:53.067867 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 664/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:57.376181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b58cf7-9e9f-4678-af54-68fd18b4a71b None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:57.376692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b58cf7-9e9f-4678-af54-68fd18b4a71b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:57.376692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b58cf7-9e9f-4678-af54-68fd18b4a71b None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:57.378064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 677/1341] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:57.383756 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99635b-0169-4b18-a471-8a4ac3ecbfef None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:57.384202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99635b-0169-4b18-a471-8a4ac3ecbfef None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:57.384299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99635b-0169-4b18-a471-8a4ac3ecbfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:57.452822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-ff99635b-0169-4b18-a471-8a4ac3ecbfef None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:57.454051 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ff99635b-0169-4b18-a471-8a4ac3ecbfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:57.540921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:57.554082 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 665/1342] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:28:57.592927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b58cf7-9e9f-4678-af54-68fd18b4a71b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:57.594548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d3b58cf7-9e9f-4678-af54-68fd18b4a71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:57.699533 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b58cf7-9e9f-4678-af54-68fd18b4a71b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:57.737923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:57.775608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2008-74fa-4ba6-9b99-f50f08cf29fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:57.776264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2008-74fa-4ba6-9b99-f50f08cf29fa service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:57.776545 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2008-74fa-4ba6-9b99-f50f08cf29fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:57.776817 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2008-74fa-4ba6-9b99-f50f08cf29fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:57.778434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d42a2008-74fa-4ba6-9b99-f50f08cf29fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:57.889291 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a2008-74fa-4ba6-9b99-f50f08cf29fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:57.890781 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a2008-74fa-4ba6-9b99-f50f08cf29fa service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:57.909545 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 678/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:00.934636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1970385-4aab-4291-8101-6d95d0aaaab0 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:00.935178 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1970385-4aab-4291-8101-6d95d0aaaab0 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:00.935267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1970385-4aab-4291-8101-6d95d0aaaab0 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:00.936737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 666/1344] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:00.942201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ee9ce-e6a7-4bc6-97f9-2b2c35eb2256 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:00.942764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ee9ce-e6a7-4bc6-97f9-2b2c35eb2256 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:00.943063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ee9ce-e6a7-4bc6-97f9-2b2c35eb2256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:01.031770 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-d13ee9ce-e6a7-4bc6-97f9-2b2c35eb2256 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:01.034137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d13ee9ce-e6a7-4bc6-97f9-2b2c35eb2256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:01.064060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:01.273840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 679/1345] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:29:01.311519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1970385-4aab-4291-8101-6d95d0aaaab0 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:01.313049 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a1970385-4aab-4291-8101-6d95d0aaaab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:01.417873 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1970385-4aab-4291-8101-6d95d0aaaab0 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:01.497064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1152b-e591-46a2-89f7-409a04989ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:01.497697 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1152b-e591-46a2-89f7-409a04989ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:01.497979 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1152b-e591-46a2-89f7-409a04989ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:01.498280 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1152b-e591-46a2-89f7-409a04989ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:01.500020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b6c1152b-e591-46a2-89f7-409a04989ca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:01.545831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:01.614027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1152b-e591-46a2-89f7-409a04989ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:01.615501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1152b-e591-46a2-89f7-409a04989ca5 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:01.635134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 667/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:05.821919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51673c0-0208-4199-890d-5b913282948e None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:05.822531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51673c0-0208-4199-890d-5b913282948e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:05.822531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51673c0-0208-4199-890d-5b913282948e None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:05.823868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 680/1347] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:05.829540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338ca4c-773a-4dea-a0d0-f00f2c2c89e8 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:05.830003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338ca4c-773a-4dea-a0d0-f00f2c2c89e8 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:05.830219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338ca4c-773a-4dea-a0d0-f00f2c2c89e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:05.904364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e338ca4c-773a-4dea-a0d0-f00f2c2c89e8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:05.906256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e338ca4c-773a-4dea-a0d0-f00f2c2c89e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:06.006876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:06.009717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 668/1348] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:06.048652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51673c0-0208-4199-890d-5b913282948e None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:06.050554 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d51673c0-0208-4199-890d-5b913282948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:06.160242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51673c0-0208-4199-890d-5b913282948e None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:06.210769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:06.238306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662e3e5-47a5-423b-b35b-02c2ae714320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:06.239005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662e3e5-47a5-423b-b35b-02c2ae714320 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:06.239486 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662e3e5-47a5-423b-b35b-02c2ae714320 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:06.239928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662e3e5-47a5-423b-b35b-02c2ae714320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:06.242651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a662e3e5-47a5-423b-b35b-02c2ae714320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:06.366451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662e3e5-47a5-423b-b35b-02c2ae714320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:06.368088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662e3e5-47a5-423b-b35b-02c2ae714320 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:06.393537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 681/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:11.399565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f37ff7-dcbe-440b-9e03-f6150d219b3e None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:11.400338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f37ff7-dcbe-440b-9e03-f6150d219b3e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:11.400772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f37ff7-dcbe-440b-9e03-f6150d219b3e None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:11.402705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 669/1350] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:11.412647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0bd1f-0518-4697-9255-63a5c7d8cb61 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:11.413608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0bd1f-0518-4697-9255-63a5c7d8cb61 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:11.413608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0bd1f-0518-4697-9255-63a5c7d8cb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:11.538066 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-7ed0bd1f-0518-4697-9255-63a5c7d8cb61 None None] MFA Rules not processed for user `423ac00601f84e3d9c6cc6ee20eee6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:11.539371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7ed0bd1f-0518-4697-9255-63a5c7d8cb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:11.559370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:11.654438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 682/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:29:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:15.731486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2584e61-bc45-49d5-8f21-20e7ee8e6572 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:15.731989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2584e61-bc45-49d5-8f21-20e7ee8e6572 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:15.731989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2584e61-bc45-49d5-8f21-20e7ee8e6572 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:15.733484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 670/1352] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:15.738180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38eed0c-58b7-49bf-905f-db00518d5e9c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:15.738602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38eed0c-58b7-49bf-905f-db00518d5e9c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:15.738798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38eed0c-58b7-49bf-905f-db00518d5e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:15.818085 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f38eed0c-58b7-49bf-905f-db00518d5e9c None None] MFA Rules not processed for user `423ac00601f84e3d9c6cc6ee20eee6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:15.819351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f38eed0c-58b7-49bf-905f-db00518d5e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:15.894619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:15.932453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 683/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:29:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:17.409957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1906fe-ab05-4834-bb92-b2cfc0553923 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:17.410586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1906fe-ab05-4834-bb92-b2cfc0553923 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:17.410586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1906fe-ab05-4834-bb92-b2cfc0553923 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:17.413052 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 671/1354] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:17.417845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae05aef-2879-42ef-a65e-f9332e01c4e1 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:17.418271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae05aef-2879-42ef-a65e-f9332e01c4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:17.418436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae05aef-2879-42ef-a65e-f9332e01c4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:17.497998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-4ae05aef-2879-42ef-a65e-f9332e01c4e1 None None] MFA Rules not processed for user `423ac00601f84e3d9c6cc6ee20eee6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:17.499235 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4ae05aef-2879-42ef-a65e-f9332e01c4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:17.611597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 684/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:29:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:21.012831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225711e6-251a-4c3a-87e3-3b394ee2cb08 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:21.013881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225711e6-251a-4c3a-87e3-3b394ee2cb08 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:21.014384 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225711e6-251a-4c3a-87e3-3b394ee2cb08 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:21.020463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 672/1356] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:21.025202 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af74cad-aeba-4195-8929-5c5171726420 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:21.026064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af74cad-aeba-4195-8929-5c5171726420 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:21.026626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af74cad-aeba-4195-8929-5c5171726420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:21.075968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:21.110442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2af74cad-aeba-4195-8929-5c5171726420 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:21.111826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2af74cad-aeba-4195-8929-5c5171726420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:21.226615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 685/1357] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:21.279393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fd541-ca0b-466e-a313-9bb10d710206 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:21.280065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fd541-ca0b-466e-a313-9bb10d710206 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:21.280586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fd541-ca0b-466e-a313-9bb10d710206 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:21.282701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 673/1358] 10.222.0.60 () {54 vars in 962 bytes} [Thu Aug 4 02:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:21.290792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73aec6e-fd81-4fbb-abc2-53a57af1f06a None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:21.291352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73aec6e-fd81-4fbb-abc2-53a57af1f06a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:21.291842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73aec6e-fd81-4fbb-abc2-53a57af1f06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:21.379888 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-a73aec6e-fd81-4fbb-abc2-53a57af1f06a None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:21.382179 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a73aec6e-fd81-4fbb-abc2-53a57af1f06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:21.437114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:21.521988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fd541-ca0b-466e-a313-9bb10d710206 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:21.523906 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4e3fd541-ca0b-466e-a313-9bb10d710206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:21.527003 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 686/1359] 10.222.0.60 () {58 vars in 1059 bytes} [Thu Aug 4 02:29:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:21.687646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fd541-ca0b-466e-a313-9bb10d710206 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:21.766909 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:21.812093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f1764-8a27-4bf3-a78c-50196004dac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:21.813018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f1764-8a27-4bf3-a78c-50196004dac5 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:21.813303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f1764-8a27-4bf3-a78c-50196004dac5 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:21.813578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f1764-8a27-4bf3-a78c-50196004dac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:21.815259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-474f1764-8a27-4bf3-a78c-50196004dac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:21.914479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f1764-8a27-4bf3-a78c-50196004dac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:21.916104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f1764-8a27-4bf3-a78c-50196004dac5 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:21.936790 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 674/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:29:24.183370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c6ee9-73f6-446d-818e-98b76463acdf None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:24.183930 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c6ee9-73f6-446d-818e-98b76463acdf None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:24.184242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c6ee9-73f6-446d-818e-98b76463acdf None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:24.185771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 687/1361] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:24.191489 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bb870-dc45-4220-b2ea-f930a3a3fd2f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:24.191949 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bb870-dc45-4220-b2ea-f930a3a3fd2f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:24.192053 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bb870-dc45-4220-b2ea-f930a3a3fd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:24.267755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f89bb870-dc45-4220-b2ea-f930a3a3fd2f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:24.268978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f89bb870-dc45-4220-b2ea-f930a3a3fd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:24.309638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:24.382765 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 675/1362] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:24.424370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c6ee9-73f6-446d-818e-98b76463acdf None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:24.425895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2d4c6ee9-73f6-446d-818e-98b76463acdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:24.608777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c6ee9-73f6-446d-818e-98b76463acdf None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:24.620121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:24.743358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee47030-b138-4a77-9aab-540de48843b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:24.744012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee47030-b138-4a77-9aab-540de48843b1 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:24.744453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee47030-b138-4a77-9aab-540de48843b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:24.744724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee47030-b138-4a77-9aab-540de48843b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:24.746391 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8ee47030-b138-4a77-9aab-540de48843b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:24.844651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee47030-b138-4a77-9aab-540de48843b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:24.846250 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee47030-b138-4a77-9aab-540de48843b1 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:24.866263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 688/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:27.340175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c2eed-fbb2-4508-8756-b3fe27aa9501 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:27.341222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c2eed-fbb2-4508-8756-b3fe27aa9501 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:27.341717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c2eed-fbb2-4508-8756-b3fe27aa9501 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:27.343325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 676/1364] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:27.350153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bac75a-8e07-4e7f-92a6-02bdf8fd5992 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:27.350153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bac75a-8e07-4e7f-92a6-02bdf8fd5992 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:27.352944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bac75a-8e07-4e7f-92a6-02bdf8fd5992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:27.368454 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:27.422010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f1bac75a-8e07-4e7f-92a6-02bdf8fd5992 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:27.423525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f1bac75a-8e07-4e7f-92a6-02bdf8fd5992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:27.529488 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 689/1365] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:27.578183 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d6ef3-34fd-408a-872e-5e827eacfb7c None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:27.578503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d6ef3-34fd-408a-872e-5e827eacfb7c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:27.579175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d6ef3-34fd-408a-872e-5e827eacfb7c None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:27.581072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 677/1366] 10.222.0.60 () {54 vars in 962 bytes} [Thu Aug 4 02:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:27.586783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bdbec-c37b-4c0e-ba22-237dab4995f5 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:27.587949 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bdbec-c37b-4c0e-ba22-237dab4995f5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:27.587949 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bdbec-c37b-4c0e-ba22-237dab4995f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:27.673670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-408bdbec-c37b-4c0e-ba22-237dab4995f5 None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:27.674837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-408bdbec-c37b-4c0e-ba22-237dab4995f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:27.713587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:27.803929 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 690/1367] 10.222.0.60 () {58 vars in 1059 bytes} [Thu Aug 4 02:29:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:27.811971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d6ef3-34fd-408a-872e-5e827eacfb7c None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:27.813508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ba3d6ef3-34fd-408a-872e-5e827eacfb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:27.965185 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d6ef3-34fd-408a-872e-5e827eacfb7c None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:27.986918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:28.094331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc593c-30c7-4499-a38f-9acdd0497a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:28.094984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc593c-30c7-4499-a38f-9acdd0497a7b service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:28.095270 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc593c-30c7-4499-a38f-9acdd0497a7b service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:28.095548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc593c-30c7-4499-a38f-9acdd0497a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:28.097186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-28dc593c-30c7-4499-a38f-9acdd0497a7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:28.194954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc593c-30c7-4499-a38f-9acdd0497a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:28.196561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc593c-30c7-4499-a38f-9acdd0497a7b service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:28.216261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 678/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:29:29.159892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d73e-e8fd-4d29-919c-866da342c8e8 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:29.160420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d73e-e8fd-4d29-919c-866da342c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:29.160420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d73e-e8fd-4d29-919c-866da342c8e8 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:29.161870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 691/1369] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:29.167274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5ae09-3fc2-4b30-9fcd-bcf900e30406 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:29.167728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5ae09-3fc2-4b30-9fcd-bcf900e30406 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:29.167822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5ae09-3fc2-4b30-9fcd-bcf900e30406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:29.202936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:29.240375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f5c5ae09-3fc2-4b30-9fcd-bcf900e30406 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:29.241598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f5c5ae09-3fc2-4b30-9fcd-bcf900e30406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:29.341795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 679/1370] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:29.689567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71d0c9-7c71-44a0-b15f-8ad0a52f3ee0 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:29.689567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71d0c9-7c71-44a0-b15f-8ad0a52f3ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:29.689567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71d0c9-7c71-44a0-b15f-8ad0a52f3ee0 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:29.691613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 692/1371] 10.222.0.60 () {54 vars in 964 bytes} [Thu Aug 4 02:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:29.695797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f02491-b454-49b8-b73e-bb916dc64a78 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:29.696093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f02491-b454-49b8-b73e-bb916dc64a78 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:29.696376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f02491-b454-49b8-b73e-bb916dc64a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:29.778395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b9f02491-b454-49b8-b73e-bb916dc64a78 None None] MFA Rules not processed for user `3ffc2cd3c6a84eef894edae6e9b38210`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:29.779842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b9f02491-b454-49b8-b73e-bb916dc64a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:29.828881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:29.861003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 680/1372] 10.222.0.60 () {58 vars in 1061 bytes} [Thu Aug 4 02:29:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:29.869506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71d0c9-7c71-44a0-b15f-8ad0a52f3ee0 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:29.871186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-fa71d0c9-7c71-44a0-b15f-8ad0a52f3ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:30.004755 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71d0c9-7c71-44a0-b15f-8ad0a52f3ee0 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:30.055841 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:30.095052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b5c7d-8400-4b9e-b94c-dfe6eb86a56c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:30.096311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b5c7d-8400-4b9e-b94c-dfe6eb86a56c service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:30.096955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b5c7d-8400-4b9e-b94c-dfe6eb86a56c service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:30.097310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b5c7d-8400-4b9e-b94c-dfe6eb86a56c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:30.099726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-584b5c7d-8400-4b9e-b94c-dfe6eb86a56c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:30.216864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b5c7d-8400-4b9e-b94c-dfe6eb86a56c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:30.218441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b5c7d-8400-4b9e-b94c-dfe6eb86a56c service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:30.238312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 693/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:30.487665 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2413e56-29cb-4330-907d-6e19a0627332 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:30.488085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2413e56-29cb-4330-907d-6e19a0627332 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:30.488761 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2413e56-29cb-4330-907d-6e19a0627332 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:30.490932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 681/1374] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:30.495760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31482c-f9ca-4c96-b45b-7c8d26fff00a None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:30.496242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31482c-f9ca-4c96-b45b-7c8d26fff00a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:30.496402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31482c-f9ca-4c96-b45b-7c8d26fff00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:30.587715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-6a31482c-f9ca-4c96-b45b-7c8d26fff00a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:30.589978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-6a31482c-f9ca-4c96-b45b-7c8d26fff00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:30.616151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:30.695635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 694/1375] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:30.740029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2413e56-29cb-4330-907d-6e19a0627332 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:30.741668 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d2413e56-29cb-4330-907d-6e19a0627332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:30.890925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2413e56-29cb-4330-907d-6e19a0627332 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:30.945721 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:31.007844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4ffdd-c7fe-4ca8-9d86-e9d56288ff3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:31.008471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4ffdd-c7fe-4ca8-9d86-e9d56288ff3e service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:31.008751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4ffdd-c7fe-4ca8-9d86-e9d56288ff3e service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:31.009028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4ffdd-c7fe-4ca8-9d86-e9d56288ff3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:31.010753 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-fca4ffdd-c7fe-4ca8-9d86-e9d56288ff3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:31.104521 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4ffdd-c7fe-4ca8-9d86-e9d56288ff3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:31.106122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4ffdd-c7fe-4ca8-9d86-e9d56288ff3e service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:31.124189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 682/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:33.261540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20d9c9-a996-4983-bdf8-a1521375c9f8 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:33.262100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20d9c9-a996-4983-bdf8-a1521375c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:33.262100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20d9c9-a996-4983-bdf8-a1521375c9f8 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:33.263458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 695/1377] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:33.268766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2c3bc-d8c7-4628-807e-2b01f5050b1a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:33.269214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2c3bc-d8c7-4628-807e-2b01f5050b1a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:33.269457 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2c3bc-d8c7-4628-807e-2b01f5050b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:33.335936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-09c2c3bc-d8c7-4628-807e-2b01f5050b1a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:33.337166 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-09c2c3bc-d8c7-4628-807e-2b01f5050b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:33.344080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:33.445037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 683/1378] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:33.490976 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20d9c9-a996-4983-bdf8-a1521375c9f8 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:33.492494 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1f20d9c9-a996-4983-bdf8-a1521375c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:33.650382 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20d9c9-a996-4983-bdf8-a1521375c9f8 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:33.654294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:33.765483 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de161b7-0284-4917-ae72-e46e1b17d412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:33.766110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de161b7-0284-4917-ae72-e46e1b17d412 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:33.766397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de161b7-0284-4917-ae72-e46e1b17d412 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:33.766707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de161b7-0284-4917-ae72-e46e1b17d412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:33.768343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4de161b7-0284-4917-ae72-e46e1b17d412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:33.860508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de161b7-0284-4917-ae72-e46e1b17d412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:33.862275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de161b7-0284-4917-ae72-e46e1b17d412 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:33.886829 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 696/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:29:36.079269 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b034-3cd5-4d99-8d5b-35029b7299e3 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:36.079894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b034-3cd5-4d99-8d5b-35029b7299e3 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:36.079894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b034-3cd5-4d99-8d5b-35029b7299e3 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:36.081232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 684/1380] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:36.087637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc42864-c052-416f-89d6-c15d565dd6b7 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:36.088074 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc42864-c052-416f-89d6-c15d565dd6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:36.088401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc42864-c052-416f-89d6-c15d565dd6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:36.100502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:36.160839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-acc42864-c052-416f-89d6-c15d565dd6b7 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:36.162218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-acc42864-c052-416f-89d6-c15d565dd6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:36.270907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 697/1381] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:36.312583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3b034-3cd5-4d99-8d5b-35029b7299e3 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:36.314220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f7a3b034-3cd5-4d99-8d5b-35029b7299e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:36.471092 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:36.482870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3b034-3cd5-4d99-8d5b-35029b7299e3 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:36.602759 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30578dc-ce3f-4f4b-b789-387198d9e7e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:36.603476 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30578dc-ce3f-4f4b-b789-387198d9e7e2 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:36.603828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30578dc-ce3f-4f4b-b789-387198d9e7e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:36.604173 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30578dc-ce3f-4f4b-b789-387198d9e7e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:36.605849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c30578dc-ce3f-4f4b-b789-387198d9e7e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:36.705682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30578dc-ce3f-4f4b-b789-387198d9e7e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:36.707401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30578dc-ce3f-4f4b-b789-387198d9e7e2 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:36.719875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:36.728408 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 685/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:38.993110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dcae7-528e-4a80-9c93-b2c7dec92e15 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:38.993665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dcae7-528e-4a80-9c93-b2c7dec92e15 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:38.993665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dcae7-528e-4a80-9c93-b2c7dec92e15 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:38.995070 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 698/1383] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:39.000629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda95a0-228a-4e21-915f-5ed91863edb1 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:39.001033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda95a0-228a-4e21-915f-5ed91863edb1 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:39.001218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda95a0-228a-4e21-915f-5ed91863edb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:39.075217 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-0eda95a0-228a-4e21-915f-5ed91863edb1 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:39.076503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0eda95a0-228a-4e21-915f-5ed91863edb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:39.181289 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 686/1384] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:39.226406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dcae7-528e-4a80-9c93-b2c7dec92e15 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:39.227964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0e3dcae7-528e-4a80-9c93-b2c7dec92e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:39.317435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:39.386543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dcae7-528e-4a80-9c93-b2c7dec92e15 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:39.517158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec78fe-6bd4-4732-bc81-2aa26cf2c017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:39.517916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec78fe-6bd4-4732-bc81-2aa26cf2c017 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:39.518277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec78fe-6bd4-4732-bc81-2aa26cf2c017 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:39.518671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec78fe-6bd4-4732-bc81-2aa26cf2c017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:39.521011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-58ec78fe-6bd4-4732-bc81-2aa26cf2c017 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:39.579322 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:39.620840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec78fe-6bd4-4732-bc81-2aa26cf2c017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:39.622456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec78fe-6bd4-4732-bc81-2aa26cf2c017 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:39.641378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 699/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:41.940128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b177f2-5c85-438d-9a8f-1a5230fc448c None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:41.940826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b177f2-5c85-438d-9a8f-1a5230fc448c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:41.940826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b177f2-5c85-438d-9a8f-1a5230fc448c None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:41.942925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 687/1386] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:29:41.948527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a70b7-c55d-46ed-a3b4-668f66bb8b3d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:41.948944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a70b7-c55d-46ed-a3b4-668f66bb8b3d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:41.949112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a70b7-c55d-46ed-a3b4-668f66bb8b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:42.028652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-292a70b7-c55d-46ed-a3b4-668f66bb8b3d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:42.030545 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-292a70b7-c55d-46ed-a3b4-668f66bb8b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:42.142576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 700/1387] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:42.189660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b177f2-5c85-438d-9a8f-1a5230fc448c None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:42.191303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-14b177f2-5c85-438d-9a8f-1a5230fc448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:42.287119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:42.361597 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b177f2-5c85-438d-9a8f-1a5230fc448c None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:42.482339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29290758-c191-468a-83e5-e429befad6a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:42.482947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29290758-c191-468a-83e5-e429befad6a5 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:42.483228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29290758-c191-468a-83e5-e429befad6a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:42.483514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29290758-c191-468a-83e5-e429befad6a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:42.485206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-29290758-c191-468a-83e5-e429befad6a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:42.524613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:42.578222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29290758-c191-468a-83e5-e429befad6a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:42.579912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29290758-c191-468a-83e5-e429befad6a5 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:42.598977 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 688/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:44.795082 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd2da1-6ec5-41ff-a5b9-1589c1203954 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:44.795675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd2da1-6ec5-41ff-a5b9-1589c1203954 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:44.795675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd2da1-6ec5-41ff-a5b9-1589c1203954 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:44.797014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 701/1389] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:44.802427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21e131-afc7-4252-8aa8-f7e34803bcad None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:44.802900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21e131-afc7-4252-8aa8-f7e34803bcad None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:44.803261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21e131-afc7-4252-8aa8-f7e34803bcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:44.874246 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6b21e131-afc7-4252-8aa8-f7e34803bcad None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:44.875627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6b21e131-afc7-4252-8aa8-f7e34803bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:44.976695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 689/1390] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:45.020546 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd2da1-6ec5-41ff-a5b9-1589c1203954 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:45.023091 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-71fd2da1-6ec5-41ff-a5b9-1589c1203954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:45.056215 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:45.174141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd2da1-6ec5-41ff-a5b9-1589c1203954 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:45.278199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:45.289966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc205dea-74c5-489e-ac03-b8d800366380 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:45.290625 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc205dea-74c5-489e-ac03-b8d800366380 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:45.290912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc205dea-74c5-489e-ac03-b8d800366380 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:45.291188 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc205dea-74c5-489e-ac03-b8d800366380 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:45.292821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-bc205dea-74c5-489e-ac03-b8d800366380 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:45.384415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc205dea-74c5-489e-ac03-b8d800366380 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:45.386037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc205dea-74c5-489e-ac03-b8d800366380 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:45.404471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 702/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:45.753549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff55f0e-5c85-4703-a309-ef74f7f673b4 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:45.753824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff55f0e-5c85-4703-a309-ef74f7f673b4 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:45.754125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff55f0e-5c85-4703-a309-ef74f7f673b4 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:45.755658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 690/1392] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:45.760895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a9db-7524-4f96-a23d-2a84f1bba568 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:45.761267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a9db-7524-4f96-a23d-2a84f1bba568 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:45.761615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a9db-7524-4f96-a23d-2a84f1bba568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:45.829180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b777a9db-7524-4f96-a23d-2a84f1bba568 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:45.830403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b777a9db-7524-4f96-a23d-2a84f1bba568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:45.891412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:45.931431 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 703/1393] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:45.987856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8cda5-caa0-4940-9dc6-3e88bb6e557e None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:45.988337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8cda5-caa0-4940-9dc6-3e88bb6e557e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:45.988433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8cda5-caa0-4940-9dc6-3e88bb6e557e None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:45.989828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 691/1394] 10.222.0.60 () {54 vars in 966 bytes} [Thu Aug 4 02:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:45.995181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415953a3-2962-4a26-9a21-5b24e30fcee5 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:45.995471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415953a3-2962-4a26-9a21-5b24e30fcee5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:45.995751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415953a3-2962-4a26-9a21-5b24e30fcee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:46.078850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-415953a3-2962-4a26-9a21-5b24e30fcee5 None None] MFA Rules not processed for user `10bd2ed69b324e85b8166135f045b840`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:46.080052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-415953a3-2962-4a26-9a21-5b24e30fcee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:46.157852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 704/1395] 10.222.0.60 () {58 vars in 1063 bytes} [Thu Aug 4 02:29:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:46.166118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8cda5-caa0-4940-9dc6-3e88bb6e557e None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:46.167759 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e7c8cda5-caa0-4940-9dc6-3e88bb6e557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:46.183533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:46.278243 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8cda5-caa0-4940-9dc6-3e88bb6e557e None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:46.354239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a99e4-c6af-4346-b598-f6f0b4a57337 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bd2ed69b324e85b8166135f045b840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:46.354921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a99e4-c6af-4346-b598-f6f0b4a57337 service glance] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:46.355211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a99e4-c6af-4346-b598-f6f0b4a57337 service glance] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:46.355494 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a99e4-c6af-4346-b598-f6f0b4a57337 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:46.357127 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2a0a99e4-c6af-4346-b598-f6f0b4a57337 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:46.428950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:46.471093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a99e4-c6af-4346-b598-f6f0b4a57337 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:46.472541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a99e4-c6af-4346-b598-f6f0b4a57337 service glance] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:46.491078 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 692/1396] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:47.368415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597e4f-3143-45aa-a659-f2f8e3b0e9f0 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:47.368415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597e4f-3143-45aa-a659-f2f8e3b0e9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:47.368415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597e4f-3143-45aa-a659-f2f8e3b0e9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:47.438044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-63597e4f-3143-45aa-a659-f2f8e3b0e9f0 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:47.439107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-63597e4f-3143-45aa-a659-f2f8e3b0e9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:47.448956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:47.531096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 705/1397] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:29:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:47.579587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420032-b3fc-47fd-a06c-99ffb7485e90 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:47.580084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420032-b3fc-47fd-a06c-99ffb7485e90 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:47.580191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420032-b3fc-47fd-a06c-99ffb7485e90 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:47.581575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 693/1398] 10.222.0.60 () {54 vars in 943 bytes} [Thu Aug 4 02:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:47.588762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c47387-cea9-4bcf-9ee8-045cad75c0a0 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:47.589059 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c47387-cea9-4bcf-9ee8-045cad75c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:47.589344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c47387-cea9-4bcf-9ee8-045cad75c0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:47.595618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5660878-e93c-43b6-8ab2-0df250de009c None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:47.595906 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5660878-e93c-43b6-8ab2-0df250de009c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:47.596186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5660878-e93c-43b6-8ab2-0df250de009c None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:47.597629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 694/1399] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:29:47.603159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638794e-a563-4847-b49f-51b985da5d87 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:47.603445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638794e-a563-4847-b49f-51b985da5d87 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:47.603725 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638794e-a563-4847-b49f-51b985da5d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:47.673545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-1638794e-a563-4847-b49f-51b985da5d87 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:47.674792 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1638794e-a563-4847-b49f-51b985da5d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:47.677343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-98c47387-cea9-4bcf-9ee8-045cad75c0a0 None None] MFA Rules not processed for user `6414c895c6d642a2affb36013b71df34`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:47.678758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-98c47387-cea9-4bcf-9ee8-045cad75c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:47.775313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 695/1400] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:29:47.795350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 706/1401] 10.222.0.60 () {58 vars in 1040 bytes} [Thu Aug 4 02:29:47 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:47.806006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638794e-a563-4847-b49f-51b985da5d87 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:47.807413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1638794e-a563-4847-b49f-51b985da5d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:47.819930 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c47387-cea9-4bcf-9ee8-045cad75c0a0 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:47.821177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-98c47387-cea9-4bcf-9ee8-045cad75c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:47.835634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:47.863444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:47.914301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638794e-a563-4847-b49f-51b985da5d87 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:47.921519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c47387-cea9-4bcf-9ee8-045cad75c0a0 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:48.021449 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141542e-d0bd-442d-98f7-d6c777a83bf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:48.022074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141542e-d0bd-442d-98f7-d6c777a83bf5 service swift] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:48.022364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141542e-d0bd-442d-98f7-d6c777a83bf5 service swift] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:48.022675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141542e-d0bd-442d-98f7-d6c777a83bf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:48.024354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2141542e-d0bd-442d-98f7-d6c777a83bf5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:48.030860 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:48.038434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1cb1d-b7ff-43f6-8cd0-146c3d781698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:48.039092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1cb1d-b7ff-43f6-8cd0-146c3d781698 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:48.040024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1cb1d-b7ff-43f6-8cd0-146c3d781698 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:48.040311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1cb1d-b7ff-43f6-8cd0-146c3d781698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:48.042001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-88f1cb1d-b7ff-43f6-8cd0-146c3d781698 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:48.070807 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:48.113590 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141542e-d0bd-442d-98f7-d6c777a83bf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:48.115901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141542e-d0bd-442d-98f7-d6c777a83bf5 service swift] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:48.124447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 696/1402] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:29:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:29:48.138837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1cb1d-b7ff-43f6-8cd0-146c3d781698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:48.140553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1cb1d-b7ff-43f6-8cd0-146c3d781698 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:48.160076 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 707/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:29:50.442127 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59244405-cc95-40ee-b91c-207671329ef6 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:50.443305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59244405-cc95-40ee-b91c-207671329ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:50.443305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59244405-cc95-40ee-b91c-207671329ef6 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:50.444565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 697/1404] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:50.450042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926132e4-0f60-4233-aae3-a5685f74744b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:50.450434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926132e4-0f60-4233-aae3-a5685f74744b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:50.450655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926132e4-0f60-4233-aae3-a5685f74744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:50.521866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-926132e4-0f60-4233-aae3-a5685f74744b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:50.523145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-926132e4-0f60-4233-aae3-a5685f74744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:50.589577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:50.635498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 708/1405] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:50.685818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59244405-cc95-40ee-b91c-207671329ef6 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:50.687652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-59244405-cc95-40ee-b91c-207671329ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:50.872828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59244405-cc95-40ee-b91c-207671329ef6 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:50.916015 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:51.007781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92677fbb-2635-408d-a170-3d0bd082355c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:51.008420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92677fbb-2635-408d-a170-3d0bd082355c service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:51.008707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92677fbb-2635-408d-a170-3d0bd082355c service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:51.008990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92677fbb-2635-408d-a170-3d0bd082355c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:51.010925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-92677fbb-2635-408d-a170-3d0bd082355c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:51.143739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92677fbb-2635-408d-a170-3d0bd082355c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:51.158441 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92677fbb-2635-408d-a170-3d0bd082355c service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:51.174654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 698/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:53.726245 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597d4ef-eca7-4e30-87d3-116362d92e8b None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:53.726855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597d4ef-eca7-4e30-87d3-116362d92e8b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:53.726855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597d4ef-eca7-4e30-87d3-116362d92e8b None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:53.728208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 709/1407] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:53.733680 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d060b0-ae8a-4f0c-91e1-66c32ac8cb59 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:53.734176 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d060b0-ae8a-4f0c-91e1-66c32ac8cb59 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:53.734266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d060b0-ae8a-4f0c-91e1-66c32ac8cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:53.794138 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:53.817568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-a0d060b0-ae8a-4f0c-91e1-66c32ac8cb59 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:53.822513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a0d060b0-ae8a-4f0c-91e1-66c32ac8cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:53.937768 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 699/1408] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:53.989909 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597d4ef-eca7-4e30-87d3-116362d92e8b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:53.989909 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4597d4ef-eca7-4e30-87d3-116362d92e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:54.162215 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597d4ef-eca7-4e30-87d3-116362d92e8b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:54.221521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:54.296221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dff859-f4b5-4842-8a61-c2a327f46086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:54.297383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dff859-f4b5-4842-8a61-c2a327f46086 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:54.297748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dff859-f4b5-4842-8a61-c2a327f46086 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:54.298093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dff859-f4b5-4842-8a61-c2a327f46086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:54.299970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-06dff859-f4b5-4842-8a61-c2a327f46086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:54.403130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dff859-f4b5-4842-8a61-c2a327f46086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:54.404868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dff859-f4b5-4842-8a61-c2a327f46086 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:54.424987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 710/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:03.935896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=47 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:04.422203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=75 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:11.638669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c9f90-a7cc-44b8-8a80-7c54b2448a9b None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:11.639233 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c9f90-a7cc-44b8-8a80-7c54b2448a9b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:11.639233 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c9f90-a7cc-44b8-8a80-7c54b2448a9b None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:11.640646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 700/1410] 10.222.0.60 () {54 vars in 918 bytes} [Thu Aug 4 02:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:11.646577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b772157-12b4-4d5a-9222-5ebe60e60fb2 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:11.646971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b772157-12b4-4d5a-9222-5ebe60e60fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:11.647170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b772157-12b4-4d5a-9222-5ebe60e60fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:11.724562 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-9b772157-12b4-4d5a-9222-5ebe60e60fb2 None None] MFA Rules not processed for user `423ac00601f84e3d9c6cc6ee20eee6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:11.726548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9b772157-12b4-4d5a-9222-5ebe60e60fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:11.829931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 711/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Thu Aug 4 02:30:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:30:11.846506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96ee15-d6de-4530-9a52-303df4e9b90f None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:11.846804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96ee15-d6de-4530-9a52-303df4e9b90f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:11.847087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96ee15-d6de-4530-9a52-303df4e9b90f None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:11.849224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 701/1412] 10.222.0.60 () {54 vars in 918 bytes} [Thu Aug 4 02:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:11.854394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932242c5-c217-4317-86e6-8f0f51c89df5 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:11.854734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932242c5-c217-4317-86e6-8f0f51c89df5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:11.855011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932242c5-c217-4317-86e6-8f0f51c89df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:11.927993 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:11.930409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-932242c5-c217-4317-86e6-8f0f51c89df5 None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:11.931639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-932242c5-c217-4317-86e6-8f0f51c89df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:12.047809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 712/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Thu Aug 4 02:30:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:30:14.513066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b22490-d7a6-4023-aac9-21e6e3f273c6 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:14.513638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b22490-d7a6-4023-aac9-21e6e3f273c6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:14.513638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b22490-d7a6-4023-aac9-21e6e3f273c6 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:14.515023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:14.520691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257195c-9bfd-46fc-9248-92ec3b75df97 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:14.521119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257195c-9bfd-46fc-9248-92ec3b75df97 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:14.521238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257195c-9bfd-46fc-9248-92ec3b75df97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:14.588153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-1257195c-9bfd-46fc-9248-92ec3b75df97 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:14.589355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1257195c-9bfd-46fc-9248-92ec3b75df97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:14.643129 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:14.686614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:14.729810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b22490-d7a6-4023-aac9-21e6e3f273c6 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:14.731406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-04b22490-d7a6-4023-aac9-21e6e3f273c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:14.880772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b22490-d7a6-4023-aac9-21e6e3f273c6 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:14.953097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:14.993615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91bbf4-74e0-414e-b095-458e8d75adba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:14.994238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91bbf4-74e0-414e-b095-458e8d75adba service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:14.994564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91bbf4-74e0-414e-b095-458e8d75adba service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:14.994875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91bbf4-74e0-414e-b095-458e8d75adba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:14.996513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4e91bbf4-74e0-414e-b095-458e8d75adba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:15.087472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91bbf4-74e0-414e-b095-458e8d75adba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:15.089089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91bbf4-74e0-414e-b095-458e8d75adba service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:15.106965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 703/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:16.013627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f4d26-4f6b-470f-b449-73b8f34dc50d None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:16.014194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f4d26-4f6b-470f-b449-73b8f34dc50d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:16.014194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f4d26-4f6b-470f-b449-73b8f34dc50d None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:16.015894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:16.020719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf0f73-1508-4e88-8266-c30d2e6cd37f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:16.021124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf0f73-1508-4e88-8266-c30d2e6cd37f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:16.021279 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf0f73-1508-4e88-8266-c30d2e6cd37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:16.101446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6ecf0f73-1508-4e88-8266-c30d2e6cd37f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:16.102721 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6ecf0f73-1508-4e88-8266-c30d2e6cd37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:16.130105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:16.200041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:16.351773 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f4d26-4f6b-470f-b449-73b8f34dc50d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:16.353296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-699f4d26-4f6b-470f-b449-73b8f34dc50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:16.499874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f4d26-4f6b-470f-b449-73b8f34dc50d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:16.540859 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:16.614313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25863ae8-20c7-4a25-af96-a53b21446ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:16.614962 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863ae8-20c7-4a25-af96-a53b21446ec0 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:16.615248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863ae8-20c7-4a25-af96-a53b21446ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:16.615525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25863ae8-20c7-4a25-af96-a53b21446ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:16.617167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-25863ae8-20c7-4a25-af96-a53b21446ec0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:16.705869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25863ae8-20c7-4a25-af96-a53b21446ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:16.708115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25863ae8-20c7-4a25-af96-a53b21446ec0 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:16.726735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 715/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:17.620187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ab018-ed93-4297-bed4-b6651ef21451 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:17.620805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ab018-ed93-4297-bed4-b6651ef21451 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:17.620805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ab018-ed93-4297-bed4-b6651ef21451 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:17.622132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:17.627453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfbbc3-f8a9-48bd-b9ba-4b810c94c822 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:17.627851 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfbbc3-f8a9-48bd-b9ba-4b810c94c822 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:17.628012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfbbc3-f8a9-48bd-b9ba-4b810c94c822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:17.683620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:17.706716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-83dfbbc3-f8a9-48bd-b9ba-4b810c94c822 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:17.707936 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-83dfbbc3-f8a9-48bd-b9ba-4b810c94c822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:17.808765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:17.968077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ab018-ed93-4297-bed4-b6651ef21451 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:17.969525 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e33ab018-ed93-4297-bed4-b6651ef21451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:18.126026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ab018-ed93-4297-bed4-b6651ef21451 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:18.138653 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:18.242828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c355f-96a5-4466-a10f-85ff159480b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:18.243503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c355f-96a5-4466-a10f-85ff159480b3 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:18.243787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c355f-96a5-4466-a10f-85ff159480b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:18.244060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c355f-96a5-4466-a10f-85ff159480b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:18.245666 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9a6c355f-96a5-4466-a10f-85ff159480b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:18.337977 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c355f-96a5-4466-a10f-85ff159480b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:18.339611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c355f-96a5-4466-a10f-85ff159480b3 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:18.358536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 706/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:19.236083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326048fd-287f-476b-9720-25185b0846ef None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:19.236626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326048fd-287f-476b-9720-25185b0846ef None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:19.236626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326048fd-287f-476b-9720-25185b0846ef None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:19.238258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:19.243260 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8fafe-4241-4fb5-886a-866eda772d2c None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:19.243714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8fafe-4241-4fb5-886a-866eda772d2c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:19.243815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8fafe-4241-4fb5-886a-866eda772d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:19.263424 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:19.321310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8aa8fafe-4241-4fb5-886a-866eda772d2c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:19.322462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8aa8fafe-4241-4fb5-886a-866eda772d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:19.420327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:19.573746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326048fd-287f-476b-9720-25185b0846ef None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:19.575239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-326048fd-287f-476b-9720-25185b0846ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:19.685620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:19.723112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326048fd-287f-476b-9720-25185b0846ef None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:19.836352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a91bcf-6961-4c7a-8ff1-d219a6c90061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:19.836971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a91bcf-6961-4c7a-8ff1-d219a6c90061 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:19.837246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a91bcf-6961-4c7a-8ff1-d219a6c90061 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:19.837617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a91bcf-6961-4c7a-8ff1-d219a6c90061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:19.839809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-96a91bcf-6961-4c7a-8ff1-d219a6c90061 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:19.914077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:19.927898 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a91bcf-6961-4c7a-8ff1-d219a6c90061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:19.929489 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a91bcf-6961-4c7a-8ff1-d219a6c90061 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:19.948058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 718/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:20.817329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca274ee0-f90c-4b1c-a61c-5d7a22b4ea0f None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:20.817886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca274ee0-f90c-4b1c-a61c-5d7a22b4ea0f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:20.817886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca274ee0-f90c-4b1c-a61c-5d7a22b4ea0f None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:20.819343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:20.824191 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a8b27-cd1d-4035-a516-9e1a2308094e None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:20.824597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a8b27-cd1d-4035-a516-9e1a2308094e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:20.824769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a8b27-cd1d-4035-a516-9e1a2308094e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:20.901607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-612a8b27-cd1d-4035-a516-9e1a2308094e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:20.902854 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-612a8b27-cd1d-4035-a516-9e1a2308094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:20.997936 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:21.150631 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca274ee0-f90c-4b1c-a61c-5d7a22b4ea0f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:21.152170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ca274ee0-f90c-4b1c-a61c-5d7a22b4ea0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:21.237311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:21.302143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca274ee0-f90c-4b1c-a61c-5d7a22b4ea0f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:21.414543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d567b4-0fa5-47f3-96a4-51f254e88599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:21.415523 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d567b4-0fa5-47f3-96a4-51f254e88599 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:21.415523 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d567b4-0fa5-47f3-96a4-51f254e88599 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:21.416293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d567b4-0fa5-47f3-96a4-51f254e88599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:21.417344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f2d567b4-0fa5-47f3-96a4-51f254e88599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:21.467527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:21.509436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d567b4-0fa5-47f3-96a4-51f254e88599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:21.511095 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d567b4-0fa5-47f3-96a4-51f254e88599 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:21.529047 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 709/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:22.412977 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497511a4-66f5-4b08-838d-51589168d090 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:22.413495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497511a4-66f5-4b08-838d-51589168d090 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:22.413607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497511a4-66f5-4b08-838d-51589168d090 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:22.415102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:22.420126 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9acc7-1262-405b-8ece-4b14dfb8f707 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:22.420540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9acc7-1262-405b-8ece-4b14dfb8f707 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:22.420684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9acc7-1262-405b-8ece-4b14dfb8f707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:22.496684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-fad9acc7-1262-405b-8ece-4b14dfb8f707 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:22.497891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-fad9acc7-1262-405b-8ece-4b14dfb8f707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:22.594600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:22.747367 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497511a4-66f5-4b08-838d-51589168d090 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:22.748896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-497511a4-66f5-4b08-838d-51589168d090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:22.798429 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:22.898633 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497511a4-66f5-4b08-838d-51589168d090 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:23.013508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee86aa-aa6b-4917-af8b-65d52d8ddbf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:23.014132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee86aa-aa6b-4917-af8b-65d52d8ddbf1 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:23.014411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee86aa-aa6b-4917-af8b-65d52d8ddbf1 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:23.014734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee86aa-aa6b-4917-af8b-65d52d8ddbf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:23.016358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4aee86aa-aa6b-4917-af8b-65d52d8ddbf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:23.023469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:23.113552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee86aa-aa6b-4917-af8b-65d52d8ddbf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:23.115194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee86aa-aa6b-4917-af8b-65d52d8ddbf1 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:23.134313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 721/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:23.977625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bb864-c940-4184-b2e9-ba5a5d9e078b None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:23.978186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bb864-c940-4184-b2e9-ba5a5d9e078b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:23.978186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bb864-c940-4184-b2e9-ba5a5d9e078b None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:23.979591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:23.984730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934227-d4bf-4b10-ac5d-07371d203162 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:23.985175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934227-d4bf-4b10-ac5d-07371d203162 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:23.985286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934227-d4bf-4b10-ac5d-07371d203162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:24.063210 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-31934227-d4bf-4b10-ac5d-07371d203162 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:24.064335 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-31934227-d4bf-4b10-ac5d-07371d203162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:24.133215 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:24.162651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:24.313594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bb864-c940-4184-b2e9-ba5a5d9e078b None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:24.315099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-7f0bb864-c940-4184-b2e9-ba5a5d9e078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:24.334064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:24.462575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bb864-c940-4184-b2e9-ba5a5d9e078b None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:24.550746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:24.576465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc206af-83cb-420c-ab05-577f35f91429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:24.577147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc206af-83cb-420c-ab05-577f35f91429 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:24.577626 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc206af-83cb-420c-ab05-577f35f91429 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:24.578070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc206af-83cb-420c-ab05-577f35f91429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:24.579981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-dcc206af-83cb-420c-ab05-577f35f91429 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:24.669455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc206af-83cb-420c-ab05-577f35f91429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:24.671368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc206af-83cb-420c-ab05-577f35f91429 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:24.689835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 712/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:25.598299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a5a5d-2f9a-4e78-b4e4-abe16a89375f None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:25.598855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a5a5d-2f9a-4e78-b4e4-abe16a89375f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:25.598965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a5a5d-2f9a-4e78-b4e4-abe16a89375f None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:25.600468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:25.605760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f426a-6d7d-4922-bddf-3b0c5ecbba5a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:25.606200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f426a-6d7d-4922-bddf-3b0c5ecbba5a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:25.606327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f426a-6d7d-4922-bddf-3b0c5ecbba5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:25.683480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-209f426a-6d7d-4922-bddf-3b0c5ecbba5a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:25.684679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-209f426a-6d7d-4922-bddf-3b0c5ecbba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:25.727422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:25.782555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:25.937779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a5a5d-2f9a-4e78-b4e4-abe16a89375f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:25.939303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-400a5a5d-2f9a-4e78-b4e4-abe16a89375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:26.090380 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a5a5d-2f9a-4e78-b4e4-abe16a89375f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:26.145354 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:26.204366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac2797-c881-4ebc-a998-ee826dc13a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:26.204893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2797-c881-4ebc-a998-ee826dc13a07 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:26.205174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2797-c881-4ebc-a998-ee826dc13a07 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:26.205445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2797-c881-4ebc-a998-ee826dc13a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:26.207300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c5ac2797-c881-4ebc-a998-ee826dc13a07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:26.295851 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac2797-c881-4ebc-a998-ee826dc13a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:26.297467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac2797-c881-4ebc-a998-ee826dc13a07 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:26.315925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 724/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:27.180249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c3ba6-6312-4424-bbbb-d91497b38905 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:27.180810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c3ba6-6312-4424-bbbb-d91497b38905 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:27.180810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c3ba6-6312-4424-bbbb-d91497b38905 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:27.182163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:27.187050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a14948-4705-4e70-8f62-7186e41d9a38 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:27.187475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a14948-4705-4e70-8f62-7186e41d9a38 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:27.187650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a14948-4705-4e70-8f62-7186e41d9a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:27.264172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-c1a14948-4705-4e70-8f62-7186e41d9a38 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:27.265388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c1a14948-4705-4e70-8f62-7186e41d9a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:27.267492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:27.365711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:27.517900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c3ba6-6312-4424-bbbb-d91497b38905 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:27.520116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6a4c3ba6-6312-4424-bbbb-d91497b38905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:27.670082 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c3ba6-6312-4424-bbbb-d91497b38905 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:27.697205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:27.784143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f730927-5033-417b-8603-4dff875155ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:27.784961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f730927-5033-417b-8603-4dff875155ad service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:27.785247 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f730927-5033-417b-8603-4dff875155ad service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:27.785522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f730927-5033-417b-8603-4dff875155ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:27.787180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0f730927-5033-417b-8603-4dff875155ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:27.877068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f730927-5033-417b-8603-4dff875155ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:27.879350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f730927-5033-417b-8603-4dff875155ad service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:27.898586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 715/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:29.829344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f43c9-33b1-4e33-a828-c0f52a395e29 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:29.829945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f43c9-33b1-4e33-a828-c0f52a395e29 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:29.829945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f43c9-33b1-4e33-a828-c0f52a395e29 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:29.831478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:29.836989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ff98c-a06e-49f2-8613-316db36aaa8b None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:29.837418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ff98c-a06e-49f2-8613-316db36aaa8b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:29.837556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ff98c-a06e-49f2-8613-316db36aaa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:29.879769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:29.904910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-024ff98c-a06e-49f2-8613-316db36aaa8b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:29.906120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-024ff98c-a06e-49f2-8613-316db36aaa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:30.005426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:30.043864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f43c9-33b1-4e33-a828-c0f52a395e29 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:30.045663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7a7f43c9-33b1-4e33-a828-c0f52a395e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:30.151105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f43c9-33b1-4e33-a828-c0f52a395e29 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:30.184286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:30.226102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff1a33-fa2c-4af4-bb3f-938fd85d3033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:30.226745 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1a33-fa2c-4af4-bb3f-938fd85d3033 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:30.227030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1a33-fa2c-4af4-bb3f-938fd85d3033 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:30.227307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1a33-fa2c-4af4-bb3f-938fd85d3033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:30.228929 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cfff1a33-fa2c-4af4-bb3f-938fd85d3033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:30.338134 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff1a33-fa2c-4af4-bb3f-938fd85d3033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:30.339634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff1a33-fa2c-4af4-bb3f-938fd85d3033 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:30.359098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 727/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:32.542153 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da559acc-8edc-4a7b-bbed-ee3ee7c68039 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:32.542735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da559acc-8edc-4a7b-bbed-ee3ee7c68039 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:32.542735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da559acc-8edc-4a7b-bbed-ee3ee7c68039 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:32.544123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:32.549651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f93f4-1a3f-4ee6-a733-74006b76ac6d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:32.550084 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f93f4-1a3f-4ee6-a733-74006b76ac6d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:32.550228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f93f4-1a3f-4ee6-a733-74006b76ac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:32.616496 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-704f93f4-1a3f-4ee6-a733-74006b76ac6d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:32.617767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-704f93f4-1a3f-4ee6-a733-74006b76ac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:32.630720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:32.716172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:32.755200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da559acc-8edc-4a7b-bbed-ee3ee7c68039 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:32.756751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-da559acc-8edc-4a7b-bbed-ee3ee7c68039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:32.863198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da559acc-8edc-4a7b-bbed-ee3ee7c68039 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:32.875396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:32.937376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54bdc0-363f-4826-ae5d-989c4a79d33b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:32.938025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54bdc0-363f-4826-ae5d-989c4a79d33b service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:32.938313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54bdc0-363f-4826-ae5d-989c4a79d33b service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:32.938623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54bdc0-363f-4826-ae5d-989c4a79d33b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:32.940544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1a54bdc0-363f-4826-ae5d-989c4a79d33b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:33.050587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54bdc0-363f-4826-ae5d-989c4a79d33b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:33.052034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54bdc0-363f-4826-ae5d-989c4a79d33b service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:33.070658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 718/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:35.507594 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083a501-96c1-484c-851f-1615a43abaf1 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:35.508134 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083a501-96c1-484c-851f-1615a43abaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:35.508134 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083a501-96c1-484c-851f-1615a43abaf1 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:35.509893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:35.515035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96030d67-f11e-4d04-90d2-5503305e0071 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:35.515470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96030d67-f11e-4d04-90d2-5503305e0071 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:35.515587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96030d67-f11e-4d04-90d2-5503305e0071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:35.566779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:35.586151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-96030d67-f11e-4d04-90d2-5503305e0071 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:35.590848 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-96030d67-f11e-4d04-90d2-5503305e0071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:35.688959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:35.729475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083a501-96c1-484c-851f-1615a43abaf1 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:35.731064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0083a501-96c1-484c-851f-1615a43abaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:35.838930 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083a501-96c1-484c-851f-1615a43abaf1 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:35.882015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:35.918363 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2934e6-114e-4bb0-b412-2932648e8048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:35.919349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2934e6-114e-4bb0-b412-2932648e8048 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:35.919637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2934e6-114e-4bb0-b412-2932648e8048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:35.919919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2934e6-114e-4bb0-b412-2932648e8048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:35.921816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-ea2934e6-114e-4bb0-b412-2932648e8048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:36.037620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2934e6-114e-4bb0-b412-2932648e8048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:36.039245 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2934e6-114e-4bb0-b412-2932648e8048 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:36.060492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 730/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:38.228773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78919158-6c6f-4149-8f47-2e9b689f4064 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:38.229280 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78919158-6c6f-4149-8f47-2e9b689f4064 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:38.229395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78919158-6c6f-4149-8f47-2e9b689f4064 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:38.230785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:38.236650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d202c-ed28-455e-ac52-af39eb38bb5c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:38.237581 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d202c-ed28-455e-ac52-af39eb38bb5c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:38.237581 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d202c-ed28-455e-ac52-af39eb38bb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:38.309812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-4c8d202c-ed28-455e-ac52-af39eb38bb5c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:38.311131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4c8d202c-ed28-455e-ac52-af39eb38bb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:38.334314 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:38.414837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:38.455907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78919158-6c6f-4149-8f47-2e9b689f4064 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:38.457604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-78919158-6c6f-4149-8f47-2e9b689f4064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:38.570467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78919158-6c6f-4149-8f47-2e9b689f4064 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:38.591571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:38.647500 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52764a1e-c9eb-4482-a1f2-5c68c0589034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:38.648450 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52764a1e-c9eb-4482-a1f2-5c68c0589034 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:38.648733 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52764a1e-c9eb-4482-a1f2-5c68c0589034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:38.649007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52764a1e-c9eb-4482-a1f2-5c68c0589034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:38.650719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-52764a1e-c9eb-4482-a1f2-5c68c0589034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:38.765796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52764a1e-c9eb-4482-a1f2-5c68c0589034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:38.767353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52764a1e-c9eb-4482-a1f2-5c68c0589034 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:38.786861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 721/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:40.967407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ea9fd-2541-4362-be80-3dae02270067 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:40.967926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ea9fd-2541-4362-be80-3dae02270067 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:40.967926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ea9fd-2541-4362-be80-3dae02270067 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:40.969256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:40.974693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579822ac-2420-4d59-a355-4940576ac46a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:40.975086 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579822ac-2420-4d59-a355-4940576ac46a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:40.975254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579822ac-2420-4d59-a355-4940576ac46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:41.039753 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:41.042901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-579822ac-2420-4d59-a355-4940576ac46a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:41.044141 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-579822ac-2420-4d59-a355-4940576ac46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:41.144470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:41.186593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ea9fd-2541-4362-be80-3dae02270067 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:41.186593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-aa4ea9fd-2541-4362-be80-3dae02270067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:41.292433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ea9fd-2541-4362-be80-3dae02270067 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:41.343950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:41.367891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39655e-b50c-48aa-a387-cb3d9d607117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:41.368507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39655e-b50c-48aa-a387-cb3d9d607117 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:41.368785 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39655e-b50c-48aa-a387-cb3d9d607117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:41.369079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39655e-b50c-48aa-a387-cb3d9d607117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:41.370719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-be39655e-b50c-48aa-a387-cb3d9d607117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:41.479006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39655e-b50c-48aa-a387-cb3d9d607117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:41.480467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39655e-b50c-48aa-a387-cb3d9d607117 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:41.499356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 733/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:43.568236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d1fa6-546c-4c8d-854b-1383258b6950 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:43.568825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d1fa6-546c-4c8d-854b-1383258b6950 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:43.568825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d1fa6-546c-4c8d-854b-1383258b6950 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:43.570159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:43.575603 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8617-9b11-48fd-8b27-e549174b7008 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:43.576023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8617-9b11-48fd-8b27-e549174b7008 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:43.576199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8617-9b11-48fd-8b27-e549174b7008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:43.641339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f03c8617-9b11-48fd-8b27-e549174b7008 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:43.643171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f03c8617-9b11-48fd-8b27-e549174b7008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:43.672214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:43.740182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:43.779021 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d1fa6-546c-4c8d-854b-1383258b6950 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:43.780601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-248d1fa6-546c-4c8d-854b-1383258b6950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:43.886265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d1fa6-546c-4c8d-854b-1383258b6950 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:43.915886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:43.961812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177571c-6350-4279-aa32-5420abf6e365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:43.962426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177571c-6350-4279-aa32-5420abf6e365 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:43.962743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177571c-6350-4279-aa32-5420abf6e365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:43.963024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177571c-6350-4279-aa32-5420abf6e365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:43.964658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d177571c-6350-4279-aa32-5420abf6e365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:44.078710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177571c-6350-4279-aa32-5420abf6e365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:44.080700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177571c-6350-4279-aa32-5420abf6e365 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:44.099722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 724/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:46.194620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0797c6-3e2e-4ffd-b6d0-93863f036e45 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:46.195170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0797c6-3e2e-4ffd-b6d0-93863f036e45 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:46.195279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0797c6-3e2e-4ffd-b6d0-93863f036e45 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:46.196584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:46.202038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bee756-3b9e-4cc1-91d5-5fd9b86e438f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:46.202432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bee756-3b9e-4cc1-91d5-5fd9b86e438f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:46.202638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bee756-3b9e-4cc1-91d5-5fd9b86e438f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:46.271192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-93bee756-3b9e-4cc1-91d5-5fd9b86e438f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:46.272416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-93bee756-3b9e-4cc1-91d5-5fd9b86e438f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:46.281039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:46.371587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:46.410940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0797c6-3e2e-4ffd-b6d0-93863f036e45 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:46.412511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2b0797c6-3e2e-4ffd-b6d0-93863f036e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:46.515547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0797c6-3e2e-4ffd-b6d0-93863f036e45 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:46.570787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:46.589351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0682f-3905-4d16-b27f-37035273ee9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:46.589966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0682f-3905-4d16-b27f-37035273ee9a service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:46.590248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0682f-3905-4d16-b27f-37035273ee9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:46.590556 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0682f-3905-4d16-b27f-37035273ee9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:46.592293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-08d0682f-3905-4d16-b27f-37035273ee9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:46.701152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0682f-3905-4d16-b27f-37035273ee9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:46.702644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0682f-3905-4d16-b27f-37035273ee9a service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:46.721637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 736/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:48.783936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719be2-d97e-4857-b7c8-e5f4cf1a4c23 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:48.784480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719be2-d97e-4857-b7c8-e5f4cf1a4c23 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:48.784480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719be2-d97e-4857-b7c8-e5f4cf1a4c23 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:48.785947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:48.791155 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5b6c7-1382-4021-91ef-8576fcd9f3aa None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:48.791568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5b6c7-1382-4021-91ef-8576fcd9f3aa None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:48.791725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5b6c7-1382-4021-91ef-8576fcd9f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:48.857565 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-46b5b6c7-1382-4021-91ef-8576fcd9f3aa None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:48.858843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-46b5b6c7-1382-4021-91ef-8576fcd9f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:48.897829 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:48.957613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:48.995038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1719be2-d97e-4857-b7c8-e5f4cf1a4c23 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:48.996585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f1719be2-d97e-4857-b7c8-e5f4cf1a4c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:49.101625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1719be2-d97e-4857-b7c8-e5f4cf1a4c23 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:49.138287 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:49.175410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfed5c4-6c3f-404f-9f0c-a9df242ff9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:49.176031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed5c4-6c3f-404f-9f0c-a9df242ff9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:49.176317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed5c4-6c3f-404f-9f0c-a9df242ff9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:49.176596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed5c4-6c3f-404f-9f0c-a9df242ff9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:49.178230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0dfed5c4-6c3f-404f-9f0c-a9df242ff9c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:49.288074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfed5c4-6c3f-404f-9f0c-a9df242ff9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:49.289533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfed5c4-6c3f-404f-9f0c-a9df242ff9c1 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:49.309720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 727/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:51.382547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b65af-552a-4281-a225-7c55a450d469 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:51.383101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b65af-552a-4281-a225-7c55a450d469 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:51.383101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b65af-552a-4281-a225-7c55a450d469 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:51.384467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:51.389670 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f3a24-6cb6-4fe9-985b-3f21751d5772 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:51.390079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f3a24-6cb6-4fe9-985b-3f21751d5772 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:51.390209 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f3a24-6cb6-4fe9-985b-3f21751d5772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:51.457426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-349f3a24-6cb6-4fe9-985b-3f21751d5772 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:51.458678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-349f3a24-6cb6-4fe9-985b-3f21751d5772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:51.477127 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:51.557587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:51.595049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b65af-552a-4281-a225-7c55a450d469 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:51.597218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-6c4b65af-552a-4281-a225-7c55a450d469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:51.700882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b65af-552a-4281-a225-7c55a450d469 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:51.767991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:51.774729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95618ed1-6572-4832-9344-a759d2234ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:51.775351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95618ed1-6572-4832-9344-a759d2234ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:51.777629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95618ed1-6572-4832-9344-a759d2234ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:51.777629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95618ed1-6572-4832-9344-a759d2234ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:51.777629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-95618ed1-6572-4832-9344-a759d2234ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:51.889956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95618ed1-6572-4832-9344-a759d2234ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:51.891437 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95618ed1-6572-4832-9344-a759d2234ad3 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:51.910373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 739/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:53.952345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4c93-c452-42cf-8689-b458c096eae4 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:53.952997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4c93-c452-42cf-8689-b458c096eae4 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:53.952997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee4c93-c452-42cf-8689-b458c096eae4 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:53.955152 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:30:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:53.960626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e23b9-1174-4a39-9118-668966f332b9 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:53.961037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e23b9-1174-4a39-9118-668966f332b9 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:53.961191 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e23b9-1174-4a39-9118-668966f332b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:54.029401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-e49e23b9-1174-4a39-9118-668966f332b9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:54.030664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e49e23b9-1174-4a39-9118-668966f332b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:54.083417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:54.131840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:54.168417 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee4c93-c452-42cf-8689-b458c096eae4 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:54.170194 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5fee4c93-c452-42cf-8689-b458c096eae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:54.273049 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee4c93-c452-42cf-8689-b458c096eae4 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:54.320601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:54.347865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aab4d-3eb1-4dc2-a091-29e905ef2c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:54.348419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aab4d-3eb1-4dc2-a091-29e905ef2c6c service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:54.348703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aab4d-3eb1-4dc2-a091-29e905ef2c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:54.349007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aab4d-3eb1-4dc2-a091-29e905ef2c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:54.351384 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6f0aab4d-3eb1-4dc2-a091-29e905ef2c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:54.458539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0aab4d-3eb1-4dc2-a091-29e905ef2c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:54.459973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0aab4d-3eb1-4dc2-a091-29e905ef2c6c service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:54.478508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 730/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:31:04.132613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=22 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:04.476271 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=66 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:14.171786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8741eb-e5c7-4630-8cd2-64c7e6708c2f None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:14.172352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8741eb-e5c7-4630-8cd2-64c7e6708c2f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:14.172560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8741eb-e5c7-4630-8cd2-64c7e6708c2f None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:14.173943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 741/1471] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:31:14.179085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa24dba-fad9-4566-a8d0-14bfcbec821e None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:14.179526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa24dba-fad9-4566-a8d0-14bfcbec821e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:14.179640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa24dba-fad9-4566-a8d0-14bfcbec821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:14.247908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-eaa24dba-fad9-4566-a8d0-14bfcbec821e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:31:14.249125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-eaa24dba-fad9-4566-a8d0-14bfcbec821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:14.346013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 731/1472] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:31:14.431244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447eb26-55eb-4da1-bc7d-f4fdd1442e22 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:14.431534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447eb26-55eb-4da1-bc7d-f4fdd1442e22 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:14.431848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447eb26-55eb-4da1-bc7d-f4fdd1442e22 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:14.433203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 742/1473] 10.222.0.60 () {54 vars in 966 bytes} [Thu Aug 4 02:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:31:14.438006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d439f21-90f6-4830-a84a-4b9a9355b13a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:14.438299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d439f21-90f6-4830-a84a-4b9a9355b13a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:14.438692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d439f21-90f6-4830-a84a-4b9a9355b13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:14.514129 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6d439f21-90f6-4830-a84a-4b9a9355b13a None None] MFA Rules not processed for user `10bd2ed69b324e85b8166135f045b840`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:31:14.515350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6d439f21-90f6-4830-a84a-4b9a9355b13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:14.537079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:14.592618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 732/1474] 10.222.0.60 () {58 vars in 1063 bytes} [Thu Aug 4 02:31:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:31:14.600987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447eb26-55eb-4da1-bc7d-f4fdd1442e22 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:31:14.602576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7447eb26-55eb-4da1-bc7d-f4fdd1442e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:14.705401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447eb26-55eb-4da1-bc7d-f4fdd1442e22 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:31:14.779045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171ab7f-1c5c-418b-9678-2e7ece0448fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bd2ed69b324e85b8166135f045b840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:31:14.779664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171ab7f-1c5c-418b-9678-2e7ece0448fb service glance] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:14.779953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171ab7f-1c5c-418b-9678-2e7ece0448fb service glance] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:14.780234 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171ab7f-1c5c-418b-9678-2e7ece0448fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:14.782710 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3171ab7f-1c5c-418b-9678-2e7ece0448fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:14.836444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:14.892837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171ab7f-1c5c-418b-9678-2e7ece0448fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:31:14.894216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171ab7f-1c5c-418b-9678-2e7ece0448fb service glance] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:31:14.913432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 743/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:31:16.994150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3341f8-faee-471e-bc32-860085b6496d None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:16.994753 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3341f8-faee-471e-bc32-860085b6496d None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:16.994753 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3341f8-faee-471e-bc32-860085b6496d None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:16.996119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 733/1476] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:31:17.001273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd69137-fa51-4784-9764-df411243c978 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:17.001700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd69137-fa51-4784-9764-df411243c978 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:17.001836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd69137-fa51-4784-9764-df411243c978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:17.070164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-bcd69137-fa51-4784-9764-df411243c978 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:31:17.071454 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-bcd69137-fa51-4784-9764-df411243c978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:17.169493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 744/1477] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:31:17.193027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3341f8-faee-471e-bc32-860085b6496d None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:31:17.194591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-db3341f8-faee-471e-bc32-860085b6496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:17.321315 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3341f8-faee-471e-bc32-860085b6496d None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:31:17.370697 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:17.416382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4218b78-c1c3-4f3d-b95f-b3d7567c0932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:31:17.417002 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218b78-c1c3-4f3d-b95f-b3d7567c0932 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:17.417285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218b78-c1c3-4f3d-b95f-b3d7567c0932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:17.417559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218b78-c1c3-4f3d-b95f-b3d7567c0932 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:17.418254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4218b78-c1c3-4f3d-b95f-b3d7567c0932 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:31:17.420316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: WARNING py.warnings [None req-d4218b78-c1c3-4f3d-b95f-b3d7567c0932 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:31:17.420316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: warnings.warn(msg) Aug 04 02:31:17.420316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: Aug 04 02:31:17.421484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4218b78-c1c3-4f3d-b95f-b3d7567c0932 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:31:17.440653 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 734/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Thu Aug 4 02:31:17 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:31:19.459718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834c58b-ad7e-488a-a31f-e0a9f3782274 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:19.460316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834c58b-ad7e-488a-a31f-e0a9f3782274 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:19.460316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834c58b-ad7e-488a-a31f-e0a9f3782274 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:19.461694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 745/1479] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:31:19.467064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7fa0d-337e-4e78-9e56-7e361b871614 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:19.467481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7fa0d-337e-4e78-9e56-7e361b871614 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:19.467632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7fa0d-337e-4e78-9e56-7e361b871614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:19.533771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-35a7fa0d-337e-4e78-9e56-7e361b871614 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:31:19.535026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-35a7fa0d-337e-4e78-9e56-7e361b871614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:19.631921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 735/1480] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:31:19.675457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834c58b-ad7e-488a-a31f-e0a9f3782274 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:31:19.677037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c834c58b-ad7e-488a-a31f-e0a9f3782274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:19.686941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:19.824594 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834c58b-ad7e-488a-a31f-e0a9f3782274 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:31:19.903713 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:19.937539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb1351-0858-489e-865f-a15b675231e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:31:19.938160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb1351-0858-489e-865f-a15b675231e5 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:19.938444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb1351-0858-489e-865f-a15b675231e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:19.938745 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb1351-0858-489e-865f-a15b675231e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:19.940401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-62eb1351-0858-489e-865f-a15b675231e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:20.030207 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb1351-0858-489e-865f-a15b675231e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:31:20.032449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb1351-0858-489e-865f-a15b675231e5 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:31:20.051336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 746/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:31:22.247002 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4be0d-3a91-4695-af41-19e131894e8e None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:22.247557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4be0d-3a91-4695-af41-19e131894e8e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:22.247668 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4be0d-3a91-4695-af41-19e131894e8e None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:22.248959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 736/1482] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:31:22.255098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863df36e-eec9-49f1-809b-e34afcb23460 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:22.255834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863df36e-eec9-49f1-809b-e34afcb23460 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:22.256010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863df36e-eec9-49f1-809b-e34afcb23460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:22.322894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-863df36e-eec9-49f1-809b-e34afcb23460 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:31:22.324113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-863df36e-eec9-49f1-809b-e34afcb23460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:22.372575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:22.423849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 747/1483] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:31:22.459797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4be0d-3a91-4695-af41-19e131894e8e None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:31:22.461332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-48b4be0d-3a91-4695-af41-19e131894e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:22.485845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:22.566435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4be0d-3a91-4695-af41-19e131894e8e None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:31:22.639036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d578706-6726-4721-86b1-0f818a57a883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:31:22.639647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d578706-6726-4721-86b1-0f818a57a883 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:22.639928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d578706-6726-4721-86b1-0f818a57a883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:22.640851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d578706-6726-4721-86b1-0f818a57a883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:22.642535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1d578706-6726-4721-86b1-0f818a57a883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:22.715500 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:22.753215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d578706-6726-4721-86b1-0f818a57a883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:31:22.754697 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d578706-6726-4721-86b1-0f818a57a883 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:31:22.772983 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 737/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:31:24.853335 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9fffe-f951-4cab-aeee-0ef646e2a993 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:24.853912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9fffe-f951-4cab-aeee-0ef646e2a993 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:24.853912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9fffe-f951-4cab-aeee-0ef646e2a993 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:24.855343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 748/1485] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:31:24.861228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2913c-e013-49b6-a50f-477ede91ce11 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:24.861660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2913c-e013-49b6-a50f-477ede91ce11 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:24.861793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2913c-e013-49b6-a50f-477ede91ce11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:24.928487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6ef2913c-e013-49b6-a50f-477ede91ce11 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:31:24.929698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6ef2913c-e013-49b6-a50f-477ede91ce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:25.026715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 738/1486] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:31:25.065793 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9fffe-f951-4cab-aeee-0ef646e2a993 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:31:25.067444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c8a9fffe-f951-4cab-aeee-0ef646e2a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:25.174815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9fffe-f951-4cab-aeee-0ef646e2a993 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:31:25.246759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:25.248718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66645e63-30c5-441b-b04a-9aa717c56771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:31:25.249372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66645e63-30c5-441b-b04a-9aa717c56771 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:25.249650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66645e63-30c5-441b-b04a-9aa717c56771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:25.250067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66645e63-30c5-441b-b04a-9aa717c56771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:25.251737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-66645e63-30c5-441b-b04a-9aa717c56771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:25.361810 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66645e63-30c5-441b-b04a-9aa717c56771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:31:25.363294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66645e63-30c5-441b-b04a-9aa717c56771 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:31:25.381636 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 749/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:31:27.558297 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c377d-17b4-4e34-be2e-3c3d24a8587a None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:27.558913 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c377d-17b4-4e34-be2e-3c3d24a8587a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:27.559023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c377d-17b4-4e34-be2e-3c3d24a8587a None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:27.560327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 739/1488] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:31:27.566224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b923f-e362-4bbf-955f-bc3e32e65ac0 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:27.566657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b923f-e362-4bbf-955f-bc3e32e65ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:27.566800 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b923f-e362-4bbf-955f-bc3e32e65ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:27.632552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-c60b923f-e362-4bbf-955f-bc3e32e65ac0 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:31:27.633760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c60b923f-e362-4bbf-955f-bc3e32e65ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:27.686618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:27.729863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 750/1489] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:31:27.770261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c377d-17b4-4e34-be2e-3c3d24a8587a None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:31:27.771888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f19c377d-17b4-4e34-be2e-3c3d24a8587a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:27.808641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:27.875265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c377d-17b4-4e34-be2e-3c3d24a8587a None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:31:27.947743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02619d-6267-4a22-8349-8426ced593fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:31:27.948355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02619d-6267-4a22-8349-8426ced593fb service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:27.948639 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02619d-6267-4a22-8349-8426ced593fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:27.948922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02619d-6267-4a22-8349-8426ced593fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:27.950566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8a02619d-6267-4a22-8349-8426ced593fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:28.031471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:28.060694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02619d-6267-4a22-8349-8426ced593fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:31:28.062079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02619d-6267-4a22-8349-8426ced593fb service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:31:28.081004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 740/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:31:30.494445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec6695-4b96-4bfa-9958-fab39422a8bc None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:30.495055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec6695-4b96-4bfa-9958-fab39422a8bc None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:30.495055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec6695-4b96-4bfa-9958-fab39422a8bc None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:30.496394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 751/1491] 10.222.0.60 () {54 vars in 927 bytes} [Thu Aug 4 02:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:31:30.502166 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210c328-ed24-4585-963e-51eb2d67c31a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:30.502657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210c328-ed24-4585-963e-51eb2d67c31a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:30.502839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210c328-ed24-4585-963e-51eb2d67c31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:30.570998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c210c328-ed24-4585-963e-51eb2d67c31a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:31:30.572218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c210c328-ed24-4585-963e-51eb2d67c31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:30.668037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 741/1492] 10.222.0.60 () {58 vars in 1024 bytes} [Thu Aug 4 02:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:31:30.707241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec6695-4b96-4bfa-9958-fab39422a8bc None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:31:30.708782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-76ec6695-4b96-4bfa-9958-fab39422a8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:30.816118 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec6695-4b96-4bfa-9958-fab39422a8bc None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:31:30.890870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de908f-0ea2-4620-9f4f-16c20f4ddd4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:31:30.891489 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de908f-0ea2-4620-9f4f-16c20f4ddd4b service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:31:30.891770 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de908f-0ea2-4620-9f4f-16c20f4ddd4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:31:30.892043 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de908f-0ea2-4620-9f4f-16c20f4ddd4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:31:30.893673 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a0de908f-0ea2-4620-9f4f-16c20f4ddd4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:31:30.902840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:31.004493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de908f-0ea2-4620-9f4f-16c20f4ddd4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:31:31.005891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de908f-0ea2-4620-9f4f-16c20f4ddd4b service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:31:31.024982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 752/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:31:40.666070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=82 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:31:41.022615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=50 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:50.047925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96020e-551a-4890-aec5-e957edbfc925 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:50.048418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96020e-551a-4890-aec5-e957edbfc925 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:50.048532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96020e-551a-4890-aec5-e957edbfc925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:50.125818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-4b96020e-551a-4890-aec5-e957edbfc925 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:32:50.127062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4b96020e-551a-4890-aec5-e957edbfc925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:50.228081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 742/1494] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:32:50.236934 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e06331-2273-4da4-b220-ded9b0127ef4 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:50.237431 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e06331-2273-4da4-b220-ded9b0127ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:50.237549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e06331-2273-4da4-b220-ded9b0127ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:50.312981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-c1e06331-2273-4da4-b220-ded9b0127ef4 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:32:50.314315 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c1e06331-2273-4da4-b220-ded9b0127ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:50.409878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 753/1495] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:32:50.414832 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96020e-551a-4890-aec5-e957edbfc925 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:50.416585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4b96020e-551a-4890-aec5-e957edbfc925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:50.428045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96020e-551a-4890-aec5-e957edbfc925 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:50.488904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:50.522598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c6292-e574-4e80-baff-5a59ffe8e935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:50.523220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c6292-e574-4e80-baff-5a59ffe8e935 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:50.523503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c6292-e574-4e80-baff-5a59ffe8e935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:50.523779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c6292-e574-4e80-baff-5a59ffe8e935 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:50.524472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c6292-e574-4e80-baff-5a59ffe8e935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:32:50.524776 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c6292-e574-4e80-baff-5a59ffe8e935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:50.526414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: WARNING py.warnings [None req-016c6292-e574-4e80-baff-5a59ffe8e935 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:50.526414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: warnings.warn(msg) Aug 04 02:32:50.526414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: Aug 04 02:32:50.527326 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c6292-e574-4e80-baff-5a59ffe8e935 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:50.538966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 743/1496] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:32:50.547432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e06331-2273-4da4-b220-ded9b0127ef4 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:50.556921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e06331-2273-4da4-b220-ded9b0127ef4 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:50.617670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:50.652868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4c17b-1efc-420b-ae78-0c42d1ce4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:50.653490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4c17b-1efc-420b-ae78-0c42d1ce4666 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:50.653774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4c17b-1efc-420b-ae78-0c42d1ce4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:50.654051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4c17b-1efc-420b-ae78-0c42d1ce4666 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:50.654745 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4c17b-1efc-420b-ae78-0c42d1ce4666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:50.656472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: WARNING py.warnings [None req-34c4c17b-1efc-420b-ae78-0c42d1ce4666 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:50.656472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: warnings.warn(msg) Aug 04 02:32:50.656472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: Aug 04 02:32:50.657667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4c17b-1efc-420b-ae78-0c42d1ce4666 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:50.762007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 754/1497] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:32:50 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:32:50.766153 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c6292-e574-4e80-baff-5a59ffe8e935 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:50.767710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-016c6292-e574-4e80-baff-5a59ffe8e935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:50.802953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c6292-e574-4e80-baff-5a59ffe8e935 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:50.898640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacf081-92b1-4ef7-a9b3-8916e5557a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:50.899260 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacf081-92b1-4ef7-a9b3-8916e5557a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:50.899546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacf081-92b1-4ef7-a9b3-8916e5557a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:50.899823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacf081-92b1-4ef7-a9b3-8916e5557a86 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:50.900519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacf081-92b1-4ef7-a9b3-8916e5557a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:50.901654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: WARNING py.warnings [None req-4bacf081-92b1-4ef7-a9b3-8916e5557a86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:50.901654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: warnings.warn(msg) Aug 04 02:32:50.901654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: Aug 04 02:32:50.902921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacf081-92b1-4ef7-a9b3-8916e5557a86 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:51.014678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 744/1498] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:32:50 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:32:51.019224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4c17b-1efc-420b-ae78-0c42d1ce4666 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:51.020791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-34c4c17b-1efc-420b-ae78-0c42d1ce4666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:51.084745 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4c17b-1efc-420b-ae78-0c42d1ce4666 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:51.168002 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:51.178237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722b578-efa8-4abb-bb3a-4f8a82212e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:51.178882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722b578-efa8-4abb-bb3a-4f8a82212e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:51.179175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722b578-efa8-4abb-bb3a-4f8a82212e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:51.179456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722b578-efa8-4abb-bb3a-4f8a82212e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:51.180154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722b578-efa8-4abb-bb3a-4f8a82212e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:51.181183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: WARNING py.warnings [None req-6722b578-efa8-4abb-bb3a-4f8a82212e18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:51.181183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: warnings.warn(msg) Aug 04 02:32:51.181183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: Aug 04 02:32:51.182630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722b578-efa8-4abb-bb3a-4f8a82212e18 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:51.195188 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 755/1499] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:32:51.199959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacf081-92b1-4ef7-a9b3-8916e5557a86 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:51.201528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4bacf081-92b1-4ef7-a9b3-8916e5557a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:51.213040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacf081-92b1-4ef7-a9b3-8916e5557a86 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:51.238706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:51.308717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af52d9-86a3-4a77-a5e7-70f47e42b622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:51.309263 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af52d9-86a3-4a77-a5e7-70f47e42b622 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:51.309550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af52d9-86a3-4a77-a5e7-70f47e42b622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:51.309829 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af52d9-86a3-4a77-a5e7-70f47e42b622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:51.310555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af52d9-86a3-4a77-a5e7-70f47e42b622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:51.311578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: WARNING py.warnings [None req-c9af52d9-86a3-4a77-a5e7-70f47e42b622 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:51.311578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: warnings.warn(msg) Aug 04 02:32:51.311578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: Aug 04 02:32:51.312468 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af52d9-86a3-4a77-a5e7-70f47e42b622 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:51.325212 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 745/1500] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:32:51.329523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722b578-efa8-4abb-bb3a-4f8a82212e18 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:51.331099 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-6722b578-efa8-4abb-bb3a-4f8a82212e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:51.364701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722b578-efa8-4abb-bb3a-4f8a82212e18 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:51.460418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da82c89-52eb-4495-9bcc-d3e831ed6dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:51.461090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da82c89-52eb-4495-9bcc-d3e831ed6dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:51.461374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da82c89-52eb-4495-9bcc-d3e831ed6dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:51.461652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da82c89-52eb-4495-9bcc-d3e831ed6dd3 admin admin] PATH_INFO: `/v3/projects/b7761aa44b074b73940046b3e7e3fd65/users/f62532f63b054b7ba9788e3e95082eaf/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:51.485001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da82c89-52eb-4495-9bcc-d3e831ed6dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7761aa44b074b73940046b3e7e3fd65, user_id=f62532f63b054b7ba9788e3e95082eaf, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:51.489537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: WARNING py.warnings [None req-3da82c89-52eb-4495-9bcc-d3e831ed6dd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:51.489537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: warnings.warn(msg) Aug 04 02:32:51.489537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: Aug 04 02:32:51.489537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da82c89-52eb-4495-9bcc-d3e831ed6dd3 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:51.596039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 756/1501] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:32:51 2022] PUT /identity/v3/projects/b7761aa44b074b73940046b3e7e3fd65/users/f62532f63b054b7ba9788e3e95082eaf/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:32:51.613636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246951ae-ca2c-433f-8763-68684333348d None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:51.613929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246951ae-ca2c-433f-8763-68684333348d None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:51.614209 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246951ae-ca2c-433f-8763-68684333348d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:51.672525 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-246951ae-ca2c-433f-8763-68684333348d None None] MFA Rules not processed for user `f62532f63b054b7ba9788e3e95082eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:32:51.673743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-246951ae-ca2c-433f-8763-68684333348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:51.751405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 746/1502] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:32:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:32:51.765177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae775a-8ba9-4969-806f-3374d1b14405 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:51.765467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae775a-8ba9-4969-806f-3374d1b14405 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:51.765759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae775a-8ba9-4969-806f-3374d1b14405 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:51.767143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 757/1503] 10.222.0.60 () {54 vars in 964 bytes} [Thu Aug 4 02:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:32:51.772043 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b703a2-430f-44b7-8a33-94120c24cfa1 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:51.772343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b703a2-430f-44b7-8a33-94120c24cfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:51.772630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b703a2-430f-44b7-8a33-94120c24cfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:51.804012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:51.849223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-32b703a2-430f-44b7-8a33-94120c24cfa1 None None] MFA Rules not processed for user `3ffc2cd3c6a84eef894edae6e9b38210`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:32:51.850368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-32b703a2-430f-44b7-8a33-94120c24cfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:51.953550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 747/1504] 10.222.0.60 () {58 vars in 1061 bytes} [Thu Aug 4 02:32:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:32:51.961449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae775a-8ba9-4969-806f-3374d1b14405 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:51.963131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9dae775a-8ba9-4969-806f-3374d1b14405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:52.013716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:52.072396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae775a-8ba9-4969-806f-3374d1b14405 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:52.147234 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058977a-1692-4f3f-b19d-6d2953b78531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:52.147790 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058977a-1692-4f3f-b19d-6d2953b78531 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:52.148073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058977a-1692-4f3f-b19d-6d2953b78531 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:52.148349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058977a-1692-4f3f-b19d-6d2953b78531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:52.149978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5058977a-1692-4f3f-b19d-6d2953b78531 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:52.248302 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058977a-1692-4f3f-b19d-6d2953b78531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:52.249753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058977a-1692-4f3f-b19d-6d2953b78531 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:52.253220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:52.267725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 758/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:32:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:32:52.314058 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65847bc2-e9c3-430f-882f-ddb5bf62d3a4 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:52.314508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65847bc2-e9c3-430f-882f-ddb5bf62d3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:52.314661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65847bc2-e9c3-430f-882f-ddb5bf62d3a4 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:52.315981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 748/1506] 10.222.0.60 () {52 vars in 830 bytes} [Thu Aug 4 02:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:32:52.319618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058977a-1692-4f3f-b19d-6d2953b78531 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:52.320872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5058977a-1692-4f3f-b19d-6d2953b78531 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:52.420333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058977a-1692-4f3f-b19d-6d2953b78531 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:52.512240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:52.512874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:52.513153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:52.513425 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] PATH_INFO: `/v3/users/f62532f63b054b7ba9788e3e95082eaf` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:52.526007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62532f63b054b7ba9788e3e95082eaf)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:52.527061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: WARNING py.warnings [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:52.527061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: warnings.warn(msg) Aug 04 02:32:52.527061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: Aug 04 02:32:52.528260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:52.538349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:52.719765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62532f63b054b7ba9788e3e95082eaf'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:52.743944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62532f63b054b7ba9788e3e95082eaf'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:52.744398 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62532f63b054b7ba9788e3e95082eaf'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:52.758448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62532f63b054b7ba9788e3e95082eaf'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:52.813774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62532f63b054b7ba9788e3e95082eaf'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:52.819597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 759/1507] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:32:52 2022] DELETE /identity/v3/users/f62532f63b054b7ba9788e3e95082eaf => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:32:52.824531 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6634b3-472d-4fc6-9c10-932b92d9f814 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:52.824818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6634b3-472d-4fc6-9c10-932b92d9f814 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:52.825099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6634b3-472d-4fc6-9c10-932b92d9f814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:52.883548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9f6634b3-472d-4fc6-9c10-932b92d9f814 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:32:52.884749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9f6634b3-472d-4fc6-9c10-932b92d9f814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:52.983815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:52.996650 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 749/1508] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:32:53.006337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:53.007611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:53.110498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1934d66-467d-4d22-a103-6472136f5100 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:53.167023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:53.187048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0a11d-ea2d-4615-9898-6e2f36555e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:53.187667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0a11d-ea2d-4615-9898-6e2f36555e87 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:53.187953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0a11d-ea2d-4615-9898-6e2f36555e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:53.188231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0a11d-ea2d-4615-9898-6e2f36555e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:53.189860 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4bb0a11d-ea2d-4615-9898-6e2f36555e87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:53.299552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0a11d-ea2d-4615-9898-6e2f36555e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:53.300925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0a11d-ea2d-4615-9898-6e2f36555e87 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:53.319920 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 760/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:32:53.782565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6634b3-472d-4fc6-9c10-932b92d9f814 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:53.784382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9f6634b3-472d-4fc6-9c10-932b92d9f814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:53.796918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6634b3-472d-4fc6-9c10-932b92d9f814 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:53.897655 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:53.898291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:53.898602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:53.898876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] PATH_INFO: `/v3/projects/b7761aa44b074b73940046b3e7e3fd65` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:53.909275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7761aa44b074b73940046b3e7e3fd65)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:53.910294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: WARNING py.warnings [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:53.910294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: warnings.warn(msg) Aug 04 02:32:53.910294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: Aug 04 02:32:53.911533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:54.029934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7761aa44b074b73940046b3e7e3fd65', 'request_id': 'req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:54.111149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7761aa44b074b73940046b3e7e3fd65', 'request_id': 'req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:54.117733 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7761aa44b074b73940046b3e7e3fd65', 'request_id': 'req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:54.147566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] The token cache is being invalidate because project b7761aa44b074b73940046b3e7e3fd65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:32:54.147854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:54.148385 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e3d1cb84-078c-4cbe-bffc-78ada94aeb5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:54.149729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 750/1510] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:32:53 2022] DELETE /identity/v3/projects/b7761aa44b074b73940046b3e7e3fd65 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:33:03.317735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=62 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:33:04.145586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:34:28.922242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b40c7c-21a9-45d2-b83d-0461c6d33d59 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:28.922845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b40c7c-21a9-45d2-b83d-0461c6d33d59 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:28.922845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b40c7c-21a9-45d2-b83d-0461c6d33d59 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:28.924311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:28.929660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aa776-dd25-4504-b563-c197c02ea256 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:28.930085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aa776-dd25-4504-b563-c197c02ea256 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:28.930283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aa776-dd25-4504-b563-c197c02ea256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:29.012434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-315aa776-dd25-4504-b563-c197c02ea256 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:29.013648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-315aa776-dd25-4504-b563-c197c02ea256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:29.119570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:34:29.273245 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b40c7c-21a9-45d2-b83d-0461c6d33d59 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:29.278748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c9b40c7c-21a9-45d2-b83d-0461c6d33d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:29.396625 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b40c7c-21a9-45d2-b83d-0461c6d33d59 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:29.402987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76569-fce3-4e95-8b8a-6d51647d3e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:29.403613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76569-fce3-4e95-8b8a-6d51647d3e89 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:29.403918 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76569-fce3-4e95-8b8a-6d51647d3e89 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:29.404220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76569-fce3-4e95-8b8a-6d51647d3e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:29.413470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c76569-fce3-4e95-8b8a-6d51647d3e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:29.415626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c76569-fce3-4e95-8b8a-6d51647d3e89 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:29.425511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 762/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:30.270518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee356d-dbb0-4fbb-808e-dd68ea874a31 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:30.271071 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee356d-dbb0-4fbb-808e-dd68ea874a31 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:30.271071 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee356d-dbb0-4fbb-808e-dd68ea874a31 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:30.272547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:30.277721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef0817-230a-4996-bf0e-30f3ddd242ab None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:30.278145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef0817-230a-4996-bf0e-30f3ddd242ab None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:30.278279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef0817-230a-4996-bf0e-30f3ddd242ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:30.302319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-9eef0817-230a-4996-bf0e-30f3ddd242ab None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:30.302319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9eef0817-230a-4996-bf0e-30f3ddd242ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:30.309882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:30.461159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee356d-dbb0-4fbb-808e-dd68ea874a31 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:30.475973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee356d-dbb0-4fbb-808e-dd68ea874a31 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:30.481444 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3a9b7-c915-41e3-b046-9d147b205ff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:30.482060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3a9b7-c915-41e3-b046-9d147b205ff6 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:30.482345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3a9b7-c915-41e3-b046-9d147b205ff6 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:30.482657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3a9b7-c915-41e3-b046-9d147b205ff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:30.491633 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3a9b7-c915-41e3-b046-9d147b205ff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:30.493353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3a9b7-c915-41e3-b046-9d147b205ff6 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:30.502619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 753/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:30.540537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74156b2e-11b7-47c6-94e5-50b611e3b5ed None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:30.540845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74156b2e-11b7-47c6-94e5-50b611e3b5ed None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:30.541109 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74156b2e-11b7-47c6-94e5-50b611e3b5ed None None] PATH_INFO: `/v3` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:30.542513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 764/1517] 10.222.0.64 () {54 vars in 925 bytes} [Thu Aug 4 02:34:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:34:30.561512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0b778-7b6f-432d-bd97-c172139d2b1c None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:30.561713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0b778-7b6f-432d-bd97-c172139d2b1c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:30.561972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0b778-7b6f-432d-bd97-c172139d2b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:30.625548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-30e0b778-7b6f-432d-bd97-c172139d2b1c None None] MFA Rules not processed for user `423ac00601f84e3d9c6cc6ee20eee6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:30.626806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-30e0b778-7b6f-432d-bd97-c172139d2b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:30.645019 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:34:30.700471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 754/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Aug 4 02:34:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:34.721513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea3da-3d25-4994-b3dd-54edb96e3da7 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:34.722075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea3da-3d25-4994-b3dd-54edb96e3da7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:34.722075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbea3da-3d25-4994-b3dd-54edb96e3da7 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:34.723346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 765/1519] 10.222.0.60 () {54 vars in 961 bytes} [Thu Aug 4 02:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:34.728385 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49c42b-401e-46a5-828c-f7eadb1535fa None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:34.728819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49c42b-401e-46a5-828c-f7eadb1535fa None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:34.728950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49c42b-401e-46a5-828c-f7eadb1535fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:34.748470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-ce49c42b-401e-46a5-828c-f7eadb1535fa None None] MFA Rules not processed for user `423ac00601f84e3d9c6cc6ee20eee6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:34.749678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ce49c42b-401e-46a5-828c-f7eadb1535fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:34.758917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 755/1520] 10.222.0.60 () {58 vars in 1058 bytes} [Thu Aug 4 02:34:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:34.766554 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbea3da-3d25-4994-b3dd-54edb96e3da7 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:34.780419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbea3da-3d25-4994-b3dd-54edb96e3da7 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:34.785547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f5a7a-bf4d-41e7-82f4-322bfc10b647 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '423ac00601f84e3d9c6cc6ee20eee6ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:34.786168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f5a7a-bf4d-41e7-82f4-322bfc10b647 service placement] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:34.786449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f5a7a-bf4d-41e7-82f4-322bfc10b647 service placement] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:34.786749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f5a7a-bf4d-41e7-82f4-322bfc10b647 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:34.794903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f5a7a-bf4d-41e7-82f4-322bfc10b647 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:34.796476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f5a7a-bf4d-41e7-82f4-322bfc10b647 service placement] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:34.805905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 766/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:41.752915 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a41a6-db34-4152-b47f-748678ba867a None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:41.753487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a41a6-db34-4152-b47f-748678ba867a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:41.753487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a41a6-db34-4152-b47f-748678ba867a None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:41.754867 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:41.759805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f25d8-0bfa-4f1d-80e5-f4f7ff9f3df9 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:41.760254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f25d8-0bfa-4f1d-80e5-f4f7ff9f3df9 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:41.760369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f25d8-0bfa-4f1d-80e5-f4f7ff9f3df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:41.779902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-427f25d8-0bfa-4f1d-80e5-f4f7ff9f3df9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:41.781104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-427f25d8-0bfa-4f1d-80e5-f4f7ff9f3df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:41.790336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:41.944498 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a41a6-db34-4152-b47f-748678ba867a None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:41.959602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a41a6-db34-4152-b47f-748678ba867a None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:41.965181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59e159-faff-491e-9ed6-0605d6d8b0b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:41.965783 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59e159-faff-491e-9ed6-0605d6d8b0b6 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:41.966067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59e159-faff-491e-9ed6-0605d6d8b0b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:41.966342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59e159-faff-491e-9ed6-0605d6d8b0b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:41.974527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59e159-faff-491e-9ed6-0605d6d8b0b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:41.976918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59e159-faff-491e-9ed6-0605d6d8b0b6 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:41.986468 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 757/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:42.812000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84b5f2-4d28-4071-bc5f-a741e001411f None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:42.812512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84b5f2-4d28-4071-bc5f-a741e001411f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:42.812512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84b5f2-4d28-4071-bc5f-a741e001411f None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:42.813882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:42.819512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8055c-3b46-4fce-bd0d-c075f5882303 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:42.819916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8055c-3b46-4fce-bd0d-c075f5882303 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:42.820071 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8055c-3b46-4fce-bd0d-c075f5882303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:42.839394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-5dd8055c-3b46-4fce-bd0d-c075f5882303 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:42.840587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5dd8055c-3b46-4fce-bd0d-c075f5882303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:42.848400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:42.999472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84b5f2-4d28-4071-bc5f-a741e001411f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:43.013747 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84b5f2-4d28-4071-bc5f-a741e001411f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:43.019226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674a6e2-ab2c-438f-9579-fdd1b2a6c15b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:43.019830 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674a6e2-ab2c-438f-9579-fdd1b2a6c15b service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:43.020113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674a6e2-ab2c-438f-9579-fdd1b2a6c15b service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:43.020389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674a6e2-ab2c-438f-9579-fdd1b2a6c15b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:43.028570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674a6e2-ab2c-438f-9579-fdd1b2a6c15b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:43.030193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674a6e2-ab2c-438f-9579-fdd1b2a6c15b service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:43.040396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 769/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:46.979812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304689c2-60b4-42ae-adeb-14f058158264 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:46.980481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304689c2-60b4-42ae-adeb-14f058158264 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:46.980481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304689c2-60b4-42ae-adeb-14f058158264 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:46.981775 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:46.987225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f696b-1313-4233-a0d5-9a3168a2be4d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:46.987636 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f696b-1313-4233-a0d5-9a3168a2be4d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:46.987793 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f696b-1313-4233-a0d5-9a3168a2be4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:47.007951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-8e4f696b-1313-4233-a0d5-9a3168a2be4d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:47.009153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8e4f696b-1313-4233-a0d5-9a3168a2be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:47.016977 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:47.091045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304689c2-60b4-42ae-adeb-14f058158264 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:47.092776 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-304689c2-60b4-42ae-adeb-14f058158264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:47.169974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304689c2-60b4-42ae-adeb-14f058158264 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:47.173584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0062daf-58c8-406a-9a2c-55679c9a6ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:47.174202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0062daf-58c8-406a-9a2c-55679c9a6ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:47.174507 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0062daf-58c8-406a-9a2c-55679c9a6ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:47.174799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0062daf-58c8-406a-9a2c-55679c9a6ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:47.184237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0062daf-58c8-406a-9a2c-55679c9a6ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:47.185677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0062daf-58c8-406a-9a2c-55679c9a6ed2 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:47.195459 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 760/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:49.207110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaac09a-c232-441b-abba-60763af5046d None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:49.207644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaac09a-c232-441b-abba-60763af5046d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:49.207644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaac09a-c232-441b-abba-60763af5046d None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:49.209150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:49.214401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7183b7-f11b-438c-81fe-c02e85ca7c4a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:49.214863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7183b7-f11b-438c-81fe-c02e85ca7c4a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:49.214975 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7183b7-f11b-438c-81fe-c02e85ca7c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:49.234605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-ee7183b7-f11b-438c-81fe-c02e85ca7c4a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:49.235791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ee7183b7-f11b-438c-81fe-c02e85ca7c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:49.244124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:49.279907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaac09a-c232-441b-abba-60763af5046d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:49.291418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaac09a-c232-441b-abba-60763af5046d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:49.294987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342456f-ee36-4454-824a-ea4202983b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:49.295535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342456f-ee36-4454-824a-ea4202983b70 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:49.295816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342456f-ee36-4454-824a-ea4202983b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:49.296090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342456f-ee36-4454-824a-ea4202983b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:49.304967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342456f-ee36-4454-824a-ea4202983b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:49.306396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342456f-ee36-4454-824a-ea4202983b70 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:49.315619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 772/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:52.913851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6ff82-c338-47f2-90a9-c720127d3262 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:52.914420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6ff82-c338-47f2-90a9-c720127d3262 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:52.914420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6ff82-c338-47f2-90a9-c720127d3262 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:52.915794 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:52.921074 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f0a7-3bf0-4e43-8b56-dc68cc2b1ff8 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:52.921479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f0a7-3bf0-4e43-8b56-dc68cc2b1ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:52.921626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f0a7-3bf0-4e43-8b56-dc68cc2b1ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:52.941074 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-84e7f0a7-3bf0-4e43-8b56-dc68cc2b1ff8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:52.942271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-84e7f0a7-3bf0-4e43-8b56-dc68cc2b1ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:52.950110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:53.254696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6ff82-c338-47f2-90a9-c720127d3262 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:53.256608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-cbc6ff82-c338-47f2-90a9-c720127d3262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:53.320260 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:34:53.333834 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6ff82-c338-47f2-90a9-c720127d3262 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:53.337498 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c60b99-0460-434c-8958-d57de15aae53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:53.338107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c60b99-0460-434c-8958-d57de15aae53 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:53.338390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c60b99-0460-434c-8958-d57de15aae53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:53.338695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c60b99-0460-434c-8958-d57de15aae53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:53.347764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c60b99-0460-434c-8958-d57de15aae53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:53.349894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c60b99-0460-434c-8958-d57de15aae53 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:53.359170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 763/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:55.381821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c0b12-b50c-409b-842b-78ec36e713e5 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:55.382409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c0b12-b50c-409b-842b-78ec36e713e5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:55.382409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c0b12-b50c-409b-842b-78ec36e713e5 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:55.383874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:55.389138 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9dcd4-fe32-4da9-bd5f-d39fed0b6993 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:55.389576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9dcd4-fe32-4da9-bd5f-d39fed0b6993 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:55.389702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9dcd4-fe32-4da9-bd5f-d39fed0b6993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:55.409286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-67e9dcd4-fe32-4da9-bd5f-d39fed0b6993 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:55.410477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-67e9dcd4-fe32-4da9-bd5f-d39fed0b6993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:55.419034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:55.719283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c0b12-b50c-409b-842b-78ec36e713e5 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:55.720964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-878c0b12-b50c-409b-842b-78ec36e713e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:55.729461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=84 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:34:55.735177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c0b12-b50c-409b-842b-78ec36e713e5 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:55.738716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c8c45-a2be-465e-ba7b-4ad095247594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:55.739330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c8c45-a2be-465e-ba7b-4ad095247594 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:55.740331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c8c45-a2be-465e-ba7b-4ad095247594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:55.740634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c8c45-a2be-465e-ba7b-4ad095247594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:55.749506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c8c45-a2be-465e-ba7b-4ad095247594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:55.751107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c8c45-a2be-465e-ba7b-4ad095247594 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:55.760403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 775/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:05.404345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=11 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:05.774510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=5 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:24.676842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b504c5-3aac-4787-93ca-73564383b760 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:24.677492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b504c5-3aac-4787-93ca-73564383b760 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:24.677492 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b504c5-3aac-4787-93ca-73564383b760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:24.706034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-66b504c5-3aac-4787-93ca-73564383b760 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:24.707321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-66b504c5-3aac-4787-93ca-73564383b760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:24.719001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 765/1540] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:24.728636 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae043e6-0589-4f58-8d64-3f01cce3cae3 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:24.729598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae043e6-0589-4f58-8d64-3f01cce3cae3 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:24.730104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae043e6-0589-4f58-8d64-3f01cce3cae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:24.760404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2ae043e6-0589-4f58-8d64-3f01cce3cae3 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:24.762053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2ae043e6-0589-4f58-8d64-3f01cce3cae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:24.779640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 776/1541] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:24.785882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b504c5-3aac-4787-93ca-73564383b760 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:24.805377 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b504c5-3aac-4787-93ca-73564383b760 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:24.816989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc019e-8920-4928-a177-acc064ef083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:24.817654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc019e-8920-4928-a177-acc064ef083c admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:24.817940 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc019e-8920-4928-a177-acc064ef083c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:24.818218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc019e-8920-4928-a177-acc064ef083c admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:24.818964 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc019e-8920-4928-a177-acc064ef083c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:24.819273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc019e-8920-4928-a177-acc064ef083c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:24.820903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc019e-8920-4928-a177-acc064ef083c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:24.840694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 766/1542] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:24.849514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae043e6-0589-4f58-8d64-3f01cce3cae3 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:24.860748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae043e6-0589-4f58-8d64-3f01cce3cae3 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:24.866543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd955673-72e3-4181-bc0a-e36f93924912 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:24.866543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd955673-72e3-4181-bc0a-e36f93924912 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:24.866543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd955673-72e3-4181-bc0a-e36f93924912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:24.875942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f994fa7-e755-4846-9d91-817faf4178e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:24.877036 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f994fa7-e755-4846-9d91-817faf4178e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:24.877575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f994fa7-e755-4846-9d91-817faf4178e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:24.878080 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f994fa7-e755-4846-9d91-817faf4178e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:24.879024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f994fa7-e755-4846-9d91-817faf4178e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:24.881516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f994fa7-e755-4846-9d91-817faf4178e2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:24.908005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-bd955673-72e3-4181-bc0a-e36f93924912 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:24.909241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-bd955673-72e3-4181-bc0a-e36f93924912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:24.933629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 767/1543] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:24.951681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefd495-c3e4-48cc-9389-815b1f3c08c5 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:24.952021 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefd495-c3e4-48cc-9389-815b1f3c08c5 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:24.952244 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefd495-c3e4-48cc-9389-815b1f3c08c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:24.987900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-afefd495-c3e4-48cc-9389-815b1f3c08c5 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:24.989114 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-afefd495-c3e4-48cc-9389-815b1f3c08c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.000834 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 768/1544] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.002219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520233e-be45-4c29-8cb3-e1b94be88399 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.002528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520233e-be45-4c29-8cb3-e1b94be88399 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.002863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520233e-be45-4c29-8cb3-e1b94be88399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.034900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9520233e-be45-4c29-8cb3-e1b94be88399 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.036504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9520233e-be45-4c29-8cb3-e1b94be88399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.055941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 769/1545] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.057470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520233e-be45-4c29-8cb3-e1b94be88399 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.082991 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520233e-be45-4c29-8cb3-e1b94be88399 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.096448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 777/1546] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:24 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:25.101063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915add0e-a605-4c99-b863-7862daa6bc63 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.103090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915add0e-a605-4c99-b863-7862daa6bc63 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.103375 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915add0e-a605-4c99-b863-7862daa6bc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.114618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e61c3-c0db-41d3-b9d5-238617987b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.115585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e61c3-c0db-41d3-b9d5-238617987b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.115872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e61c3-c0db-41d3-b9d5-238617987b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.116171 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e61c3-c0db-41d3-b9d5-238617987b47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.117533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e61c3-c0db-41d3-b9d5-238617987b47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:25.117855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e61c3-c0db-41d3-b9d5-238617987b47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.119628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e61c3-c0db-41d3-b9d5-238617987b47 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.134726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 770/1547] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:25.141855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935fffe-8e72-4fb2-86d9-5900db05d612 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.141855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935fffe-8e72-4fb2-86d9-5900db05d612 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.141855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935fffe-8e72-4fb2-86d9-5900db05d612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.145297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-915add0e-a605-4c99-b863-7862daa6bc63 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.147991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-915add0e-a605-4c99-b863-7862daa6bc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.167986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-3935fffe-8e72-4fb2-86d9-5900db05d612 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.169302 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-3935fffe-8e72-4fb2-86d9-5900db05d612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.230520 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 778/1548] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.231810 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62340b8-3e0f-4f67-89c1-3cbb51c166cc None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.232104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62340b8-3e0f-4f67-89c1-3cbb51c166cc None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.232383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62340b8-3e0f-4f67-89c1-3cbb51c166cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.251059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 771/1549] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.252511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-d62340b8-3e0f-4f67-89c1-3cbb51c166cc None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.252727 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81012707-134a-450a-ba81-c3cdb778d80f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.252984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81012707-134a-450a-ba81-c3cdb778d80f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.253271 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81012707-134a-450a-ba81-c3cdb778d80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.253734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d62340b8-3e0f-4f67-89c1-3cbb51c166cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.270062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 779/1550] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.270062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62340b8-3e0f-4f67-89c1-3cbb51c166cc None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.273062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62340b8-3e0f-4f67-89c1-3cbb51c166cc None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.273549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-81012707-134a-450a-ba81-c3cdb778d80f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.274795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-81012707-134a-450a-ba81-c3cdb778d80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.278179 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09781639-d660-45a9-9c83-28094bd62960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.278845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781639-d660-45a9-9c83-28094bd62960 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.279407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781639-d660-45a9-9c83-28094bd62960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.279687 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781639-d660-45a9-9c83-28094bd62960 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.280349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09781639-d660-45a9-9c83-28094bd62960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.281942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: WARNING py.warnings [None req-09781639-d660-45a9-9c83-28094bd62960 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:36:25.281942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: warnings.warn(msg) Aug 04 02:36:25.281942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: Aug 04 02:36:25.283189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09781639-d660-45a9-9c83-28094bd62960 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.283850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 772/1551] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.284726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81012707-134a-450a-ba81-c3cdb778d80f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.294123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81012707-134a-450a-ba81-c3cdb778d80f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.299124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cdc5d-e56d-4f22-9286-fe9900960c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.299729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cdc5d-e56d-4f22-9286-fe9900960c2a admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.300018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cdc5d-e56d-4f22-9286-fe9900960c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.300296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cdc5d-e56d-4f22-9286-fe9900960c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.300959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cdc5d-e56d-4f22-9286-fe9900960c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.301988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: WARNING py.warnings [None req-3e7cdc5d-e56d-4f22-9286-fe9900960c2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:36:25.301988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: warnings.warn(msg) Aug 04 02:36:25.301988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: Aug 04 02:36:25.303220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cdc5d-e56d-4f22-9286-fe9900960c2a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.378854 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 780/1552] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:25.380123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f3a62-4348-45c1-944c-805ca97e6410 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.380397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f3a62-4348-45c1-944c-805ca97e6410 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.380680 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f3a62-4348-45c1-944c-805ca97e6410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.396551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 773/1553] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:25.396551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe69b2a-c357-4ab6-8b58-8ecd1a2e303e None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.396551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe69b2a-c357-4ab6-8b58-8ecd1a2e303e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.396551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe69b2a-c357-4ab6-8b58-8ecd1a2e303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.409134 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-d18f3a62-4348-45c1-944c-805ca97e6410 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.410342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d18f3a62-4348-45c1-944c-805ca97e6410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.416026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-efe69b2a-c357-4ab6-8b58-8ecd1a2e303e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.417208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-efe69b2a-c357-4ab6-8b58-8ecd1a2e303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.470251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 781/1554] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.471144 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f3a62-4348-45c1-944c-805ca97e6410 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.480656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f3a62-4348-45c1-944c-805ca97e6410 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.485330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10116-f5f6-46a3-bf1f-65bbb05c06cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.485604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 774/1555] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.486217 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10116-f5f6-46a3-bf1f-65bbb05c06cc admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.486603 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10116-f5f6-46a3-bf1f-65bbb05c06cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.486887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10116-f5f6-46a3-bf1f-65bbb05c06cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.487586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f10116-f5f6-46a3-bf1f-65bbb05c06cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:25.487897 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f10116-f5f6-46a3-bf1f-65bbb05c06cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.488210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b30c-4c2f-4aee-8b0f-494230c8d613 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.488506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b30c-4c2f-4aee-8b0f-494230c8d613 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.488791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4b30c-4c2f-4aee-8b0f-494230c8d613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.488914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: WARNING py.warnings [None req-08f10116-f5f6-46a3-bf1f-65bbb05c06cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:36:25.488914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: warnings.warn(msg) Aug 04 02:36:25.488914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: Aug 04 02:36:25.489791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f10116-f5f6-46a3-bf1f-65bbb05c06cc admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.502031 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 782/1556] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:25.503224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942863fb-5f1d-470a-b4cf-b37043255424 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.503516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942863fb-5f1d-470a-b4cf-b37043255424 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.503796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942863fb-5f1d-470a-b4cf-b37043255424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.508165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-2dc4b30c-4c2f-4aee-8b0f-494230c8d613 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.509677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2dc4b30c-4c2f-4aee-8b0f-494230c8d613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.518196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 775/1557] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.519527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560672f-68e0-4dc7-a11d-f778d63d18b9 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.519819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560672f-68e0-4dc7-a11d-f778d63d18b9 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.520110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560672f-68e0-4dc7-a11d-f778d63d18b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.527316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-942863fb-5f1d-470a-b4cf-b37043255424 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.528525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-942863fb-5f1d-470a-b4cf-b37043255424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.537455 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 783/1558] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.538242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942863fb-5f1d-470a-b4cf-b37043255424 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.540012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c560672f-68e0-4dc7-a11d-f778d63d18b9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.541627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c560672f-68e0-4dc7-a11d-f778d63d18b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.547750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942863fb-5f1d-470a-b4cf-b37043255424 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.549541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 776/1559] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.550355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560672f-68e0-4dc7-a11d-f778d63d18b9 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.552837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bee08-d0bc-4079-9176-298a8bf9fe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.553462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bee08-d0bc-4079-9176-298a8bf9fe41 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.553750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bee08-d0bc-4079-9176-298a8bf9fe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.554025 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bee08-d0bc-4079-9176-298a8bf9fe41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.554747 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bee08-d0bc-4079-9176-298a8bf9fe41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.556360 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bee08-d0bc-4079-9176-298a8bf9fe41 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.560081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560672f-68e0-4dc7-a11d-f778d63d18b9 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.564837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624c895-ce45-4c1f-917d-096d4d11ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.565440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624c895-ce45-4c1f-917d-096d4d11ca3c admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.565724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624c895-ce45-4c1f-917d-096d4d11ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.566001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624c895-ce45-4c1f-917d-096d4d11ca3c admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.566650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 784/1560] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:25.566795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624c895-ce45-4c1f-917d-096d4d11ca3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.567840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9582651-0601-46c5-b3d8-4f27fc17f264 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.568131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9582651-0601-46c5-b3d8-4f27fc17f264 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.568410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9582651-0601-46c5-b3d8-4f27fc17f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.568674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624c895-ce45-4c1f-917d-096d4d11ca3c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.577025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:25.588586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-a9582651-0601-46c5-b3d8-4f27fc17f264 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.589782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a9582651-0601-46c5-b3d8-4f27fc17f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.598512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 785/1561] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.602113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78639f09-00fb-49a9-b5e4-6d0b1ca792d5 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.602113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78639f09-00fb-49a9-b5e4-6d0b1ca792d5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.602113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78639f09-00fb-49a9-b5e4-6d0b1ca792d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.607616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:25.619292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-78639f09-00fb-49a9-b5e4-6d0b1ca792d5 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.620464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-78639f09-00fb-49a9-b5e4-6d0b1ca792d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.628862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 786/1562] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.629596 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78639f09-00fb-49a9-b5e4-6d0b1ca792d5 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.638467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78639f09-00fb-49a9-b5e4-6d0b1ca792d5 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.644197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aa3ec-92ee-4437-9d7a-f83463f9b286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.653490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aa3ec-92ee-4437-9d7a-f83463f9b286 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.653490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aa3ec-92ee-4437-9d7a-f83463f9b286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.653490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aa3ec-92ee-4437-9d7a-f83463f9b286 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.653490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014aa3ec-92ee-4437-9d7a-f83463f9b286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.653490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014aa3ec-92ee-4437-9d7a-f83463f9b286 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.654213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 777/1563] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:25.654213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624c895-ce45-4c1f-917d-096d4d11ca3c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.660829 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624c895-ce45-4c1f-917d-096d4d11ca3c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.665462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f34bb7-31f3-43dc-a5b4-d7eadcb2be6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.666065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f34bb7-31f3-43dc-a5b4-d7eadcb2be6e admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.666351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f34bb7-31f3-43dc-a5b4-d7eadcb2be6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.666664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f34bb7-31f3-43dc-a5b4-d7eadcb2be6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.667371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f34bb7-31f3-43dc-a5b4-d7eadcb2be6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:25.667665 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f34bb7-31f3-43dc-a5b4-d7eadcb2be6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.669334 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f34bb7-31f3-43dc-a5b4-d7eadcb2be6e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.683096 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 778/1564] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:25.684033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f34bb7-31f3-43dc-a5b4-d7eadcb2be6e admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.694374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f34bb7-31f3-43dc-a5b4-d7eadcb2be6e admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.702891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6538b9-84fb-4bd3-9456-26eceab39598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.702891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6538b9-84fb-4bd3-9456-26eceab39598 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.702891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6538b9-84fb-4bd3-9456-26eceab39598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.702891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6538b9-84fb-4bd3-9456-26eceab39598 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.703912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6538b9-84fb-4bd3-9456-26eceab39598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:25.703912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6538b9-84fb-4bd3-9456-26eceab39598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.703912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6538b9-84fb-4bd3-9456-26eceab39598 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.714550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 779/1565] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:25.715462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6538b9-84fb-4bd3-9456-26eceab39598 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.725162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6538b9-84fb-4bd3-9456-26eceab39598 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.728322 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 787/1566] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:25.733417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aa3ec-92ee-4437-9d7a-f83463f9b286 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.734007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210f4ce-6146-42ec-850d-4b3b62909735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.734007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210f4ce-6146-42ec-850d-4b3b62909735 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.734007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210f4ce-6146-42ec-850d-4b3b62909735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.734007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210f4ce-6146-42ec-850d-4b3b62909735 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.734374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210f4ce-6146-42ec-850d-4b3b62909735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:25.734374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210f4ce-6146-42ec-850d-4b3b62909735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.734374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210f4ce-6146-42ec-850d-4b3b62909735 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.746546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 780/1567] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:25.747496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210f4ce-6146-42ec-850d-4b3b62909735 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.760299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210f4ce-6146-42ec-850d-4b3b62909735 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.799477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aa3ec-92ee-4437-9d7a-f83463f9b286 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.804077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25de23-d80a-4c57-9d5e-3271cee649fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.804694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25de23-d80a-4c57-9d5e-3271cee649fb admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.804974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25de23-d80a-4c57-9d5e-3271cee649fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.805247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25de23-d80a-4c57-9d5e-3271cee649fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.805932 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25de23-d80a-4c57-9d5e-3271cee649fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.807570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25de23-d80a-4c57-9d5e-3271cee649fb admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.815732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0461bf0-ac25-4053-bf85-c22fc53a6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.816359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0461bf0-ac25-4053-bf85-c22fc53a6462 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.816649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0461bf0-ac25-4053-bf85-c22fc53a6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.816928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0461bf0-ac25-4053-bf85-c22fc53a6462 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.817623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0461bf0-ac25-4053-bf85-c22fc53a6462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:25.817934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0461bf0-ac25-4053-bf85-c22fc53a6462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.818071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 788/1568] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:25.821418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25de23-d80a-4c57-9d5e-3271cee649fb admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.821529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0461bf0-ac25-4053-bf85-c22fc53a6462 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.831512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25de23-d80a-4c57-9d5e-3271cee649fb admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.832538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 781/1569] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:25.833477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0461bf0-ac25-4053-bf85-c22fc53a6462 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.836598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755c5c8-3d0b-43fc-af0c-07c5e8d4f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.837200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755c5c8-3d0b-43fc-af0c-07c5e8d4f5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.837477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755c5c8-3d0b-43fc-af0c-07c5e8d4f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.837998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755c5c8-3d0b-43fc-af0c-07c5e8d4f5a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.838716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755c5c8-3d0b-43fc-af0c-07c5e8d4f5a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:25.839024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755c5c8-3d0b-43fc-af0c-07c5e8d4f5a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.840876 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755c5c8-3d0b-43fc-af0c-07c5e8d4f5a3 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.849516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0461bf0-ac25-4053-bf85-c22fc53a6462 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.853875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 789/1570] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:25.854126 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d30d9-c221-49d0-8537-4b42a6a708fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.854700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755c5c8-3d0b-43fc-af0c-07c5e8d4f5a3 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.854915 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d30d9-c221-49d0-8537-4b42a6a708fd admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.855176 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d30d9-c221-49d0-8537-4b42a6a708fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.855422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d30d9-c221-49d0-8537-4b42a6a708fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.856105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d30d9-c221-49d0-8537-4b42a6a708fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.857686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d30d9-c221-49d0-8537-4b42a6a708fd admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.872245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 782/1571] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:25.872245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d30d9-c221-49d0-8537-4b42a6a708fd admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.872525 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755c5c8-3d0b-43fc-af0c-07c5e8d4f5a3 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.875949 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcf2d9-2e85-41c4-86cd-cc81050c5474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.876559 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcf2d9-2e85-41c4-86cd-cc81050c5474 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.876846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcf2d9-2e85-41c4-86cd-cc81050c5474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.877125 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcf2d9-2e85-41c4-86cd-cc81050c5474 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.877796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcf2d9-2e85-41c4-86cd-cc81050c5474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.879748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcf2d9-2e85-41c4-86cd-cc81050c5474 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.882237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d30d9-c221-49d0-8537-4b42a6a708fd admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.886849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d478eb-29c1-49d0-a21c-471aac4e8621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.887439 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d478eb-29c1-49d0-a21c-471aac4e8621 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.887726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d478eb-29c1-49d0-a21c-471aac4e8621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.888000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d478eb-29c1-49d0-a21c-471aac4e8621 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.888649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d478eb-29c1-49d0-a21c-471aac4e8621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.890543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d478eb-29c1-49d0-a21c-471aac4e8621 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.974630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 790/1572] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:25.981226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcf2d9-2e85-41c4-86cd-cc81050c5474 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.007996 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 783/1573] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:26.009040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d478eb-29c1-49d0-a21c-471aac4e8621 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.044341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcf2d9-2e85-41c4-86cd-cc81050c5474 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.076954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d478eb-29c1-49d0-a21c-471aac4e8621 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.082382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71988f-d10d-435e-b1db-3d695b15db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.083039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71988f-d10d-435e-b1db-3d695b15db42 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.083327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71988f-d10d-435e-b1db-3d695b15db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.083666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:26.083891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71988f-d10d-435e-b1db-3d695b15db42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.084606 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71988f-d10d-435e-b1db-3d695b15db42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.086567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71988f-d10d-435e-b1db-3d695b15db42 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.100813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d70aa6-f62e-466c-b900-a4bc328f8c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.101442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d70aa6-f62e-466c-b900-a4bc328f8c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.101730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d70aa6-f62e-466c-b900-a4bc328f8c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.102008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d70aa6-f62e-466c-b900-a4bc328f8c78 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.102713 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d70aa6-f62e-466c-b900-a4bc328f8c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.103235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:26.104649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d70aa6-f62e-466c-b900-a4bc328f8c78 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.185489 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 784/1574] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:26 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:26.186360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71988f-d10d-435e-b1db-3d695b15db42 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.213691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 791/1575] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:26.214505 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d70aa6-f62e-466c-b900-a4bc328f8c78 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.226318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d70aa6-f62e-466c-b900-a4bc328f8c78 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.249391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71988f-d10d-435e-b1db-3d695b15db42 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.254506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ae9ef-7796-4e68-b724-5181de78081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.255203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ae9ef-7796-4e68-b724-5181de78081d admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.255490 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ae9ef-7796-4e68-b724-5181de78081d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.255771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ae9ef-7796-4e68-b724-5181de78081d admin admin] PATH_INFO: `/v3/projects/665b55428ee3418e81787962fdef4d1a/users/cd0e74d35ca74099b04e28e5826f29c3/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.270686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ae9ef-7796-4e68-b724-5181de78081d admin admin] RBAC: Authorizing `identity:create_grant(project_id=665b55428ee3418e81787962fdef4d1a, user_id=cd0e74d35ca74099b04e28e5826f29c3, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.273835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: WARNING py.warnings [None req-e99ae9ef-7796-4e68-b724-5181de78081d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:36:26.273835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: warnings.warn(msg) Aug 04 02:36:26.273835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: Aug 04 02:36:26.273835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ae9ef-7796-4e68-b724-5181de78081d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.284645 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163217f7-9783-4f49-8f20-8d0557ab609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.285351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163217f7-9783-4f49-8f20-8d0557ab609f admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.285637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163217f7-9783-4f49-8f20-8d0557ab609f admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.285912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163217f7-9783-4f49-8f20-8d0557ab609f admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.286601 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163217f7-9783-4f49-8f20-8d0557ab609f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.288498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163217f7-9783-4f49-8f20-8d0557ab609f admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.360029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 785/1576] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:26 2022] PUT /identity/v3/projects/665b55428ee3418e81787962fdef4d1a/users/cd0e74d35ca74099b04e28e5826f29c3/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:26.360938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ae9ef-7796-4e68-b724-5181de78081d admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.361343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 792/1577] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:26 2022] POST /identity/v3/projects => generated 393 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:26.362189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163217f7-9783-4f49-8f20-8d0557ab609f admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.428119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ae9ef-7796-4e68-b724-5181de78081d admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.432806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75a8fa-e61b-4c99-b968-93b51c2ebac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.433428 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75a8fa-e61b-4c99-b968-93b51c2ebac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.433714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75a8fa-e61b-4c99-b968-93b51c2ebac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.433990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75a8fa-e61b-4c99-b968-93b51c2ebac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.434682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75a8fa-e61b-4c99-b968-93b51c2ebac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.434799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163217f7-9783-4f49-8f20-8d0557ab609f admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.436613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75a8fa-e61b-4c99-b968-93b51c2ebac9 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.439912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bfcaf-aa13-4565-995c-87f1a04beb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.440529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bfcaf-aa13-4565-995c-87f1a04beb29 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.440816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bfcaf-aa13-4565-995c-87f1a04beb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.441097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bfcaf-aa13-4565-995c-87f1a04beb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.441792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bfcaf-aa13-4565-995c-87f1a04beb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.443433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bfcaf-aa13-4565-995c-87f1a04beb29 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.453840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 793/1578] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:26.457223 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bfcaf-aa13-4565-995c-87f1a04beb29 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.466176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bfcaf-aa13-4565-995c-87f1a04beb29 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.471501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd12abd-9607-427a-97cf-fe437d4cef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.472157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd12abd-9607-427a-97cf-fe437d4cef57 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.472442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd12abd-9607-427a-97cf-fe437d4cef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.472762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd12abd-9607-427a-97cf-fe437d4cef57 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.473439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd12abd-9607-427a-97cf-fe437d4cef57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.475435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd12abd-9607-427a-97cf-fe437d4cef57 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.521930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 786/1579] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:26 2022] POST /identity/v3/projects => generated 405 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:26.525229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75a8fa-e61b-4c99-b968-93b51c2ebac9 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.584480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75a8fa-e61b-4c99-b968-93b51c2ebac9 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.589268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619a993-d97e-44fd-8943-24cf07d6858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.589885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a993-d97e-44fd-8943-24cf07d6858a admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.590194 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a993-d97e-44fd-8943-24cf07d6858a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.590452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a993-d97e-44fd-8943-24cf07d6858a admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.591147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619a993-d97e-44fd-8943-24cf07d6858a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.593130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619a993-d97e-44fd-8943-24cf07d6858a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.603310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:26.612261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 794/1580] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:26 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:26.613001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd12abd-9607-427a-97cf-fe437d4cef57 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.622739 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd12abd-9607-427a-97cf-fe437d4cef57 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.628011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c2bf9-932f-4859-96a6-f3ab9e974cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.628604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c2bf9-932f-4859-96a6-f3ab9e974cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.628891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c2bf9-932f-4859-96a6-f3ab9e974cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.629171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c2bf9-932f-4859-96a6-f3ab9e974cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.629834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c2bf9-932f-4859-96a6-f3ab9e974cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.631815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c2bf9-932f-4859-96a6-f3ab9e974cf8 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.693596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 787/1581] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:26 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:26.694479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619a993-d97e-44fd-8943-24cf07d6858a admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.704644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619a993-d97e-44fd-8943-24cf07d6858a admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.709299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef831a-417f-4cd8-a1d2-49e01b70367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.709889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef831a-417f-4cd8-a1d2-49e01b70367f admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.710175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef831a-417f-4cd8-a1d2-49e01b70367f admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.710452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef831a-417f-4cd8-a1d2-49e01b70367f admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.711167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef831a-417f-4cd8-a1d2-49e01b70367f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.712815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef831a-417f-4cd8-a1d2-49e01b70367f admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.723490 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 788/1582] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:26.724280 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef831a-417f-4cd8-a1d2-49e01b70367f admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.733526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef831a-417f-4cd8-a1d2-49e01b70367f admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.738952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3347dd-becc-4cdd-b806-d27e56628c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.739532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3347dd-becc-4cdd-b806-d27e56628c5c admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.739809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3347dd-becc-4cdd-b806-d27e56628c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.740090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3347dd-becc-4cdd-b806-d27e56628c5c admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.740732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3347dd-becc-4cdd-b806-d27e56628c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.742688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3347dd-becc-4cdd-b806-d27e56628c5c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.749394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 795/1583] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:26 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:26.751957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401b32-6e61-4e8e-bd40-259e892d3c69 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.751957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401b32-6e61-4e8e-bd40-259e892d3c69 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.751957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401b32-6e61-4e8e-bd40-259e892d3c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.779335 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2e401b32-6e61-4e8e-bd40-259e892d3c69 None None] MFA Rules not processed for user `cd0e74d35ca74099b04e28e5826f29c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:26.780576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2e401b32-6e61-4e8e-bd40-259e892d3c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:26.785767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:26.828728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 789/1584] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:26 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:26.832180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3347dd-becc-4cdd-b806-d27e56628c5c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.840992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3347dd-becc-4cdd-b806-d27e56628c5c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.845502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 796/1585] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:26.845666 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7b98a-56bd-45f1-a8e5-345ecf44a35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.846310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7b98a-56bd-45f1-a8e5-345ecf44a35f admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.846427 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e401b32-6e61-4e8e-bd40-259e892d3c69 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.846636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7b98a-56bd-45f1-a8e5-345ecf44a35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.846921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7b98a-56bd-45f1-a8e5-345ecf44a35f admin admin] PATH_INFO: `/v3/projects/448b55f570f54489acf6ddc99a3b0bc8/users/630198109cbc4939a9c55361df0b85ee/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.857661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e401b32-6e61-4e8e-bd40-259e892d3c69 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.863160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c631364-70ed-4d22-9447-46e5e12ceef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.863307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7b98a-56bd-45f1-a8e5-345ecf44a35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=448b55f570f54489acf6ddc99a3b0bc8, user_id=630198109cbc4939a9c55361df0b85ee, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.863728 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631364-70ed-4d22-9447-46e5e12ceef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.864016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631364-70ed-4d22-9447-46e5e12ceef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.864951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631364-70ed-4d22-9447-46e5e12ceef9 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.865041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c631364-70ed-4d22-9447-46e5e12ceef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.866170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7b98a-56bd-45f1-a8e5-345ecf44a35f admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.867268 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c631364-70ed-4d22-9447-46e5e12ceef9 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.939312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 790/1586] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:26 2022] PUT /identity/v3/projects/448b55f570f54489acf6ddc99a3b0bc8/users/630198109cbc4939a9c55361df0b85ee/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:26.940433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7b98a-56bd-45f1-a8e5-345ecf44a35f admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.967469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 797/1587] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:26 2022] POST /identity/v3/users => generated 303 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:26.968350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c631364-70ed-4d22-9447-46e5e12ceef9 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.979918 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c631364-70ed-4d22-9447-46e5e12ceef9 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.005022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7b98a-56bd-45f1-a8e5-345ecf44a35f admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.009994 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddeeaa-06f9-4411-afa1-b382395721d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.010672 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddeeaa-06f9-4411-afa1-b382395721d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.010999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddeeaa-06f9-4411-afa1-b382395721d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.011278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddeeaa-06f9-4411-afa1-b382395721d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.011973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddeeaa-06f9-4411-afa1-b382395721d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.013580 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddeeaa-06f9-4411-afa1-b382395721d0 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.023723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 791/1588] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:27.024544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddeeaa-06f9-4411-afa1-b382395721d0 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.034700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddeeaa-06f9-4411-afa1-b382395721d0 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.044466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a723f73-c8cd-4fab-a0c1-b4f1bb00d441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.045087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a723f73-c8cd-4fab-a0c1-b4f1bb00d441 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.045434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a723f73-c8cd-4fab-a0c1-b4f1bb00d441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.045726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a723f73-c8cd-4fab-a0c1-b4f1bb00d441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.046428 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a723f73-c8cd-4fab-a0c1-b4f1bb00d441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.047602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d10de-1213-4ba9-b053-d565ee2f41c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.048277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d10de-1213-4ba9-b053-d565ee2f41c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.048613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d10de-1213-4ba9-b053-d565ee2f41c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.048887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d10de-1213-4ba9-b053-d565ee2f41c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.049000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a723f73-c8cd-4fab-a0c1-b4f1bb00d441 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.049584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d10de-1213-4ba9-b053-d565ee2f41c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.051241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d10de-1213-4ba9-b053-d565ee2f41c5 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.060916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 792/1589] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:27.065215 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 798/1590] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:27.065215 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d10de-1213-4ba9-b053-d565ee2f41c5 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.065671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a723f73-c8cd-4fab-a0c1-b4f1bb00d441 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.074748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d10de-1213-4ba9-b053-d565ee2f41c5 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.075354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a723f73-c8cd-4fab-a0c1-b4f1bb00d441 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.079847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b94a38-dd3a-4c81-b95a-7bd6fa359b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.080152 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b013f1-c19d-45ec-80ef-a525e3f4cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.080453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b94a38-dd3a-4c81-b95a-7bd6fa359b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.080734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b94a38-dd3a-4c81-b95a-7bd6fa359b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.080926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b013f1-c19d-45ec-80ef-a525e3f4cff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.081020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b94a38-dd3a-4c81-b95a-7bd6fa359b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.081098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b013f1-c19d-45ec-80ef-a525e3f4cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.081393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b013f1-c19d-45ec-80ef-a525e3f4cff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.081682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b94a38-dd3a-4c81-b95a-7bd6fa359b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.082093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b013f1-c19d-45ec-80ef-a525e3f4cff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.083311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b94a38-dd3a-4c81-b95a-7bd6fa359b80 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.083726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b013f1-c19d-45ec-80ef-a525e3f4cff6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.094411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 799/1591] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:27.097628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 793/1592] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:27.097759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7b0b8-af8d-4486-ac32-029c8fe55ab6 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.097759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7b0b8-af8d-4486-ac32-029c8fe55ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.097938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e5ef-718f-4b11-a5f5-be77e2f63b4f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.098025 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7b0b8-af8d-4486-ac32-029c8fe55ab6 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.098113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e5ef-718f-4b11-a5f5-be77e2f63b4f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.098113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e5ef-718f-4b11-a5f5-be77e2f63b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.098264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 800/1593] 10.222.0.60 () {54 vars in 962 bytes} [Thu Aug 4 02:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:27.098950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7b0b8-af8d-4486-ac32-029c8fe55ab6 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.112051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7b0b8-af8d-4486-ac32-029c8fe55ab6 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.116563 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b6b1e-206b-4255-88dc-00a1648a3c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.117098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b6b1e-206b-4255-88dc-00a1648a3c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.117379 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b6b1e-206b-4255-88dc-00a1648a3c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.117660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b6b1e-206b-4255-88dc-00a1648a3c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.118346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b6b1e-206b-4255-88dc-00a1648a3c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.119976 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b6b1e-206b-4255-88dc-00a1648a3c4a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.126021 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8897e5ef-718f-4b11-a5f5-be77e2f63b4f None None] MFA Rules not processed for user `630198109cbc4939a9c55361df0b85ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:27.127287 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8897e5ef-718f-4b11-a5f5-be77e2f63b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:27.129977 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 801/1594] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:27.130882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b6b1e-206b-4255-88dc-00a1648a3c4a admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.140428 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b6b1e-206b-4255-88dc-00a1648a3c4a admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.145153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1e90b-cf74-498f-adb6-560ba0091027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.145737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1e90b-cf74-498f-adb6-560ba0091027 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.146018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1e90b-cf74-498f-adb6-560ba0091027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.146295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1e90b-cf74-498f-adb6-560ba0091027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.147006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1e90b-cf74-498f-adb6-560ba0091027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.148617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1e90b-cf74-498f-adb6-560ba0091027 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.159786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 802/1595] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:27.160620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1e90b-cf74-498f-adb6-560ba0091027 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.170257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1e90b-cf74-498f-adb6-560ba0091027 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.175805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9b240-70ab-4e8c-b230-1ce9c3b420fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.176462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9b240-70ab-4e8c-b230-1ce9c3b420fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.176724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9b240-70ab-4e8c-b230-1ce9c3b420fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.177006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9b240-70ab-4e8c-b230-1ce9c3b420fd admin admin] PATH_INFO: `/v3/projects/a2c4c2e98c444c07b2919db3e65cedf2/users/99068d55e19e4b3cbf9197ca46d86fd3/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.191585 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9b240-70ab-4e8c-b230-1ce9c3b420fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c4c2e98c444c07b2919db3e65cedf2, user_id=99068d55e19e4b3cbf9197ca46d86fd3, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.194216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9b240-70ab-4e8c-b230-1ce9c3b420fd admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.197601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 794/1596] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:27.198448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897e5ef-718f-4b11-a5f5-be77e2f63b4f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.204931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:27.209605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897e5ef-718f-4b11-a5f5-be77e2f63b4f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.215335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619800d-eb17-443b-b761-3b21be58c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.215335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619800d-eb17-443b-b761-3b21be58c5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.215534 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619800d-eb17-443b-b761-3b21be58c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.215803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619800d-eb17-443b-b761-3b21be58c5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.216501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619800d-eb17-443b-b761-3b21be58c5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.218346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619800d-eb17-443b-b761-3b21be58c5a2 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.230598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 795/1597] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:27.230598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619800d-eb17-443b-b761-3b21be58c5a2 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.241934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619800d-eb17-443b-b761-3b21be58c5a2 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.246804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb16e8-58c5-4b5c-83e6-8ed7a629a01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.247399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb16e8-58c5-4b5c-83e6-8ed7a629a01a admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.247686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb16e8-58c5-4b5c-83e6-8ed7a629a01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.247967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb16e8-58c5-4b5c-83e6-8ed7a629a01a admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.248651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb16e8-58c5-4b5c-83e6-8ed7a629a01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.250546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb16e8-58c5-4b5c-83e6-8ed7a629a01a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.260803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 796/1598] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:27.261607 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb16e8-58c5-4b5c-83e6-8ed7a629a01a admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.271187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 803/1599] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:27 2022] PUT /identity/v3/projects/a2c4c2e98c444c07b2919db3e65cedf2/users/99068d55e19e4b3cbf9197ca46d86fd3/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:27.272524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb16e8-58c5-4b5c-83e6-8ed7a629a01a admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.272920 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b041f-f7d0-481e-9256-0dc66b029ba7 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.273299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b041f-f7d0-481e-9256-0dc66b029ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.273646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b041f-f7d0-481e-9256-0dc66b029ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.319443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-a57b041f-f7d0-481e-9256-0dc66b029ba7 None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:27.320702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a57b041f-f7d0-481e-9256-0dc66b029ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:27.330952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:27.333298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a075f-d4fe-46df-b016-93ca6ec907e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.333932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a075f-d4fe-46df-b016-93ca6ec907e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.334224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a075f-d4fe-46df-b016-93ca6ec907e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.334545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a075f-d4fe-46df-b016-93ca6ec907e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.335245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a075f-d4fe-46df-b016-93ca6ec907e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.336879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a075f-d4fe-46df-b016-93ca6ec907e1 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.355719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 797/1600] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:27.356539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a075f-d4fe-46df-b016-93ca6ec907e1 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.366363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a075f-d4fe-46df-b016-93ca6ec907e1 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.371335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0440bc-43e1-44ba-b16a-602cdb9a2766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.371877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0440bc-43e1-44ba-b16a-602cdb9a2766 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.372158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0440bc-43e1-44ba-b16a-602cdb9a2766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.372479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0440bc-43e1-44ba-b16a-602cdb9a2766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.373276 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0440bc-43e1-44ba-b16a-602cdb9a2766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.375471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0440bc-43e1-44ba-b16a-602cdb9a2766 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.386356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 798/1601] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:27.387258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0440bc-43e1-44ba-b16a-602cdb9a2766 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.390740 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 804/1602] 10.222.0.60 () {58 vars in 1059 bytes} [Thu Aug 4 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:27.392791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c970d6-b287-46e7-af67-b1f9fab737ac None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.393288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c970d6-b287-46e7-af67-b1f9fab737ac None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.393570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c970d6-b287-46e7-af67-b1f9fab737ac None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.395110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 805/1603] 10.222.0.60 () {54 vars in 962 bytes} [Thu Aug 4 02:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:27.395756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c970d6-b287-46e7-af67-b1f9fab737ac None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.398196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0440bc-43e1-44ba-b16a-602cdb9a2766 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.403069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bddf5-b609-4487-ab7b-c19415194d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.403729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bddf5-b609-4487-ab7b-c19415194d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.404576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bddf5-b609-4487-ab7b-c19415194d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.404576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bddf5-b609-4487-ab7b-c19415194d08 admin admin] PATH_INFO: `/v3/projects/9550ba5c205d465ea1f45a9deb8bd7d1/users/2c08c0c0d6514ff7a09e61560ac6f495/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.410282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c970d6-b287-46e7-af67-b1f9fab737ac None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.415868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19034a-29b6-4dfc-9b3b-08cc74653ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.416530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19034a-29b6-4dfc-9b3b-08cc74653ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.416813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19034a-29b6-4dfc-9b3b-08cc74653ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.417088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19034a-29b6-4dfc-9b3b-08cc74653ed8 admin admin] PATH_INFO: `/v3/projects/a9b0b8e8bfa74696bea98b9aa0f19951/users/d8bc44049ca2427883806568abab2681/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.420168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bddf5-b609-4487-ab7b-c19415194d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9550ba5c205d465ea1f45a9deb8bd7d1, user_id=2c08c0c0d6514ff7a09e61560ac6f495, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.423814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bddf5-b609-4487-ab7b-c19415194d08 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.432214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19034a-29b6-4dfc-9b3b-08cc74653ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b0b8e8bfa74696bea98b9aa0f19951, user_id=d8bc44049ca2427883806568abab2681, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.434965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19034a-29b6-4dfc-9b3b-08cc74653ed8 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.497122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 799/1604] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:27 2022] PUT /identity/v3/projects/9550ba5c205d465ea1f45a9deb8bd7d1/users/2c08c0c0d6514ff7a09e61560ac6f495/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:27.498033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bddf5-b609-4487-ab7b-c19415194d08 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.520659 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 806/1605] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:27 2022] PUT /identity/v3/projects/a9b0b8e8bfa74696bea98b9aa0f19951/users/d8bc44049ca2427883806568abab2681/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:27.523104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba24a-6c4d-45cc-82f5-99fba8bcce13 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.523104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba24a-6c4d-45cc-82f5-99fba8bcce13 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.523104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ba24a-6c4d-45cc-82f5-99fba8bcce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.541088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-e49ba24a-6c4d-45cc-82f5-99fba8bcce13 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:27.542329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e49ba24a-6c4d-45cc-82f5-99fba8bcce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:27.560554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bddf5-b609-4487-ab7b-c19415194d08 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.600843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 807/1606] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:27.604132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba24a-6c4d-45cc-82f5-99fba8bcce13 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.613346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ba24a-6c4d-45cc-82f5-99fba8bcce13 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.614079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:27.618630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2690266-967e-4a00-99bc-09cb431a6bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.622670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2690266-967e-4a00-99bc-09cb431a6bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.622670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2690266-967e-4a00-99bc-09cb431a6bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.622670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2690266-967e-4a00-99bc-09cb431a6bce admin admin] PATH_INFO: `/v3/projects/651f296b94d342488b3cd98998a08e02/users/2e47969dca184aec92e620fcd53d6a5c/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.624310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401eb2-6079-4460-b3e6-5d7ce972b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.625634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401eb2-6079-4460-b3e6-5d7ce972b27c admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.626110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401eb2-6079-4460-b3e6-5d7ce972b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.626371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401eb2-6079-4460-b3e6-5d7ce972b27c admin admin] PATH_INFO: `/v3/projects/16c45c4b6ccc40e3bdf304d9141d56ca/users/64be537a50754c838554d1a2e0a4177a/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.634964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2690266-967e-4a00-99bc-09cb431a6bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=651f296b94d342488b3cd98998a08e02, user_id=2e47969dca184aec92e620fcd53d6a5c, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.637686 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2690266-967e-4a00-99bc-09cb431a6bce admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.640863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78401eb2-6079-4460-b3e6-5d7ce972b27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c45c4b6ccc40e3bdf304d9141d56ca, user_id=64be537a50754c838554d1a2e0a4177a, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.643523 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78401eb2-6079-4460-b3e6-5d7ce972b27c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.721266 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 808/1607] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:27 2022] PUT /identity/v3/projects/651f296b94d342488b3cd98998a08e02/users/2e47969dca184aec92e620fcd53d6a5c/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:27.721834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2690266-967e-4a00-99bc-09cb431a6bce admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.751193 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 800/1608] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:27 2022] PUT /identity/v3/projects/16c45c4b6ccc40e3bdf304d9141d56ca/users/64be537a50754c838554d1a2e0a4177a/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:27.752032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401eb2-6079-4460-b3e6-5d7ce972b27c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.785465 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2690266-967e-4a00-99bc-09cb431a6bce admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.791743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:27.831059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401eb2-6079-4460-b3e6-5d7ce972b27c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.836701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d3dcb-822e-4920-b620-021aae7e874b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.837326 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d3dcb-822e-4920-b620-021aae7e874b service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.837613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d3dcb-822e-4920-b620-021aae7e874b service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.837895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d3dcb-822e-4920-b620-021aae7e874b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.853381 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fe5f6-0c09-4f11-aa4b-1a97898e7c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.854054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe5f6-0c09-4f11-aa4b-1a97898e7c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.854339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe5f6-0c09-4f11-aa4b-1a97898e7c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.854686 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe5f6-0c09-4f11-aa4b-1a97898e7c14 admin admin] PATH_INFO: `/v3/projects/e99d6872769b4e21a53750edd6a5d803/users/e1a59e25a7434ad7bf394340fa810c58/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.869854 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fe5f6-0c09-4f11-aa4b-1a97898e7c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99d6872769b4e21a53750edd6a5d803, user_id=e1a59e25a7434ad7bf394340fa810c58, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.872628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fe5f6-0c09-4f11-aa4b-1a97898e7c14 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.894698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d3dcb-822e-4920-b620-021aae7e874b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.896235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d3dcb-822e-4920-b620-021aae7e874b service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.905376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 801/1609] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:27.907477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0324be8-2c61-4d4a-8090-f6c506ea3867 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.907765 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0324be8-2c61-4d4a-8090-f6c506ea3867 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.908045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0324be8-2c61-4d4a-8090-f6c506ea3867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.928529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e0324be8-2c61-4d4a-8090-f6c506ea3867 None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:27.929723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e0324be8-2c61-4d4a-8090-f6c506ea3867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:27.934184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 809/1610] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:27 2022] PUT /identity/v3/projects/e99d6872769b4e21a53750edd6a5d803/users/e1a59e25a7434ad7bf394340fa810c58/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:27.936605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b520b3-625b-476b-8bd2-0ac03ba2fa56 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.937041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b520b3-625b-476b-8bd2-0ac03ba2fa56 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.938039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b520b3-625b-476b-8bd2-0ac03ba2fa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.971320 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-84b520b3-625b-476b-8bd2-0ac03ba2fa56 None None] MFA Rules not processed for user `2c08c0c0d6514ff7a09e61560ac6f495`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:27.972675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-84b520b3-625b-476b-8bd2-0ac03ba2fa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.007972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 802/1611] 10.222.0.60 () {58 vars in 1059 bytes} [Thu Aug 4 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:28.009542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4f8ea-e879-4ff5-a741-b17fdcc75515 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.009974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4f8ea-e879-4ff5-a741-b17fdcc75515 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.010480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4f8ea-e879-4ff5-a741-b17fdcc75515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.019061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:28.032311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e7f4f8ea-e879-4ff5-a741-b17fdcc75515 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:28.035153 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e7f4f8ea-e879-4ff5-a741-b17fdcc75515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.053416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 810/1612] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:28.054341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b520b3-625b-476b-8bd2-0ac03ba2fa56 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.112211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 803/1613] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:28.114993 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b520b3-625b-476b-8bd2-0ac03ba2fa56 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.116444 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1c5dc-75b7-4e60-9436-89b18ed7fe2e None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.116823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1c5dc-75b7-4e60-9436-89b18ed7fe2e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.117388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1c5dc-75b7-4e60-9436-89b18ed7fe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.119210 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aeeedb-26c7-4699-829e-c35ade4565dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.119938 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aeeedb-26c7-4699-829e-c35ade4565dd service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.120328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aeeedb-26c7-4699-829e-c35ade4565dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.120721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aeeedb-26c7-4699-829e-c35ade4565dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.131387 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aeeedb-26c7-4699-829e-c35ade4565dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.132981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aeeedb-26c7-4699-829e-c35ade4565dd service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.138613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-a7a1c5dc-75b7-4e60-9436-89b18ed7fe2e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:28.139867 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a7a1c5dc-75b7-4e60-9436-89b18ed7fe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.144330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 811/1614] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:28.145538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d7c0-86e4-491c-8afd-202e0aae4cd9 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.145901 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d7c0-86e4-491c-8afd-202e0aae4cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.146253 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d7c0-86e4-491c-8afd-202e0aae4cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.150231 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 804/1615] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:28.151481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9e92-6d04-4194-b7c8-9bf96b174719 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.151773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9e92-6d04-4194-b7c8-9bf96b174719 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.152054 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9e92-6d04-4194-b7c8-9bf96b174719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.172591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8efe9e92-6d04-4194-b7c8-9bf96b174719 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:28.174000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8efe9e92-6d04-4194-b7c8-9bf96b174719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.174271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-d4f8d7c0-86e4-491c-8afd-202e0aae4cd9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:28.175517 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d4f8d7c0-86e4-491c-8afd-202e0aae4cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.181986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 805/1616] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:28.182831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9e92-6d04-4194-b7c8-9bf96b174719 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.186805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 812/1617] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:28.186805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d7c0-86e4-491c-8afd-202e0aae4cd9 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.199580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d7c0-86e4-491c-8afd-202e0aae4cd9 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.201980 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9e92-6d04-4194-b7c8-9bf96b174719 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.205409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a730a-6b9f-4be5-8552-962ef3c620d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.206018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a730a-6b9f-4be5-8552-962ef3c620d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.206301 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a730a-6b9f-4be5-8552-962ef3c620d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.206624 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a730a-6b9f-4be5-8552-962ef3c620d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.207321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a730a-6b9f-4be5-8552-962ef3c620d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.208620 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f6746-0bae-42ab-8cc8-3a469f8cfd35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.209200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a730a-6b9f-4be5-8552-962ef3c620d5 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.209857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f6746-0bae-42ab-8cc8-3a469f8cfd35 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.210141 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f6746-0bae-42ab-8cc8-3a469f8cfd35 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.210414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f6746-0bae-42ab-8cc8-3a469f8cfd35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.224328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:28.270760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f6746-0bae-42ab-8cc8-3a469f8cfd35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.273096 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f6746-0bae-42ab-8cc8-3a469f8cfd35 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.286314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 806/1618] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:28.287636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f6746-0bae-42ab-8cc8-3a469f8cfd35 service nova] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.303585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f6746-0bae-42ab-8cc8-3a469f8cfd35 service nova] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.311303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2470a75-f15d-4ace-815b-8ada99f02566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.313383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2470a75-f15d-4ace-815b-8ada99f02566 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.314182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2470a75-f15d-4ace-815b-8ada99f02566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.314943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2470a75-f15d-4ace-815b-8ada99f02566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.317451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 813/1619] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:28 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:28.319312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a730a-6b9f-4be5-8552-962ef3c620d5 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.331263 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2470a75-f15d-4ace-815b-8ada99f02566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.333229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2470a75-f15d-4ace-815b-8ada99f02566 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.345335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 807/1620] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:28.346815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405a648-5a53-4b26-b088-cff0af86419c None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.347115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405a648-5a53-4b26-b088-cff0af86419c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.347524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405a648-5a53-4b26-b088-cff0af86419c None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.349655 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 808/1621] 10.222.0.60 () {54 vars in 912 bytes} [Thu Aug 4 02:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:28.350446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405a648-5a53-4b26-b088-cff0af86419c None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.352394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1405a648-5a53-4b26-b088-cff0af86419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.394321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a730a-6b9f-4be5-8552-962ef3c620d5 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.399348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5d76-36f5-4da0-bb63-70a2f5dcf056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.400410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5d76-36f5-4da0-bb63-70a2f5dcf056 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.400657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5d76-36f5-4da0-bb63-70a2f5dcf056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.401014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5d76-36f5-4da0-bb63-70a2f5dcf056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.440887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405a648-5a53-4b26-b088-cff0af86419c None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.447734 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d105ea3-0b5d-4c3a-88f1-33fca8362dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.448809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d105ea3-0b5d-4c3a-88f1-33fca8362dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.449151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d105ea3-0b5d-4c3a-88f1-33fca8362dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.449443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d105ea3-0b5d-4c3a-88f1-33fca8362dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.496316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5d76-36f5-4da0-bb63-70a2f5dcf056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.497241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:28.498654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5d76-36f5-4da0-bb63-70a2f5dcf056 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.518857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 814/1622] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:28.520093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5d76-36f5-4da0-bb63-70a2f5dcf056 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.538290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5d76-36f5-4da0-bb63-70a2f5dcf056 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.544683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e425a3-8e5d-474f-84dd-bdff31b43717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.544683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e425a3-8e5d-474f-84dd-bdff31b43717 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.544683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e425a3-8e5d-474f-84dd-bdff31b43717 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.544683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e425a3-8e5d-474f-84dd-bdff31b43717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.546371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d105ea3-0b5d-4c3a-88f1-33fca8362dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.549905 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d105ea3-0b5d-4c3a-88f1-33fca8362dc3 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.561881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 809/1623] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:28.563814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d105ea3-0b5d-4c3a-88f1-33fca8362dc3 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.576640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d105ea3-0b5d-4c3a-88f1-33fca8362dc3 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.583443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dc0eb-ffd7-4c54-a4ef-385f82bc495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.584274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dc0eb-ffd7-4c54-a4ef-385f82bc495b admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.584664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dc0eb-ffd7-4c54-a4ef-385f82bc495b admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.585507 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dc0eb-ffd7-4c54-a4ef-385f82bc495b admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.587210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dc0eb-ffd7-4c54-a4ef-385f82bc495b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.589427 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e425a3-8e5d-474f-84dd-bdff31b43717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.590289 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dc0eb-ffd7-4c54-a4ef-385f82bc495b admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.591315 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e425a3-8e5d-474f-84dd-bdff31b43717 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.604307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 815/1624] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:28.611518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dc389-91c1-4e82-b427-f2d79094313e None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.611813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dc389-91c1-4e82-b427-f2d79094313e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.612095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dc389-91c1-4e82-b427-f2d79094313e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.633636 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-754dc389-91c1-4e82-b427-f2d79094313e None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:28.634894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-754dc389-91c1-4e82-b427-f2d79094313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.713282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 816/1625] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:28.722951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec042f-82bc-44dc-a598-420c7500e094 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.723313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec042f-82bc-44dc-a598-420c7500e094 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.723695 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec042f-82bc-44dc-a598-420c7500e094 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.725850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 817/1626] 10.222.0.60 () {54 vars in 912 bytes} [Thu Aug 4 02:36:28 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:28.731640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630a493-62d1-499c-863b-572dd281c6e6 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.735267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630a493-62d1-499c-863b-572dd281c6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.735267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630a493-62d1-499c-863b-572dd281c6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.741840 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 810/1627] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:28 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:28.743036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dc0eb-ffd7-4c54-a4ef-385f82bc495b admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.761351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-a630a493-62d1-499c-863b-572dd281c6e6 None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:28.766791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a630a493-62d1-499c-863b-572dd281c6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.774512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 818/1628] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:28.775378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630a493-62d1-499c-863b-572dd281c6e6 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.789434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630a493-62d1-499c-863b-572dd281c6e6 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.798378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67a296-c69f-43a0-8e04-4a45b07bd8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.798378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a296-c69f-43a0-8e04-4a45b07bd8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.798378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a296-c69f-43a0-8e04-4a45b07bd8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.798378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a296-c69f-43a0-8e04-4a45b07bd8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.798775 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67a296-c69f-43a0-8e04-4a45b07bd8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.800761 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67a296-c69f-43a0-8e04-4a45b07bd8ed admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.814762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 819/1629] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:28.815758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67a296-c69f-43a0-8e04-4a45b07bd8ed admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.821822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dc0eb-ffd7-4c54-a4ef-385f82bc495b admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.822848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:28.827348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a130d66-0696-4c26-a786-04e4eaf02da4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.827534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67a296-c69f-43a0-8e04-4a45b07bd8ed admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.828802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a130d66-0696-4c26-a786-04e4eaf02da4 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.829021 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a130d66-0696-4c26-a786-04e4eaf02da4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.829359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a130d66-0696-4c26-a786-04e4eaf02da4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.832452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb619b-87c9-4a08-9c3c-c2ce75241628 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.833364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb619b-87c9-4a08-9c3c-c2ce75241628 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.833782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb619b-87c9-4a08-9c3c-c2ce75241628 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.834164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb619b-87c9-4a08-9c3c-c2ce75241628 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.845326 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a130d66-0696-4c26-a786-04e4eaf02da4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.847303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a130d66-0696-4c26-a786-04e4eaf02da4 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.847860 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb619b-87c9-4a08-9c3c-c2ce75241628 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.849605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb619b-87c9-4a08-9c3c-c2ce75241628 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.859931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 811/1630] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:28.862382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a130d66-0696-4c26-a786-04e4eaf02da4 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.868519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 820/1631] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:28.876819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a130d66-0696-4c26-a786-04e4eaf02da4 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.884067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197d7e9-d22f-4914-b1cd-3093a705bd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.890108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197d7e9-d22f-4914-b1cd-3093a705bd51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.890108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197d7e9-d22f-4914-b1cd-3093a705bd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.890108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197d7e9-d22f-4914-b1cd-3093a705bd51 admin admin] PATH_INFO: `/v3/projects/85aa6709249d4f5a8c8887d47fcb534f/users/741e19333d8f40cc850966aa70cde8cb/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.912241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197d7e9-d22f-4914-b1cd-3093a705bd51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85aa6709249d4f5a8c8887d47fcb534f, user_id=741e19333d8f40cc850966aa70cde8cb, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.917070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197d7e9-d22f-4914-b1cd-3093a705bd51 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.037838 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 812/1632] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:28 2022] PUT /identity/v3/projects/85aa6709249d4f5a8c8887d47fcb534f/users/741e19333d8f40cc850966aa70cde8cb/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:29.056262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb619b-87c9-4a08-9c3c-c2ce75241628 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.063906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb619b-87c9-4a08-9c3c-c2ce75241628 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.128987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197d7e9-d22f-4914-b1cd-3093a705bd51 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.169140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a376aa-ad67-4679-bca8-1f6c0b2aec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.170756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a376aa-ad67-4679-bca8-1f6c0b2aec88 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.171141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a376aa-ad67-4679-bca8-1f6c0b2aec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.172460 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a376aa-ad67-4679-bca8-1f6c0b2aec88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.173664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a376aa-ad67-4679-bca8-1f6c0b2aec88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.176124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a376aa-ad67-4679-bca8-1f6c0b2aec88 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.195778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 821/1633] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:29.196688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a376aa-ad67-4679-bca8-1f6c0b2aec88 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.208163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a376aa-ad67-4679-bca8-1f6c0b2aec88 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.213979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e03d25-f620-4697-a2f4-af231e6dd33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.216404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03d25-f620-4697-a2f4-af231e6dd33e admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.216404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03d25-f620-4697-a2f4-af231e6dd33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.216404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03d25-f620-4697-a2f4-af231e6dd33e admin admin] PATH_INFO: `/v3/projects/85aa6709249d4f5a8c8887d47fcb534f/users/741e19333d8f40cc850966aa70cde8cb/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.217033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e03d25-f620-4697-a2f4-af231e6dd33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85aa6709249d4f5a8c8887d47fcb534f, user_id=741e19333d8f40cc850966aa70cde8cb, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.220716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e03d25-f620-4697-a2f4-af231e6dd33e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.246078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 822/1634] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:29 2022] PUT /identity/v3/projects/85aa6709249d4f5a8c8887d47fcb534f/users/741e19333d8f40cc850966aa70cde8cb/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:29.247831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca72765-87b8-4750-8f22-42b58fcf164f None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.248212 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca72765-87b8-4750-8f22-42b58fcf164f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.248495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca72765-87b8-4750-8f22-42b58fcf164f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.264229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197d7e9-d22f-4914-b1cd-3093a705bd51 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.289241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-1ca72765-87b8-4750-8f22-42b58fcf164f None None] MFA Rules not processed for user `741e19333d8f40cc850966aa70cde8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:29.290592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1ca72765-87b8-4750-8f22-42b58fcf164f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:29.314323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:29.364863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e0e2a-9a19-4b6d-937b-19eba8254972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.367630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0e2a-9a19-4b6d-937b-19eba8254972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.368290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0e2a-9a19-4b6d-937b-19eba8254972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.369768 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0e2a-9a19-4b6d-937b-19eba8254972 admin admin] PATH_INFO: `/v3/users/630198109cbc4939a9c55361df0b85ee` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.373248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e0e2a-9a19-4b6d-937b-19eba8254972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630198109cbc4939a9c55361df0b85ee)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.377309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: WARNING py.warnings [None req-557e0e2a-9a19-4b6d-937b-19eba8254972 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:36:29.377309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: warnings.warn(msg) Aug 04 02:36:29.377309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: Aug 04 02:36:29.377672 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 823/1635] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:29.379545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e0e2a-9a19-4b6d-937b-19eba8254972 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.392349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca72765-87b8-4750-8f22-42b58fcf164f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.456994 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca72765-87b8-4750-8f22-42b58fcf164f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.461047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34f153-fb25-4a18-a480-2b177517ba19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.461698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34f153-fb25-4a18-a480-2b177517ba19 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.461985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34f153-fb25-4a18-a480-2b177517ba19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.462266 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34f153-fb25-4a18-a480-2b177517ba19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.473869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34f153-fb25-4a18-a480-2b177517ba19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.475441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34f153-fb25-4a18-a480-2b177517ba19 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.501006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 824/1636] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:29.627092 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-557e0e2a-9a19-4b6d-937b-19eba8254972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630198109cbc4939a9c55361df0b85ee'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.698611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34f153-fb25-4a18-a480-2b177517ba19 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.698611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:29.704660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34f153-fb25-4a18-a480-2b177517ba19 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.710077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c77d09-28e9-449c-a88f-ce8e316d2142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.710838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c77d09-28e9-449c-a88f-ce8e316d2142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.711122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c77d09-28e9-449c-a88f-ce8e316d2142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.711394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c77d09-28e9-449c-a88f-ce8e316d2142 admin admin] PATH_INFO: `/v3/users/2c08c0c0d6514ff7a09e61560ac6f495` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.712902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c77d09-28e9-449c-a88f-ce8e316d2142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c08c0c0d6514ff7a09e61560ac6f495)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.715487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c77d09-28e9-449c-a88f-ce8e316d2142 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.744933 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-557e0e2a-9a19-4b6d-937b-19eba8254972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630198109cbc4939a9c55361df0b85ee'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.772213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-557e0e2a-9a19-4b6d-937b-19eba8254972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630198109cbc4939a9c55361df0b85ee'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.774701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-557e0e2a-9a19-4b6d-937b-19eba8254972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630198109cbc4939a9c55361df0b85ee'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.775352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-557e0e2a-9a19-4b6d-937b-19eba8254972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630198109cbc4939a9c55361df0b85ee'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.818319 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 813/1637] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:29 2022] DELETE /identity/v3/users/630198109cbc4939a9c55361df0b85ee => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:29.824035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9892890-eac2-4c23-9474-d34b9f4efd36 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.824689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9892890-eac2-4c23-9474-d34b9f4efd36 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.824689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9892890-eac2-4c23-9474-d34b9f4efd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.871055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-d9892890-eac2-4c23-9474-d34b9f4efd36 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:29.872992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d9892890-eac2-4c23-9474-d34b9f4efd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:29.928080 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-c0c77d09-28e9-449c-a88f-ce8e316d2142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c08c0c0d6514ff7a09e61560ac6f495'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.955491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-c0c77d09-28e9-449c-a88f-ce8e316d2142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c08c0c0d6514ff7a09e61560ac6f495'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.956169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-c0c77d09-28e9-449c-a88f-ce8e316d2142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c08c0c0d6514ff7a09e61560ac6f495'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.981195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-c0c77d09-28e9-449c-a88f-ce8e316d2142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c08c0c0d6514ff7a09e61560ac6f495'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.999028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 814/1638] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:30.009188 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9892890-eac2-4c23-9474-d34b9f4efd36 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:30.011238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d9892890-eac2-4c23-9474-d34b9f4efd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:30.096402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-c0c77d09-28e9-449c-a88f-ce8e316d2142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c08c0c0d6514ff7a09e61560ac6f495'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:30.109608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 825/1639] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:29 2022] DELETE /identity/v3/users/2c08c0c0d6514ff7a09e61560ac6f495 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:30.118741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc713d4e-62f6-4eff-9c71-902bf3aafe7f None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:30.119049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc713d4e-62f6-4eff-9c71-902bf3aafe7f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:30.119346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc713d4e-62f6-4eff-9c71-902bf3aafe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:30.120722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9892890-eac2-4c23-9474-d34b9f4efd36 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:30.138401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:30.173853 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-dc713d4e-62f6-4eff-9c71-902bf3aafe7f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:30.175680 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-dc713d4e-62f6-4eff-9c71-902bf3aafe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:30.253777 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1659fc-e22c-4601-bd0b-02a9b7a84ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:30.254292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1659fc-e22c-4601-bd0b-02a9b7a84ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:30.254609 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1659fc-e22c-4601-bd0b-02a9b7a84ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:30.255149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1659fc-e22c-4601-bd0b-02a9b7a84ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:30.305659 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 826/1640] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:30.312014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc713d4e-62f6-4eff-9c71-902bf3aafe7f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:30.353951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc713d4e-62f6-4eff-9c71-902bf3aafe7f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:30.365779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa049ac-40de-4758-a236-86a4155a2fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:30.366928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa049ac-40de-4758-a236-86a4155a2fae service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:30.367586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa049ac-40de-4758-a236-86a4155a2fae service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:30.370126 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa049ac-40de-4758-a236-86a4155a2fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:30.395290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa049ac-40de-4758-a236-86a4155a2fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:30.400065 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa049ac-40de-4758-a236-86a4155a2fae service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:30.409833 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1659fc-e22c-4601-bd0b-02a9b7a84ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:30.414949 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1659fc-e22c-4601-bd0b-02a9b7a84ec0 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:30.431889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 827/1641] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:30.436900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 815/1642] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:31.446236 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9057c-6d52-4d20-8906-bba181c06bf7 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.446236 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9057c-6d52-4d20-8906-bba181c06bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.446236 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9057c-6d52-4d20-8906-bba181c06bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.446236 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f7f9057c-6d52-4d20-8906-bba181c06bf7 None None] MFA Rules not processed for user `e1a59e25a7434ad7bf394340fa810c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:31.446236 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f7f9057c-6d52-4d20-8906-bba181c06bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.450210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1659fc-e22c-4601-bd0b-02a9b7a84ec0 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.450210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-bf1659fc-e22c-4601-bd0b-02a9b7a84ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.457045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:31.457402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1659fc-e22c-4601-bd0b-02a9b7a84ec0 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.457402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.457402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.457402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.458225 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] PATH_INFO: `/v3/projects/9550ba5c205d465ea1f45a9deb8bd7d1` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.458225 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9550ba5c205d465ea1f45a9deb8bd7d1)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.460123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.506612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 828/1643] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:31.538466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9057c-6d52-4d20-8906-bba181c06bf7 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.553366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f7f9057c-6d52-4d20-8906-bba181c06bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.607333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9057c-6d52-4d20-8906-bba181c06bf7 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.620955 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9550ba5c205d465ea1f45a9deb8bd7d1', 'request_id': 'req-43329826-be5e-4ac9-8b21-69789312687c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.690226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6928a-f6d7-4291-996e-54fc098a7dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.691313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6928a-f6d7-4291-996e-54fc098a7dff admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.691698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6928a-f6d7-4291-996e-54fc098a7dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.692082 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6928a-f6d7-4291-996e-54fc098a7dff admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.693509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6928a-f6d7-4291-996e-54fc098a7dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.694968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6928a-f6d7-4291-996e-54fc098a7dff admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.738692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9550ba5c205d465ea1f45a9deb8bd7d1', 'request_id': 'req-43329826-be5e-4ac9-8b21-69789312687c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.746703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9550ba5c205d465ea1f45a9deb8bd7d1', 'request_id': 'req-43329826-be5e-4ac9-8b21-69789312687c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.780360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] The token cache is being invalidate because project 9550ba5c205d465ea1f45a9deb8bd7d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:31.780672 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.786334 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.790566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 816/1644] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:31 2022] DELETE /identity/v3/projects/9550ba5c205d465ea1f45a9deb8bd7d1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:31.793272 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.796455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.818010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43329826-be5e-4ac9-8b21-69789312687c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.825943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.827341 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.828395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.829182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] PATH_INFO: `/v3/projects/448b55f570f54489acf6ddc99a3b0bc8` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.831469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] RBAC: Authorizing `identity:delete_project(project_id=448b55f570f54489acf6ddc99a3b0bc8)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.834421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.846534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 829/1645] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:31 2022] POST /identity/v3/projects => generated 401 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:31.846534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6928a-f6d7-4291-996e-54fc098a7dff admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.851998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f9d6928a-f6d7-4291-996e-54fc098a7dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.977824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6928a-f6d7-4291-996e-54fc098a7dff admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.988830 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e1753-4ff7-4798-86cb-7291b607f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.990296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e1753-4ff7-4798-86cb-7291b607f9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.990621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e1753-4ff7-4798-86cb-7291b607f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.991345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e1753-4ff7-4798-86cb-7291b607f9b2 admin admin] PATH_INFO: `/v3/users/741e19333d8f40cc850966aa70cde8cb` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.993638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e1753-4ff7-4798-86cb-7291b607f9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=741e19333d8f40cc850966aa70cde8cb)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.007227 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e1753-4ff7-4798-86cb-7291b607f9b2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.034992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:32.065281 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448b55f570f54489acf6ddc99a3b0bc8', 'request_id': 'req-1f8524bc-16e1-4b53-9965-1232683d131c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:32.174682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448b55f570f54489acf6ddc99a3b0bc8', 'request_id': 'req-1f8524bc-16e1-4b53-9965-1232683d131c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:32.198975 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448b55f570f54489acf6ddc99a3b0bc8', 'request_id': 'req-1f8524bc-16e1-4b53-9965-1232683d131c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:32.246027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] The token cache is being invalidate because project 448b55f570f54489acf6ddc99a3b0bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:32.246224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d44e1753-4ff7-4798-86cb-7291b607f9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '741e19333d8f40cc850966aa70cde8cb'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:32.251395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:32.255906 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:32.270993 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 817/1646] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:31 2022] DELETE /identity/v3/projects/448b55f570f54489acf6ddc99a3b0bc8 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:32.270993 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.272222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:32.278359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d44e1753-4ff7-4798-86cb-7291b607f9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '741e19333d8f40cc850966aa70cde8cb'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:32.282282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d44e1753-4ff7-4798-86cb-7291b607f9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '741e19333d8f40cc850966aa70cde8cb'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:32.290567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d44e1753-4ff7-4798-86cb-7291b607f9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '741e19333d8f40cc850966aa70cde8cb'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:32.411271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d44e1753-4ff7-4798-86cb-7291b607f9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '741e19333d8f40cc850966aa70cde8cb'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:32.414119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8524bc-16e1-4b53-9965-1232683d131c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.423292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 830/1647] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:31 2022] DELETE /identity/v3/users/741e19333d8f40cc850966aa70cde8cb => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:32.425965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682673e-6211-42c0-b767-6899ad3ea87a None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.426669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682673e-6211-42c0-b767-6899ad3ea87a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.427343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682673e-6211-42c0-b767-6899ad3ea87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.430382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded2a9-406e-4151-a99e-4de345352f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.431064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded2a9-406e-4151-a99e-4de345352f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.431347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded2a9-406e-4151-a99e-4de345352f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.431618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded2a9-406e-4151-a99e-4de345352f9c admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.435063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ded2a9-406e-4151-a99e-4de345352f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.438187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ded2a9-406e-4151-a99e-4de345352f9c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.476520 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-7682673e-6211-42c0-b767-6899ad3ea87a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:32.480467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7682673e-6211-42c0-b767-6899ad3ea87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:32.551288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 818/1648] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/users => generated 307 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:32.553872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded2a9-406e-4151-a99e-4de345352f9c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.558330 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-29ded2a9-406e-4151-a99e-4de345352f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:32.604611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ded2a9-406e-4151-a99e-4de345352f9c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.652904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 831/1649] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:32.661325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a935c8-b483-43d3-94a9-2a0ff05f5d0e None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.661325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a935c8-b483-43d3-94a9-2a0ff05f5d0e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.661561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a935c8-b483-43d3-94a9-2a0ff05f5d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.690031 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b2a935c8-b483-43d3-94a9-2a0ff05f5d0e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:32.691616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b2a935c8-b483-43d3-94a9-2a0ff05f5d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:32.707122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 832/1650] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:32.708292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a935c8-b483-43d3-94a9-2a0ff05f5d0e None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.727697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a935c8-b483-43d3-94a9-2a0ff05f5d0e None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.738738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4e694-96f2-4f36-9526-e35a99f6cc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.740116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4e694-96f2-4f36-9526-e35a99f6cc62 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.741238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56366210-8937-451b-a9a5-11538833a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.742220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4e694-96f2-4f36-9526-e35a99f6cc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.742220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4e694-96f2-4f36-9526-e35a99f6cc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.742895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56366210-8937-451b-a9a5-11538833a8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.743167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4e694-96f2-4f36-9526-e35a99f6cc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.744736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56366210-8937-451b-a9a5-11538833a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.745420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56366210-8937-451b-a9a5-11538833a8ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.747546 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56366210-8937-451b-a9a5-11538833a8ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:32.748996 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56366210-8937-451b-a9a5-11538833a8ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.751084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4e694-96f2-4f36-9526-e35a99f6cc62 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.753528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56366210-8937-451b-a9a5-11538833a8ed admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.783994 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 819/1651] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:32.785370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4e694-96f2-4f36-9526-e35a99f6cc62 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.789883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 833/1652] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:32.797033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56366210-8937-451b-a9a5-11538833a8ed admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.811062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4e694-96f2-4f36-9526-e35a99f6cc62 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.815407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56366210-8937-451b-a9a5-11538833a8ed admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.817932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0d821-b131-4eab-8b0a-676f1418927e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.818250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0d821-b131-4eab-8b0a-676f1418927e admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.818564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0d821-b131-4eab-8b0a-676f1418927e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.819280 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0d821-b131-4eab-8b0a-676f1418927e admin admin] PATH_INFO: `/v3/projects/b09a85563b044182be8ac0a4e6f8f93a/users/ec17e3dfa63047109f321c2c207c4dc5/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.825867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175625a-47b1-46de-a63c-08a3a10f40ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.826896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175625a-47b1-46de-a63c-08a3a10f40ff admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.827383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175625a-47b1-46de-a63c-08a3a10f40ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.828498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175625a-47b1-46de-a63c-08a3a10f40ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.829526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175625a-47b1-46de-a63c-08a3a10f40ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.832927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175625a-47b1-46de-a63c-08a3a10f40ff admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.839622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0d821-b131-4eab-8b0a-676f1418927e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09a85563b044182be8ac0a4e6f8f93a, user_id=ec17e3dfa63047109f321c2c207c4dc5, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.842578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0d821-b131-4eab-8b0a-676f1418927e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.983825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 834/1653] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/projects => generated 403 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:32.987252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175625a-47b1-46de-a63c-08a3a10f40ff admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.008125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 820/1654] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:32 2022] PUT /identity/v3/projects/b09a85563b044182be8ac0a4e6f8f93a/users/ec17e3dfa63047109f321c2c207c4dc5/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:33.023727 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0d821-b131-4eab-8b0a-676f1418927e admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.117075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175625a-47b1-46de-a63c-08a3a10f40ff admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.189967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0d821-b131-4eab-8b0a-676f1418927e admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.211396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9ecd1-051d-432a-996f-ffa94da16b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.212035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9ecd1-051d-432a-996f-ffa94da16b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.212332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9ecd1-051d-432a-996f-ffa94da16b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.212605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9ecd1-051d-432a-996f-ffa94da16b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.213322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9ecd1-051d-432a-996f-ffa94da16b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.215010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9ecd1-051d-432a-996f-ffa94da16b5c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.258970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 821/1655] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:33.260007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9ecd1-051d-432a-996f-ffa94da16b5c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.287762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9ecd1-051d-432a-996f-ffa94da16b5c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.299104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c903c-9ee5-4397-bea7-4694cf0c581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.302478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c903c-9ee5-4397-bea7-4694cf0c581a admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.302478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c903c-9ee5-4397-bea7-4694cf0c581a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.302478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c903c-9ee5-4397-bea7-4694cf0c581a admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.302478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c903c-9ee5-4397-bea7-4694cf0c581a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.303181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c903c-9ee5-4397-bea7-4694cf0c581a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.311209 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca53cc4-24a6-4898-a63d-25d368c5257c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.311906 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca53cc4-24a6-4898-a63d-25d368c5257c admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.312856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca53cc4-24a6-4898-a63d-25d368c5257c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.313140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca53cc4-24a6-4898-a63d-25d368c5257c admin admin] PATH_INFO: `/v3/projects/b09a85563b044182be8ac0a4e6f8f93a/users/ec17e3dfa63047109f321c2c207c4dc5/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.319449 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca53cc4-24a6-4898-a63d-25d368c5257c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09a85563b044182be8ac0a4e6f8f93a, user_id=ec17e3dfa63047109f321c2c207c4dc5, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.322094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca53cc4-24a6-4898-a63d-25d368c5257c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.349182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 822/1656] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:33 2022] PUT /identity/v3/projects/b09a85563b044182be8ac0a4e6f8f93a/users/ec17e3dfa63047109f321c2c207c4dc5/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:33.418539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 835/1657] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/users => generated 302 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:36:33.424083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca53cc4-24a6-4898-a63d-25d368c5257c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.643066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca53cc4-24a6-4898-a63d-25d368c5257c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.659903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d010acf-ee7c-41c9-b916-28fdbbd070fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.660548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010acf-ee7c-41c9-b916-28fdbbd070fb admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.660835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010acf-ee7c-41c9-b916-28fdbbd070fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.661758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d010acf-ee7c-41c9-b916-28fdbbd070fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.662586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d010acf-ee7c-41c9-b916-28fdbbd070fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.664297 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d010acf-ee7c-41c9-b916-28fdbbd070fb admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.742313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 823/1658] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:33.745973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c903c-9ee5-4397-bea7-4694cf0c581a admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.774167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d010acf-ee7c-41c9-b916-28fdbbd070fb admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.777551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c903c-9ee5-4397-bea7-4694cf0c581a admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.780769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8d010acf-ee7c-41c9-b916-28fdbbd070fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:33.807039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e5c17-4b37-4e56-99d3-d163aad23da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.808146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e5c17-4b37-4e56-99d3-d163aad23da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.809635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e5c17-4b37-4e56-99d3-d163aad23da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.809871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d010acf-ee7c-41c9-b916-28fdbbd070fb admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.810351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e5c17-4b37-4e56-99d3-d163aad23da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.811325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e5c17-4b37-4e56-99d3-d163aad23da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.814099 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e5c17-4b37-4e56-99d3-d163aad23da4 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.826391 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 836/1659] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:33.827596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3bc8b-246d-4c58-b354-a5bc967684f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.828495 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3bc8b-246d-4c58-b354-a5bc967684f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.828787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3bc8b-246d-4c58-b354-a5bc967684f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.829075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3bc8b-246d-4c58-b354-a5bc967684f5 admin admin] PATH_INFO: `/v3/projects/85aa6709249d4f5a8c8887d47fcb534f` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.831130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e5c17-4b37-4e56-99d3-d163aad23da4 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.837186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3bc8b-246d-4c58-b354-a5bc967684f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85aa6709249d4f5a8c8887d47fcb534f)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.842402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3bc8b-246d-4c58-b354-a5bc967684f5 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.844991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e5c17-4b37-4e56-99d3-d163aad23da4 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.852103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02024a55-35a8-4361-b8c1-0d5c8a028eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.859845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02024a55-35a8-4361-b8c1-0d5c8a028eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.859845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02024a55-35a8-4361-b8c1-0d5c8a028eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.859845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02024a55-35a8-4361-b8c1-0d5c8a028eb8 admin admin] PATH_INFO: `/v3/projects/f3b8748756a642ea9272a1268792866c/users/721bd849457644d688cf4b0a38a6bca3/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.899963 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02024a55-35a8-4361-b8c1-0d5c8a028eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b8748756a642ea9272a1268792866c, user_id=721bd849457644d688cf4b0a38a6bca3, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.904496 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02024a55-35a8-4361-b8c1-0d5c8a028eb8 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:34.005813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 837/1660] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:33 2022] PUT /identity/v3/projects/f3b8748756a642ea9272a1268792866c/users/721bd849457644d688cf4b0a38a6bca3/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:34.016338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5f02d-5326-47a2-92a7-cc879396a556 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:34.016808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5f02d-5326-47a2-92a7-cc879396a556 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:34.017053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5f02d-5326-47a2-92a7-cc879396a556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:34.048368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-dae3bc8b-246d-4c58-b354-a5bc967684f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85aa6709249d4f5a8c8887d47fcb534f', 'request_id': 'req-dae3bc8b-246d-4c58-b354-a5bc967684f5'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:34.077211 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-bba5f02d-5326-47a2-92a7-cc879396a556 None None] MFA Rules not processed for user `721bd849457644d688cf4b0a38a6bca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:34.078531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-bba5f02d-5326-47a2-92a7-cc879396a556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:34.173044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-dae3bc8b-246d-4c58-b354-a5bc967684f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85aa6709249d4f5a8c8887d47fcb534f', 'request_id': 'req-dae3bc8b-246d-4c58-b354-a5bc967684f5'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:34.175418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:34.181977 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-dae3bc8b-246d-4c58-b354-a5bc967684f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85aa6709249d4f5a8c8887d47fcb534f', 'request_id': 'req-dae3bc8b-246d-4c58-b354-a5bc967684f5'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:34.207359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-dae3bc8b-246d-4c58-b354-a5bc967684f5 admin admin] The token cache is being invalidate because project 85aa6709249d4f5a8c8887d47fcb534f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:34.207766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-dae3bc8b-246d-4c58-b354-a5bc967684f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:34.211050 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-dae3bc8b-246d-4c58-b354-a5bc967684f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:34.218746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 824/1661] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:33 2022] DELETE /identity/v3/projects/85aa6709249d4f5a8c8887d47fcb534f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:34.222764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139449d-825c-4819-a985-2a4117e31c9f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:34.223104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139449d-825c-4819-a985-2a4117e31c9f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:34.223329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139449d-825c-4819-a985-2a4117e31c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:34.237583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 838/1662] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:34.244962 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5f02d-5326-47a2-92a7-cc879396a556 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:34.269947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c139449d-825c-4819-a985-2a4117e31c9f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:34.271247 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c139449d-825c-4819-a985-2a4117e31c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:34.426971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5f02d-5326-47a2-92a7-cc879396a556 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:34.440182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 825/1663] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:34.440953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175e4b6-1253-4857-9139-f50fca443aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:34.441644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175e4b6-1253-4857-9139-f50fca443aef admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:34.441935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175e4b6-1253-4857-9139-f50fca443aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:34.442218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175e4b6-1253-4857-9139-f50fca443aef admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:34.442959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175e4b6-1253-4857-9139-f50fca443aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:34.444926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175e4b6-1253-4857-9139-f50fca443aef admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:34.449099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcef9f-3e20-40de-8527-4449a15b334a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:34.449711 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcef9f-3e20-40de-8527-4449a15b334a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:34.450342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcef9f-3e20-40de-8527-4449a15b334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:34.480115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c6dcef9f-3e20-40de-8527-4449a15b334a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:34.481782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c6dcef9f-3e20-40de-8527-4449a15b334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:34.514888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 826/1664] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:34.520898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcef9f-3e20-40de-8527-4449a15b334a None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:34.546299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcef9f-3e20-40de-8527-4449a15b334a None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:34.557503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08e819-4fa0-4a20-b91c-ea33c8507afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:34.558760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08e819-4fa0-4a20-b91c-ea33c8507afb admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:34.559367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08e819-4fa0-4a20-b91c-ea33c8507afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:34.559824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08e819-4fa0-4a20-b91c-ea33c8507afb admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:34.560696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08e819-4fa0-4a20-b91c-ea33c8507afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:34.561332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08e819-4fa0-4a20-b91c-ea33c8507afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:34.563406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08e819-4fa0-4a20-b91c-ea33c8507afb admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:34.606454 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:34.616274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 827/1665] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:34.617681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08e819-4fa0-4a20-b91c-ea33c8507afb admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:34.631143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 839/1666] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:34 2022] POST /identity/v3/projects => generated 403 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:34.641008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175e4b6-1253-4857-9139-f50fca443aef admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:34.641155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08e819-4fa0-4a20-b91c-ea33c8507afb admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:34.641319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3175e4b6-1253-4857-9139-f50fca443aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:34.724096 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444e096-dc33-4b53-8e5b-63054b1d9008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:34.724768 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444e096-dc33-4b53-8e5b-63054b1d9008 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:34.725028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444e096-dc33-4b53-8e5b-63054b1d9008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:34.725323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444e096-dc33-4b53-8e5b-63054b1d9008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:34.726150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444e096-dc33-4b53-8e5b-63054b1d9008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:34.729662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444e096-dc33-4b53-8e5b-63054b1d9008 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:34.826079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175e4b6-1253-4857-9139-f50fca443aef admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:34.834369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625ce93-8d7c-495a-9168-72431c309e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:34.837524 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625ce93-8d7c-495a-9168-72431c309e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:34.838176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625ce93-8d7c-495a-9168-72431c309e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:34.838698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625ce93-8d7c-495a-9168-72431c309e06 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:34.841121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625ce93-8d7c-495a-9168-72431c309e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:34.844680 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625ce93-8d7c-495a-9168-72431c309e06 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:34.878917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 828/1667] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:34 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:34.883030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444e096-dc33-4b53-8e5b-63054b1d9008 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:35.023082 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 840/1668] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:34 2022] POST /identity/v3/users => generated 308 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:35.026828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625ce93-8d7c-495a-9168-72431c309e06 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:35.031949 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444e096-dc33-4b53-8e5b-63054b1d9008 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:35.054117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4ffdc-0829-414e-b343-b26493882786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:35.055627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4ffdc-0829-414e-b343-b26493882786 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.055937 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4ffdc-0829-414e-b343-b26493882786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.056238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4ffdc-0829-414e-b343-b26493882786 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.056912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4ffdc-0829-414e-b343-b26493882786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:35.059144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4ffdc-0829-414e-b343-b26493882786 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:35.064162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625ce93-8d7c-495a-9168-72431c309e06 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:35.085472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cee87-34ef-4e06-bac8-816c15f73549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:35.086333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cee87-34ef-4e06-bac8-816c15f73549 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.086917 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cee87-34ef-4e06-bac8-816c15f73549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.098140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cee87-34ef-4e06-bac8-816c15f73549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.099232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cee87-34ef-4e06-bac8-816c15f73549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:35.114800 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cee87-34ef-4e06-bac8-816c15f73549 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:35.141609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 841/1669] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:35.145972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cee87-34ef-4e06-bac8-816c15f73549 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:35.168572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 829/1670] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:34 2022] POST /identity/v3/users => generated 289 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:35.173685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cee87-34ef-4e06-bac8-816c15f73549 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:35.174122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4ffdc-0829-414e-b343-b26493882786 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:35.188956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0344-bdcb-472c-b1d1-e458b95f7afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:35.193623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0344-bdcb-472c-b1d1-e458b95f7afb admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.193623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0344-bdcb-472c-b1d1-e458b95f7afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.193623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d0344-bdcb-472c-b1d1-e458b95f7afb admin admin] PATH_INFO: `/v3/projects/5e416e11281f4844ac68829d8bf24efb/users/cdc0f4875b2e4208b1e8e5b1ca9eda4d/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.193893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4ffdc-0829-414e-b343-b26493882786 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:35.206846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aa0e3-4aba-4f81-a87b-74feec311655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:35.207494 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aa0e3-4aba-4f81-a87b-74feec311655 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.207781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aa0e3-4aba-4f81-a87b-74feec311655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.208058 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382aa0e3-4aba-4f81-a87b-74feec311655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.208783 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382aa0e3-4aba-4f81-a87b-74feec311655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:35.210526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382aa0e3-4aba-4f81-a87b-74feec311655 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:35.227281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d0344-bdcb-472c-b1d1-e458b95f7afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e416e11281f4844ac68829d8bf24efb, user_id=cdc0f4875b2e4208b1e8e5b1ca9eda4d, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:35.235966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d0344-bdcb-472c-b1d1-e458b95f7afb admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:35.243742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 830/1671] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:35.248800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aa0e3-4aba-4f81-a87b-74feec311655 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:35.273913 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382aa0e3-4aba-4f81-a87b-74feec311655 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:35.285879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a2197-19c6-4cf5-ad2b-d40d32f34b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:35.286557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a2197-19c6-4cf5-ad2b-d40d32f34b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.286852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a2197-19c6-4cf5-ad2b-d40d32f34b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.287119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a2197-19c6-4cf5-ad2b-d40d32f34b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.287834 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a2197-19c6-4cf5-ad2b-d40d32f34b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:35.289582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a2197-19c6-4cf5-ad2b-d40d32f34b84 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:35.320839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 831/1672] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:35.323867 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a2197-19c6-4cf5-ad2b-d40d32f34b84 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:35.331382 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 842/1673] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:35 2022] PUT /identity/v3/projects/5e416e11281f4844ac68829d8bf24efb/users/cdc0f4875b2e4208b1e8e5b1ca9eda4d/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:35.348744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a2197-19c6-4cf5-ad2b-d40d32f34b84 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:35.354190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0344-bdcb-472c-b1d1-e458b95f7afb admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:35.486523 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf4ced-ae96-44ef-9a15-c858ddd0b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:35.487754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf4ced-ae96-44ef-9a15-c858ddd0b1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.487754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf4ced-ae96-44ef-9a15-c858ddd0b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.487754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf4ced-ae96-44ef-9a15-c858ddd0b1d1 admin admin] PATH_INFO: `/v3/projects/67ba82a0b0534421b903b2688ed99b91/users/b6f1d2749e6b47fcba4951a5df7518bf/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.518476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d0344-bdcb-472c-b1d1-e458b95f7afb admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:35.527070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf4ced-ae96-44ef-9a15-c858ddd0b1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ba82a0b0534421b903b2688ed99b91, user_id=b6f1d2749e6b47fcba4951a5df7518bf, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:35.528182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56315b64-50a0-41c8-bbd7-66cb469f0907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:35.529218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315b64-50a0-41c8-bbd7-66cb469f0907 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.529505 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315b64-50a0-41c8-bbd7-66cb469f0907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.529778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315b64-50a0-41c8-bbd7-66cb469f0907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.531168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56315b64-50a0-41c8-bbd7-66cb469f0907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:35.534966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56315b64-50a0-41c8-bbd7-66cb469f0907 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:35.535981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf4ced-ae96-44ef-9a15-c858ddd0b1d1 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:35.565819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 843/1674] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:35.573239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56315b64-50a0-41c8-bbd7-66cb469f0907 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:35.598742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56315b64-50a0-41c8-bbd7-66cb469f0907 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:35.613174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c17c8-b379-46d0-ad0e-a4dda2f8c7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:35.613935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c17c8-b379-46d0-ad0e-a4dda2f8c7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.614221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c17c8-b379-46d0-ad0e-a4dda2f8c7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.614521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c17c8-b379-46d0-ad0e-a4dda2f8c7fa admin admin] PATH_INFO: `/v3/projects/5e416e11281f4844ac68829d8bf24efb/users/cdc0f4875b2e4208b1e8e5b1ca9eda4d/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.620473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c17c8-b379-46d0-ad0e-a4dda2f8c7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e416e11281f4844ac68829d8bf24efb, user_id=cdc0f4875b2e4208b1e8e5b1ca9eda4d, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:35.629713 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c17c8-b379-46d0-ad0e-a4dda2f8c7fa admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:35.641485 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 832/1675] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:35 2022] PUT /identity/v3/projects/67ba82a0b0534421b903b2688ed99b91/users/b6f1d2749e6b47fcba4951a5df7518bf/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:35.651539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505890e-a839-4559-a9c6-490289f5a6ca None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.651902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 844/1676] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:35 2022] PUT /identity/v3/projects/5e416e11281f4844ac68829d8bf24efb/users/cdc0f4875b2e4208b1e8e5b1ca9eda4d/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:35.663989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505890e-a839-4559-a9c6-490289f5a6ca None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.664334 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505890e-a839-4559-a9c6-490289f5a6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.665400 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7723abd-c251-4a78-8a4a-78398d616b34 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.665707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7723abd-c251-4a78-8a4a-78398d616b34 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.665988 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7723abd-c251-4a78-8a4a-78398d616b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.724068 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:35.730689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f7723abd-c251-4a78-8a4a-78398d616b34 None None] MFA Rules not processed for user `cdc0f4875b2e4208b1e8e5b1ca9eda4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:35.732100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f7723abd-c251-4a78-8a4a-78398d616b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:35.732400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c505890e-a839-4559-a9c6-490289f5a6ca None None] MFA Rules not processed for user `b6f1d2749e6b47fcba4951a5df7518bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:35.733647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c505890e-a839-4559-a9c6-490289f5a6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:35.835545 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 845/1677] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:35 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:35.861024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7723abd-c251-4a78-8a4a-78398d616b34 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:35.865922 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f7723abd-c251-4a78-8a4a-78398d616b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:35.907627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 833/1678] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:35.909160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505890e-a839-4559-a9c6-490289f5a6ca None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:35.943616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:36.006557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7723abd-c251-4a78-8a4a-78398d616b34 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:36.016802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba6e42-0d32-49b1-ae0e-1d4a64b5cd30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:36.018563 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba6e42-0d32-49b1-ae0e-1d4a64b5cd30 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.018885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba6e42-0d32-49b1-ae0e-1d4a64b5cd30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.020365 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba6e42-0d32-49b1-ae0e-1d4a64b5cd30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.037535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba6e42-0d32-49b1-ae0e-1d4a64b5cd30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:36.040255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba6e42-0d32-49b1-ae0e-1d4a64b5cd30 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:36.054912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 846/1679] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:35 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:36.083027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505890e-a839-4559-a9c6-490289f5a6ca None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:36.094268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8361e-d917-4678-a1a8-3f74fa739156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:36.099539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8361e-d917-4678-a1a8-3f74fa739156 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.101696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8361e-d917-4678-a1a8-3f74fa739156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.101696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8361e-d917-4678-a1a8-3f74fa739156 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.101696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8361e-d917-4678-a1a8-3f74fa739156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:36.103916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8361e-d917-4678-a1a8-3f74fa739156 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:36.252314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 834/1680] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:35 2022] POST /identity/v3/projects => generated 379 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:36.253705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba6e42-0d32-49b1-ae0e-1d4a64b5cd30 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:36.288914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba6e42-0d32-49b1-ae0e-1d4a64b5cd30 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:36.330623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8361e-d917-4678-a1a8-3f74fa739156 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:36.455990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db493c-dc69-486f-8127-abac8b96c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:36.456823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db493c-dc69-486f-8127-abac8b96c1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.457121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db493c-dc69-486f-8127-abac8b96c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.457602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db493c-dc69-486f-8127-abac8b96c1e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.458307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db493c-dc69-486f-8127-abac8b96c1e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:36.461035 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db493c-dc69-486f-8127-abac8b96c1e2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:36.470231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:36.490746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8361e-d917-4678-a1a8-3f74fa739156 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:36.497529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:36.498694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.498694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.498961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] PATH_INFO: `/v3/users/721bd849457644d688cf4b0a38a6bca3` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.500823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=721bd849457644d688cf4b0a38a6bca3)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:36.503240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:36.575287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 847/1681] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:36 2022] POST /identity/v3/users => generated 290 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:36.595240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db493c-dc69-486f-8127-abac8b96c1e2 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:36.654273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db493c-dc69-486f-8127-abac8b96c1e2 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:36.676865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5429c-18f9-46a3-9205-a63d7573e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:36.678131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5429c-18f9-46a3-9205-a63d7573e3fd admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.678418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5429c-18f9-46a3-9205-a63d7573e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.684006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5429c-18f9-46a3-9205-a63d7573e3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.684006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5429c-18f9-46a3-9205-a63d7573e3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:36.693374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5429c-18f9-46a3-9205-a63d7573e3fd admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:36.728491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 848/1682] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:36.733640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5429c-18f9-46a3-9205-a63d7573e3fd admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:36.785533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721bd849457644d688cf4b0a38a6bca3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:36.792105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5429c-18f9-46a3-9205-a63d7573e3fd admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:36.806815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdeac9-97ba-4b45-8d60-abf609d9ea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:36.807033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdeac9-97ba-4b45-8d60-abf609d9ea4a admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.807303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdeac9-97ba-4b45-8d60-abf609d9ea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.810353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdeac9-97ba-4b45-8d60-abf609d9ea4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.812675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdeac9-97ba-4b45-8d60-abf609d9ea4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:36.817009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdeac9-97ba-4b45-8d60-abf609d9ea4a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:36.847774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 849/1683] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:36.847774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdeac9-97ba-4b45-8d60-abf609d9ea4a admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:36.850452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-57fdeac9-97ba-4b45-8d60-abf609d9ea4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:36.885874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdeac9-97ba-4b45-8d60-abf609d9ea4a admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:36.898807 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721bd849457644d688cf4b0a38a6bca3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:36.909376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721bd849457644d688cf4b0a38a6bca3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:36.913165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721bd849457644d688cf4b0a38a6bca3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:36.915380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721bd849457644d688cf4b0a38a6bca3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:36.924049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:36.926916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.927208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.931827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] PATH_INFO: `/v3/users/cd0e74d35ca74099b04e28e5826f29c3` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.938546 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0e74d35ca74099b04e28e5826f29c3)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:36.946057 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:37.020368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 835/1684] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:36 2022] DELETE /identity/v3/users/721bd849457644d688cf4b0a38a6bca3 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:37.020368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.020368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:37.199632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d4c8a-609f-4413-93de-b0af3352eccc admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:37.218746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f96362-478b-43c0-8856-3da050256164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:37.219749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96362-478b-43c0-8856-3da050256164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.220193 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96362-478b-43c0-8856-3da050256164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.221174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96362-478b-43c0-8856-3da050256164 admin admin] PATH_INFO: `/v3/projects/b7368543eba7463a8958354b054f953c/users/058b2c05646748a1913d201d6ddee1f7/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.244568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f96362-478b-43c0-8856-3da050256164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7368543eba7463a8958354b054f953c, user_id=058b2c05646748a1913d201d6ddee1f7, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:37.249138 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f96362-478b-43c0-8856-3da050256164 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:37.546608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 836/1685] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:36 2022] PUT /identity/v3/projects/b7368543eba7463a8958354b054f953c/users/058b2c05646748a1913d201d6ddee1f7/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:37.546608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d391f6b-f915-4065-a19c-9045ba01523f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.547463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d391f6b-f915-4065-a19c-9045ba01523f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.547463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d391f6b-f915-4065-a19c-9045ba01523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.589265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-2d391f6b-f915-4065-a19c-9045ba01523f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:37.590560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2d391f6b-f915-4065-a19c-9045ba01523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:37.682013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0e74d35ca74099b04e28e5826f29c3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:37.697526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0e74d35ca74099b04e28e5826f29c3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:37.698782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0e74d35ca74099b04e28e5826f29c3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:37.711888 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0e74d35ca74099b04e28e5826f29c3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:37.728799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 837/1686] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:37.730124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0718e-55a4-4859-a7e9-6af374919d8c None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.731742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0718e-55a4-4859-a7e9-6af374919d8c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.731742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0718e-55a4-4859-a7e9-6af374919d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.744944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:37.765298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-dde0718e-55a4-4859-a7e9-6af374919d8c None None] MFA Rules not processed for user `058b2c05646748a1913d201d6ddee1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:37.766831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-dde0718e-55a4-4859-a7e9-6af374919d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:37.807827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0e74d35ca74099b04e28e5826f29c3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:37.845324 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 850/1687] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:36 2022] DELETE /identity/v3/users/cd0e74d35ca74099b04e28e5826f29c3 => generated 0 bytes in 995 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:37.850811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.852219 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:37.890446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 838/1688] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:37.891932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc1401-a601-4493-bbdb-c2a3f75558a9 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.892227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc1401-a601-4493-bbdb-c2a3f75558a9 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.892509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc1401-a601-4493-bbdb-c2a3f75558a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.914693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-69dc1401-a601-4493-bbdb-c2a3f75558a9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:37.918427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-69dc1401-a601-4493-bbdb-c2a3f75558a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:38.004781 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeea527-d226-42c1-8cf0-ef07ed25b115 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.009118 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72f725-abd0-4c22-b514-d1d8176dec1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.010231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72f725-abd0-4c22-b514-d1d8176dec1c service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.010737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72f725-abd0-4c22-b514-d1d8176dec1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.011489 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72f725-abd0-4c22-b514-d1d8176dec1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.020516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:38.100016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 839/1689] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:38.107564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc1401-a601-4493-bbdb-c2a3f75558a9 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.110622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-69dc1401-a601-4493-bbdb-c2a3f75558a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:38.133902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72f725-abd0-4c22-b514-d1d8176dec1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.138269 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc1401-a601-4493-bbdb-c2a3f75558a9 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.139339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72f725-abd0-4c22-b514-d1d8176dec1c service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.149289 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2092b-d6b1-4bfa-a43d-6b22fe7a3eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.149929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2092b-d6b1-4bfa-a43d-6b22fe7a3eac admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.150213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2092b-d6b1-4bfa-a43d-6b22fe7a3eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.151651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2092b-d6b1-4bfa-a43d-6b22fe7a3eac admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.152344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2092b-d6b1-4bfa-a43d-6b22fe7a3eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.155963 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2092b-d6b1-4bfa-a43d-6b22fe7a3eac admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.161773 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 851/1690] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:38.282209 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 840/1691] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:38 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:38.286544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72f725-abd0-4c22-b514-d1d8176dec1c service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.302013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72f725-abd0-4c22-b514-d1d8176dec1c service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.441398 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b46ca8-686d-4033-94ad-ff1dfb3c6b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.442316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b46ca8-686d-4033-94ad-ff1dfb3c6b91 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.444022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b46ca8-686d-4033-94ad-ff1dfb3c6b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.444462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b46ca8-686d-4033-94ad-ff1dfb3c6b91 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.446060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b46ca8-686d-4033-94ad-ff1dfb3c6b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.456743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b46ca8-686d-4033-94ad-ff1dfb3c6b91 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.502354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2092b-d6b1-4bfa-a43d-6b22fe7a3eac admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.611172 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2092b-d6b1-4bfa-a43d-6b22fe7a3eac admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.615029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87646d94-2ca4-4d86-a171-9a6408d4ddcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.620097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87646d94-2ca4-4d86-a171-9a6408d4ddcb service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.620097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87646d94-2ca4-4d86-a171-9a6408d4ddcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.620097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87646d94-2ca4-4d86-a171-9a6408d4ddcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.620475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 852/1692] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:38 2022] POST /identity/v3/users => generated 295 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:38.621643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b46ca8-686d-4033-94ad-ff1dfb3c6b91 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.642261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87646d94-2ca4-4d86-a171-9a6408d4ddcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.642880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b46ca8-686d-4033-94ad-ff1dfb3c6b91 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.644671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87646d94-2ca4-4d86-a171-9a6408d4ddcb service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.656264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb371ef1-3b7b-411d-8143-51dc01e609e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.656903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb371ef1-3b7b-411d-8143-51dc01e609e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.657184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb371ef1-3b7b-411d-8143-51dc01e609e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.657456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb371ef1-3b7b-411d-8143-51dc01e609e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.658157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb371ef1-3b7b-411d-8143-51dc01e609e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.661717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb371ef1-3b7b-411d-8143-51dc01e609e8 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.666337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 841/1693] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:38.679615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87646d94-2ca4-4d86-a171-9a6408d4ddcb service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.680059 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 853/1694] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:38.690845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87646d94-2ca4-4d86-a171-9a6408d4ddcb service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.704121 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc165540-c147-4ee7-9b75-c21e085d4c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.704820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165540-c147-4ee7-9b75-c21e085d4c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.705278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165540-c147-4ee7-9b75-c21e085d4c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.705695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165540-c147-4ee7-9b75-c21e085d4c76 admin admin] PATH_INFO: `/v3/projects/0a76e135f6cf47889edeaa9963a6983c/users/9134be4895364412a818d0df9a37d700/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.722101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc165540-c147-4ee7-9b75-c21e085d4c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a76e135f6cf47889edeaa9963a6983c, user_id=9134be4895364412a818d0df9a37d700, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.729379 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc165540-c147-4ee7-9b75-c21e085d4c76 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.812893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 842/1695] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:38 2022] PUT /identity/v3/projects/0a76e135f6cf47889edeaa9963a6983c/users/9134be4895364412a818d0df9a37d700/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:38.817163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb371ef1-3b7b-411d-8143-51dc01e609e8 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.830688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb371ef1-3b7b-411d-8143-51dc01e609e8 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.881147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:38.911935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69074250-76e0-45e5-bb9b-d9b76b29db04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.912831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69074250-76e0-45e5-bb9b-d9b76b29db04 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.913949 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69074250-76e0-45e5-bb9b-d9b76b29db04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.914244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69074250-76e0-45e5-bb9b-d9b76b29db04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.915000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69074250-76e0-45e5-bb9b-d9b76b29db04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.916751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69074250-76e0-45e5-bb9b-d9b76b29db04 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.931054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 854/1696] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:38.932541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc165540-c147-4ee7-9b75-c21e085d4c76 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.945386 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc165540-c147-4ee7-9b75-c21e085d4c76 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.952808 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa0d39-3a4e-4b42-af38-2c2e0b9baa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.958350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa0d39-3a4e-4b42-af38-2c2e0b9baa6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.958350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa0d39-3a4e-4b42-af38-2c2e0b9baa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.958350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa0d39-3a4e-4b42-af38-2c2e0b9baa6f admin admin] PATH_INFO: `/v3/projects/0a76e135f6cf47889edeaa9963a6983c/users/9134be4895364412a818d0df9a37d700/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.958350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa0d39-3a4e-4b42-af38-2c2e0b9baa6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a76e135f6cf47889edeaa9963a6983c, user_id=9134be4895364412a818d0df9a37d700, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.960590 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa0d39-3a4e-4b42-af38-2c2e0b9baa6f admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.986382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 843/1697] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:38 2022] PUT /identity/v3/projects/0a76e135f6cf47889edeaa9963a6983c/users/9134be4895364412a818d0df9a37d700/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:38.988123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceda921-b964-4f38-aecc-7c2fca00c94c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.988480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceda921-b964-4f38-aecc-7c2fca00c94c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.988827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceda921-b964-4f38-aecc-7c2fca00c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:39.024155 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-3ceda921-b964-4f38-aecc-7c2fca00c94c None None] MFA Rules not processed for user `9134be4895364412a818d0df9a37d700`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:39.025896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3ceda921-b964-4f38-aecc-7c2fca00c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:39.122113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 855/1698] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:39.131209 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa0d39-3a4e-4b42-af38-2c2e0b9baa6f admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:39.134014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5daa0d39-3a4e-4b42-af38-2c2e0b9baa6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:39.252142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:39.259815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa0d39-3a4e-4b42-af38-2c2e0b9baa6f admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:39.264239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b160090-7369-413e-8a36-d888d739f458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:39.266319 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160090-7369-413e-8a36-d888d739f458 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:39.266788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160090-7369-413e-8a36-d888d739f458 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:39.267366 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160090-7369-413e-8a36-d888d739f458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:39.279017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b160090-7369-413e-8a36-d888d739f458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:39.280787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b160090-7369-413e-8a36-d888d739f458 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:39.292360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 844/1699] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:39.465531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceda921-b964-4f38-aecc-7c2fca00c94c None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:39.467789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3ceda921-b964-4f38-aecc-7c2fca00c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:39.493307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceda921-b964-4f38-aecc-7c2fca00c94c None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:39.505203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073174c-a374-4173-902e-50d5a439c0d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:39.506521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073174c-a374-4173-902e-50d5a439c0d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:39.506828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073174c-a374-4173-902e-50d5a439c0d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:39.507443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073174c-a374-4173-902e-50d5a439c0d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:39.514250 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8073174c-a374-4173-902e-50d5a439c0d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:39.656306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85247c71-b03d-4e8a-bf7c-98ce6d2906c4 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:39.656828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85247c71-b03d-4e8a-bf7c-98ce6d2906c4 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:39.657377 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85247c71-b03d-4e8a-bf7c-98ce6d2906c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:39.711115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073174c-a374-4173-902e-50d5a439c0d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:39.715724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073174c-a374-4173-902e-50d5a439c0d1 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:39.726463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-85247c71-b03d-4e8a-bf7c-98ce6d2906c4 None None] MFA Rules not processed for user `ec17e3dfa63047109f321c2c207c4dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:39.728184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-85247c71-b03d-4e8a-bf7c-98ce6d2906c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:39.739283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 856/1700] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:39.930546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 845/1701] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:39.939513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:40.880607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073174c-a374-4173-902e-50d5a439c0d1 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:40.882115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8073174c-a374-4173-902e-50d5a439c0d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:41.009230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:41.090177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073174c-a374-4173-902e-50d5a439c0d1 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:41.098519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:41.099187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.099378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.099543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] PATH_INFO: `/v3/projects/665b55428ee3418e81787962fdef4d1a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.102297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=665b55428ee3418e81787962fdef4d1a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:41.103058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: WARNING py.warnings [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:36:41.103058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: warnings.warn(msg) Aug 04 02:36:41.103058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: Aug 04 02:36:41.104249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:41.357802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665b55428ee3418e81787962fdef4d1a', 'request_id': 'req-9181ca79-45ef-433b-b070-8311fe002e5a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.383238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665b55428ee3418e81787962fdef4d1a', 'request_id': 'req-9181ca79-45ef-433b-b070-8311fe002e5a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.480761 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665b55428ee3418e81787962fdef4d1a', 'request_id': 'req-9181ca79-45ef-433b-b070-8311fe002e5a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.532182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] The token cache is being invalidate because project 665b55428ee3418e81787962fdef4d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:41.533842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.535871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9181ca79-45ef-433b-b070-8311fe002e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.540522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 857/1702] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:40 2022] DELETE /identity/v3/projects/665b55428ee3418e81787962fdef4d1a => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:41.547544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bb214-581e-4bb7-84aa-4c0537cb9344 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.548743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bb214-581e-4bb7-84aa-4c0537cb9344 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.549214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bb214-581e-4bb7-84aa-4c0537cb9344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.605857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6d9bb214-581e-4bb7-84aa-4c0537cb9344 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:41.608332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6d9bb214-581e-4bb7-84aa-4c0537cb9344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:41.742988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 846/1703] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:41.751596 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc890e2-c170-4087-a867-35f19cc244e6 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.751733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc890e2-c170-4087-a867-35f19cc244e6 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.752163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc890e2-c170-4087-a867-35f19cc244e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.789700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-5dc890e2-c170-4087-a867-35f19cc244e6 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:41.791308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5dc890e2-c170-4087-a867-35f19cc244e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:41.826360 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 858/1704] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:41.830877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bb214-581e-4bb7-84aa-4c0537cb9344 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:41.852267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bb214-581e-4bb7-84aa-4c0537cb9344 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:41.867450 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d20f05-f620-471e-ace8-5cd5ef0da7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:41.868078 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d20f05-f620-471e-ace8-5cd5ef0da7ff admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.868369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d20f05-f620-471e-ace8-5cd5ef0da7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.868648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d20f05-f620-471e-ace8-5cd5ef0da7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.869371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d20f05-f620-471e-ace8-5cd5ef0da7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:41.869683 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d20f05-f620-471e-ace8-5cd5ef0da7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:41.871348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d20f05-f620-471e-ace8-5cd5ef0da7ff admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:41.888670 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 847/1705] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:41.889871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc890e2-c170-4087-a867-35f19cc244e6 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:41.902474 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc890e2-c170-4087-a867-35f19cc244e6 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:41.911458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31d918-9bd6-4560-9462-82275fa0565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:41.911458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31d918-9bd6-4560-9462-82275fa0565f admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.911458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31d918-9bd6-4560-9462-82275fa0565f admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.911458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31d918-9bd6-4560-9462-82275fa0565f admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.911730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31d918-9bd6-4560-9462-82275fa0565f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:41.914012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31d918-9bd6-4560-9462-82275fa0565f admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:41.914134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d20f05-f620-471e-ace8-5cd5ef0da7ff admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:41.916069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-17d20f05-f620-471e-ace8-5cd5ef0da7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:41.944426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d20f05-f620-471e-ace8-5cd5ef0da7ff admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:41.949885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:41.951071 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.951616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.952265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] PATH_INFO: `/v3/projects/f3b8748756a642ea9272a1268792866c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.960627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b8748756a642ea9272a1268792866c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:41.968717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.019613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:42.071950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 859/1706] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:41 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:42.075781 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31d918-9bd6-4560-9462-82275fa0565f admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.121953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b8748756a642ea9272a1268792866c', 'request_id': 'req-8dc9d25b-9670-4e74-bd58-ee2684413817'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:42.212186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b8748756a642ea9272a1268792866c', 'request_id': 'req-8dc9d25b-9670-4e74-bd58-ee2684413817'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:42.212724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31d918-9bd6-4560-9462-82275fa0565f admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.222657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b8748756a642ea9272a1268792866c', 'request_id': 'req-8dc9d25b-9670-4e74-bd58-ee2684413817'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:42.269410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] The token cache is being invalidate because project f3b8748756a642ea9272a1268792866c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:42.272806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:42.276040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:42.282591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 848/1707] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:41 2022] DELETE /identity/v3/projects/f3b8748756a642ea9272a1268792866c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:42.286377 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.289765 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:42.338929 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0efa-8d47-4a76-b6a5-fd24ada999de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.339620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0efa-8d47-4a76-b6a5-fd24ada999de admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.339912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0efa-8d47-4a76-b6a5-fd24ada999de admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.340197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0efa-8d47-4a76-b6a5-fd24ada999de admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.341444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee0efa-8d47-4a76-b6a5-fd24ada999de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.347602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee0efa-8d47-4a76-b6a5-fd24ada999de admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.434836 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9d25b-9670-4e74-bd58-ee2684413817 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.450232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6a1f4-3fee-48fe-9087-c097d66b9dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.451098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6a1f4-3fee-48fe-9087-c097d66b9dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.451507 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6a1f4-3fee-48fe-9087-c097d66b9dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.451959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6a1f4-3fee-48fe-9087-c097d66b9dbd admin admin] PATH_INFO: `/v3/users/cdc0f4875b2e4208b1e8e5b1ca9eda4d` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.454177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6a1f4-3fee-48fe-9087-c097d66b9dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc0f4875b2e4208b1e8e5b1ca9eda4d)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.456789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6a1f4-3fee-48fe-9087-c097d66b9dbd admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.491627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 860/1708] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:42 2022] POST /identity/v3/users => generated 287 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:36:42.494688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0efa-8d47-4a76-b6a5-fd24ada999de admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.497030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3eee0efa-8d47-4a76-b6a5-fd24ada999de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:42.525996 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0efa-8d47-4a76-b6a5-fd24ada999de admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.532585 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b494f-fd29-4804-8815-b4e9a783fd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.534044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b494f-fd29-4804-8815-b4e9a783fd93 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.534586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b494f-fd29-4804-8815-b4e9a783fd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.535430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b494f-fd29-4804-8815-b4e9a783fd93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.536369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b494f-fd29-4804-8815-b4e9a783fd93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.538349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b494f-fd29-4804-8815-b4e9a783fd93 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.554459 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 861/1709] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:42.559468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b494f-fd29-4804-8815-b4e9a783fd93 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.572692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b494f-fd29-4804-8815-b4e9a783fd93 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.584378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb5bd4-1a2b-4fa1-b6f7-b3217365446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.585503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb5bd4-1a2b-4fa1-b6f7-b3217365446d admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.586007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb5bd4-1a2b-4fa1-b6f7-b3217365446d admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.586513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb5bd4-1a2b-4fa1-b6f7-b3217365446d admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.589452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb5bd4-1a2b-4fa1-b6f7-b3217365446d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.591802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb5bd4-1a2b-4fa1-b6f7-b3217365446d admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.613497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 862/1710] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:42.621545 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb5bd4-1a2b-4fa1-b6f7-b3217365446d admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.637093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb5bd4-1a2b-4fa1-b6f7-b3217365446d admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.644770 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44d366-2ee2-4261-b5ee-2549ea2a9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.645553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44d366-2ee2-4261-b5ee-2549ea2a9507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.645912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44d366-2ee2-4261-b5ee-2549ea2a9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.646265 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44d366-2ee2-4261-b5ee-2549ea2a9507 admin admin] PATH_INFO: `/v3/projects/3e2ea8e413ef416fbe828cdf5e02de4e/users/01edd8ec787c401f9f385da421e3a534/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.670323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44d366-2ee2-4261-b5ee-2549ea2a9507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2ea8e413ef416fbe828cdf5e02de4e, user_id=01edd8ec787c401f9f385da421e3a534, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.674095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44d366-2ee2-4261-b5ee-2549ea2a9507 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.707165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-5ad6a1f4-3fee-48fe-9087-c097d66b9dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc0f4875b2e4208b1e8e5b1ca9eda4d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:42.786612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 863/1711] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:42 2022] PUT /identity/v3/projects/3e2ea8e413ef416fbe828cdf5e02de4e/users/01edd8ec787c401f9f385da421e3a534/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:42.795270 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93701c-5556-4bd5-9c2c-5742de85ebc7 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.795843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93701c-5556-4bd5-9c2c-5742de85ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.796283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93701c-5556-4bd5-9c2c-5742de85ebc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.826024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-5ad6a1f4-3fee-48fe-9087-c097d66b9dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc0f4875b2e4208b1e8e5b1ca9eda4d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:42.837731 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-5ad6a1f4-3fee-48fe-9087-c097d66b9dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc0f4875b2e4208b1e8e5b1ca9eda4d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:42.837952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-cb93701c-5556-4bd5-9c2c-5742de85ebc7 None None] MFA Rules not processed for user `d8bc44049ca2427883806568abab2681`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:42.839052 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-5ad6a1f4-3fee-48fe-9087-c097d66b9dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc0f4875b2e4208b1e8e5b1ca9eda4d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:42.840058 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-5ad6a1f4-3fee-48fe-9087-c097d66b9dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc0f4875b2e4208b1e8e5b1ca9eda4d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:42.840171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cb93701c-5556-4bd5-9c2c-5742de85ebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:42.892322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 849/1712] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:42 2022] DELETE /identity/v3/users/cdc0f4875b2e4208b1e8e5b1ca9eda4d => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:42.894299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28221f5-ea2d-489b-89f8-d22fb3e33cd7 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.905437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28221f5-ea2d-489b-89f8-d22fb3e33cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.905437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28221f5-ea2d-489b-89f8-d22fb3e33cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.934974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f28221f5-ea2d-489b-89f8-d22fb3e33cd7 None None] MFA Rules not processed for user `01edd8ec787c401f9f385da421e3a534`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:42.936911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f28221f5-ea2d-489b-89f8-d22fb3e33cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:42.991365 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 864/1713] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:43.006556 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef54dc-044f-4b8b-8174-16c02d9f6ce3 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.006858 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef54dc-044f-4b8b-8174-16c02d9f6ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.007147 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef54dc-044f-4b8b-8174-16c02d9f6ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.058925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-4eef54dc-044f-4b8b-8174-16c02d9f6ce3 None None] MFA Rules not processed for user `d8bc44049ca2427883806568abab2681`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:43.060215 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4eef54dc-044f-4b8b-8174-16c02d9f6ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:43.080235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 850/1714] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:43.081543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28221f5-ea2d-489b-89f8-d22fb3e33cd7 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:43.083491 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f28221f5-ea2d-489b-89f8-d22fb3e33cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:43.159456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 865/1715] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:43.160855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bd87e-f344-4e65-9b58-0171f13d22dd None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.161152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bd87e-f344-4e65-9b58-0171f13d22dd None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.161433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bd87e-f344-4e65-9b58-0171f13d22dd None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.163042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 866/1716] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:43.175143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bd87e-f344-4e65-9b58-0171f13d22dd None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:43.175469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d95bd87e-f344-4e65-9b58-0171f13d22dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:43.311656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28221f5-ea2d-489b-89f8-d22fb3e33cd7 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:43.318649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330209-3292-4820-a20c-86c7f54e35a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:43.319303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330209-3292-4820-a20c-86c7f54e35a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.319695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330209-3292-4820-a20c-86c7f54e35a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.320093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330209-3292-4820-a20c-86c7f54e35a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.321252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69330209-3292-4820-a20c-86c7f54e35a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:43.324192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69330209-3292-4820-a20c-86c7f54e35a8 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:43.361426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:43.370797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bd87e-f344-4e65-9b58-0171f13d22dd None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:43.391506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d857a9-0e75-451b-91c2-5d4e1f6946a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:43.392606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d857a9-0e75-451b-91c2-5d4e1f6946a4 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.393752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d857a9-0e75-451b-91c2-5d4e1f6946a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.394050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d857a9-0e75-451b-91c2-5d4e1f6946a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.415501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d857a9-0e75-451b-91c2-5d4e1f6946a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:43.417915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d857a9-0e75-451b-91c2-5d4e1f6946a4 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:43.437744 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 867/1717] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:43.439589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5d686-31d6-4f35-999f-6d832ba46d17 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.439985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5d686-31d6-4f35-999f-6d832ba46d17 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.440338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5d686-31d6-4f35-999f-6d832ba46d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.474296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-eac5d686-31d6-4f35-999f-6d832ba46d17 None None] MFA Rules not processed for user `423ac00601f84e3d9c6cc6ee20eee6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:43.476769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-eac5d686-31d6-4f35-999f-6d832ba46d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:43.500486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 851/1718] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:43 2022] POST /identity/v3/projects => generated 373 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:43.502023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330209-3292-4820-a20c-86c7f54e35a8 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:43.566739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:43.725077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 868/1719] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:36:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:43.743279 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330209-3292-4820-a20c-86c7f54e35a8 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:43.752749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21501438-c405-4ed6-b824-1152e89de57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:43.753600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21501438-c405-4ed6-b824-1152e89de57f admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.753983 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21501438-c405-4ed6-b824-1152e89de57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.754425 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21501438-c405-4ed6-b824-1152e89de57f admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.757568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5d686-31d6-4f35-999f-6d832ba46d17 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:43.759057 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-eac5d686-31d6-4f35-999f-6d832ba46d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:43.759684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21501438-c405-4ed6-b824-1152e89de57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:43.764046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21501438-c405-4ed6-b824-1152e89de57f admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:43.792700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5d686-31d6-4f35-999f-6d832ba46d17 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:43.810026 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:43.810737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.811023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.811298 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] PATH_INFO: `/v3/projects/5e416e11281f4844ac68829d8bf24efb` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.818808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e416e11281f4844ac68829d8bf24efb)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:43.821639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:43.887336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 852/1720] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:43 2022] POST /identity/v3/users => generated 293 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:43.888820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1d937-67e2-4097-9919-dc074e5becda None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.893313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1d937-67e2-4097-9919-dc074e5becda None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.893695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1d937-67e2-4097-9919-dc074e5becda None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.904443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 853/1721] 10.222.0.60 () {54 vars in 961 bytes} [Thu Aug 4 02:36:43 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:43.915788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1d937-67e2-4097-9919-dc074e5becda None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:43.951587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1d937-67e2-4097-9919-dc074e5becda None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:43.965393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b9e54-2f94-4831-a404-d0efc29e6bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:43.966131 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b9e54-2f94-4831-a404-d0efc29e6bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.968383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b9e54-2f94-4831-a404-d0efc29e6bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.968688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b9e54-2f94-4831-a404-d0efc29e6bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.970651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b9e54-2f94-4831-a404-d0efc29e6bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:43.996341 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b9e54-2f94-4831-a404-d0efc29e6bd3 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:44.009326 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:44.043631 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 854/1722] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:44.048653 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aa6ae-dc5f-41ce-8985-217d55472ec9 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:44.053662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aa6ae-dc5f-41ce-8985-217d55472ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:44.053662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aa6ae-dc5f-41ce-8985-217d55472ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:44.054426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e416e11281f4844ac68829d8bf24efb', 'request_id': 'req-8e1862b8-a708-49f4-9840-d39fd87c3f26'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.073484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e416e11281f4844ac68829d8bf24efb', 'request_id': 'req-8e1862b8-a708-49f4-9840-d39fd87c3f26'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.087163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-be1aa6ae-dc5f-41ce-8985-217d55472ec9 None None] MFA Rules not processed for user `423ac00601f84e3d9c6cc6ee20eee6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:44.087163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-be1aa6ae-dc5f-41ce-8985-217d55472ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:44.171898 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e416e11281f4844ac68829d8bf24efb', 'request_id': 'req-8e1862b8-a708-49f4-9840-d39fd87c3f26'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.188616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] The token cache is being invalidate because project 5e416e11281f4844ac68829d8bf24efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:44.189004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.193151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.200056 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 869/1723] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:43 2022] DELETE /identity/v3/projects/5e416e11281f4844ac68829d8bf24efb => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:44.200056 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:44.201454 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:44.240670 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 855/1724] 10.222.0.60 () {58 vars in 1058 bytes} [Thu Aug 4 02:36:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:44.242993 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb808f76-378a-4754-a47f-46126b9b3fee None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:44.243483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb808f76-378a-4754-a47f-46126b9b3fee None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:44.243987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb808f76-378a-4754-a47f-46126b9b3fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:44.277561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-fb808f76-378a-4754-a47f-46126b9b3fee None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:44.277561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-fb808f76-378a-4754-a47f-46126b9b3fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:44.363565 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1862b8-a708-49f4-9840-d39fd87c3f26 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:44.376714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e84f7-2922-436b-9425-d9df284da073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:44.377169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e84f7-2922-436b-9425-d9df284da073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:44.377455 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e84f7-2922-436b-9425-d9df284da073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:44.377734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e84f7-2922-436b-9425-d9df284da073 admin admin] PATH_INFO: `/v3/projects/d9d69c03fcc34c259f2d3bbd9d5da94c/users/f0ca79f038f54818b781f6bb15af24a7/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:44.412183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e84f7-2922-436b-9425-d9df284da073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d69c03fcc34c259f2d3bbd9d5da94c, user_id=f0ca79f038f54818b781f6bb15af24a7, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:44.414946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e84f7-2922-436b-9425-d9df284da073 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:44.447077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 856/1725] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:44.458372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb808f76-378a-4754-a47f-46126b9b3fee None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:44.482374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb808f76-378a-4754-a47f-46126b9b3fee None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:44.492912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba9af8-aba2-479b-a24e-dee59abeee3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '423ac00601f84e3d9c6cc6ee20eee6ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:44.494851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba9af8-aba2-479b-a24e-dee59abeee3f service placement] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:44.496285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba9af8-aba2-479b-a24e-dee59abeee3f service placement] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:44.497917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba9af8-aba2-479b-a24e-dee59abeee3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:44.500377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 870/1726] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:44 2022] PUT /identity/v3/projects/d9d69c03fcc34c259f2d3bbd9d5da94c/users/f0ca79f038f54818b781f6bb15af24a7/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:44.501786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812b2f8-d258-411e-b858-9244d678e6e8 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:44.502191 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812b2f8-d258-411e-b858-9244d678e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:44.502480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812b2f8-d258-411e-b858-9244d678e6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:44.504864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-95ba9af8-aba2-479b-a24e-dee59abeee3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:44.536649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba9af8-aba2-479b-a24e-dee59abeee3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:44.539783 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba9af8-aba2-479b-a24e-dee59abeee3f service placement] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:44.549941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-9812b2f8-d258-411e-b858-9244d678e6e8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:44.551254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9812b2f8-d258-411e-b858-9244d678e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:44.559164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 857/1727] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:44.559164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba9af8-aba2-479b-a24e-dee59abeee3f service placement] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:44.575151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba9af8-aba2-479b-a24e-dee59abeee3f service placement] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:44.579936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:44.731862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 871/1728] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:44.738907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812b2f8-d258-411e-b858-9244d678e6e8 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:44.760929 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812b2f8-d258-411e-b858-9244d678e6e8 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:44.773615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1999-2056-462d-b698-3ab4bb648571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:44.774366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1999-2056-462d-b698-3ab4bb648571 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:44.774743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1999-2056-462d-b698-3ab4bb648571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:44.775134 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1999-2056-462d-b698-3ab4bb648571 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:44.776440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b1999-2056-462d-b698-3ab4bb648571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:44.779288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b1999-2056-462d-b698-3ab4bb648571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:44.782249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b1999-2056-462d-b698-3ab4bb648571 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:44.797722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c052d39-eee7-4ab1-a626-403aaedce338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:44.798479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c052d39-eee7-4ab1-a626-403aaedce338 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:44.799048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c052d39-eee7-4ab1-a626-403aaedce338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:44.799402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c052d39-eee7-4ab1-a626-403aaedce338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:44.804167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c052d39-eee7-4ab1-a626-403aaedce338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:44.804654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 872/1729] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:44.806767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c052d39-eee7-4ab1-a626-403aaedce338 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:44.811863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1999-2056-462d-b698-3ab4bb648571 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:44.821674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 858/1730] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:44.826017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c052d39-eee7-4ab1-a626-403aaedce338 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:44.839908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1999-2056-462d-b698-3ab4bb648571 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:44.846554 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407742e-ab9d-4401-b2a1-f0e5d7dbb455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:44.849137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407742e-ab9d-4401-b2a1-f0e5d7dbb455 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:44.849137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407742e-ab9d-4401-b2a1-f0e5d7dbb455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:44.849137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407742e-ab9d-4401-b2a1-f0e5d7dbb455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:44.849137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407742e-ab9d-4401-b2a1-f0e5d7dbb455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:44.853107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407742e-ab9d-4401-b2a1-f0e5d7dbb455 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:44.863614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c052d39-eee7-4ab1-a626-403aaedce338 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:44.889973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79754b3-9a82-45a1-bb69-cedfc89dcf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:44.892157 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79754b3-9a82-45a1-bb69-cedfc89dcf32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:44.893147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79754b3-9a82-45a1-bb69-cedfc89dcf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:44.893960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79754b3-9a82-45a1-bb69-cedfc89dcf32 admin admin] PATH_INFO: `/v3/projects/d9d69c03fcc34c259f2d3bbd9d5da94c/users/f0ca79f038f54818b781f6bb15af24a7/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:44.902309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79754b3-9a82-45a1-bb69-cedfc89dcf32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d69c03fcc34c259f2d3bbd9d5da94c, user_id=f0ca79f038f54818b781f6bb15af24a7, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:44.908568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79754b3-9a82-45a1-bb69-cedfc89dcf32 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:44.947435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 859/1731] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:44 2022] PUT /identity/v3/projects/d9d69c03fcc34c259f2d3bbd9d5da94c/users/f0ca79f038f54818b781f6bb15af24a7/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:44.968736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd4295-2211-4194-84c7-5ed21cb32d19 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:44.968736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd4295-2211-4194-84c7-5ed21cb32d19 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:44.968736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd4295-2211-4194-84c7-5ed21cb32d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.021230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 873/1732] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:44 2022] POST /identity/v3/projects => generated 365 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:45.023956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722ac5e-aa0a-475c-879e-783f4bbb065f None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.024746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722ac5e-aa0a-475c-879e-783f4bbb065f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.026012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722ac5e-aa0a-475c-879e-783f4bbb065f None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.049290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-ccdd4295-2211-4194-84c7-5ed21cb32d19 None None] MFA Rules not processed for user `f0ca79f038f54818b781f6bb15af24a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:45.053263 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ccdd4295-2211-4194-84c7-5ed21cb32d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:45.062148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 874/1733] 10.222.0.60 () {54 vars in 912 bytes} [Thu Aug 4 02:36:45 2022] GET /identity => generated 270 bytes in 39 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:45.063317 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722ac5e-aa0a-475c-879e-783f4bbb065f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:45.197311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722ac5e-aa0a-475c-879e-783f4bbb065f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:45.210171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1855d-04eb-41df-a601-148ca59ab082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:45.210878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1855d-04eb-41df-a601-148ca59ab082 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.211170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1855d-04eb-41df-a601-148ca59ab082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.211587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1855d-04eb-41df-a601-148ca59ab082 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.212353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1855d-04eb-41df-a601-148ca59ab082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:45.214982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1855d-04eb-41df-a601-148ca59ab082 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:45.290744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 860/1734] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:45.292304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e68f0d-c853-49a4-95dd-2a5a3576e40e None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.292676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e68f0d-c853-49a4-95dd-2a5a3576e40e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.293428 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e68f0d-c853-49a4-95dd-2a5a3576e40e None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.295128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 861/1735] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:45.297990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c161d8-b065-4e29-9810-1657d590bde5 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.297990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c161d8-b065-4e29-9810-1657d590bde5 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.298665 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c161d8-b065-4e29-9810-1657d590bde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.322932 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 875/1736] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:45 2022] POST /identity/v3/users => generated 283 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:45.324100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1855d-04eb-41df-a601-148ca59ab082 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:45.336497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-62c1855d-04eb-41df-a601-148ca59ab082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:45.392483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-51c161d8-b065-4e29-9810-1657d590bde5 None None] MFA Rules not processed for user `1ac08ad57a8e442d89ba1881abf43cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:45.394146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-51c161d8-b065-4e29-9810-1657d590bde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:45.520978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1855d-04eb-41df-a601-148ca59ab082 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:45.528436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:45.532573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d274a-c86c-40fd-a934-47b641510cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:45.533234 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d274a-c86c-40fd-a934-47b641510cfb service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.533521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d274a-c86c-40fd-a934-47b641510cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.533800 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d274a-c86c-40fd-a934-47b641510cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.550853 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d274a-c86c-40fd-a934-47b641510cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:45.553436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 862/1737] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:36:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:45.554442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c161d8-b065-4e29-9810-1657d590bde5 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:45.554803 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d274a-c86c-40fd-a934-47b641510cfb service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:45.579973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c161d8-b065-4e29-9810-1657d590bde5 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:45.589435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 876/1738] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:45.592119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d274a-c86c-40fd-a934-47b641510cfb service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:45.596711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-748d274a-c86c-40fd-a934-47b641510cfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:45.599931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9bef6-0888-4ca7-a656-9919d119115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:45.600928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9bef6-0888-4ca7-a656-9919d119115c admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.600928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9bef6-0888-4ca7-a656-9919d119115c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.601229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9bef6-0888-4ca7-a656-9919d119115c admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.601856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9bef6-0888-4ca7-a656-9919d119115c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:45.603632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9bef6-0888-4ca7-a656-9919d119115c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:45.631476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d274a-c86c-40fd-a934-47b641510cfb service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:45.638590 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 863/1739] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:45.639919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a6eb2-d805-4a64-b92c-90a49a066e8a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.640428 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a6eb2-d805-4a64-b92c-90a49a066e8a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.643067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a6eb2-d805-4a64-b92c-90a49a066e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.643679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:45.644572 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.645043 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.645515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] PATH_INFO: `/v3/users/e1a59e25a7434ad7bf394340fa810c58` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.648506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a59e25a7434ad7bf394340fa810c58)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:45.651138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:45.713968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c58a6eb2-d805-4a64-b92c-90a49a066e8a None None] MFA Rules not processed for user `423ac00601f84e3d9c6cc6ee20eee6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:45.715460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c58a6eb2-d805-4a64-b92c-90a49a066e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:45.850937 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 864/1740] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:36:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:45.853163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a6eb2-d805-4a64-b92c-90a49a066e8a None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:45.856809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c58a6eb2-d805-4a64-b92c-90a49a066e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:45.882177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a6eb2-d805-4a64-b92c-90a49a066e8a None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:45.901098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4111e78-919c-401e-91f7-9376329cdb2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:45.903203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4111e78-919c-401e-91f7-9376329cdb2a service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.903980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a59e25a7434ad7bf394340fa810c58'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:45.905880 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4111e78-919c-401e-91f7-9376329cdb2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.906590 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4111e78-919c-401e-91f7-9376329cdb2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.926904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4111e78-919c-401e-91f7-9376329cdb2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:45.938462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4111e78-919c-401e-91f7-9376329cdb2a service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:45.949625 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a59e25a7434ad7bf394340fa810c58'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:45.968910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a59e25a7434ad7bf394340fa810c58'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:45.978210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 865/1741] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:45.981189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4111e78-919c-401e-91f7-9376329cdb2a service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:45.991714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a59e25a7434ad7bf394340fa810c58'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:46.000826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4111e78-919c-401e-91f7-9376329cdb2a service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.008396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bead30e-3b86-4ff5-a3f7-76b985e78117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.009396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bead30e-3b86-4ff5-a3f7-76b985e78117 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.009798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bead30e-3b86-4ff5-a3f7-76b985e78117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.010212 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bead30e-3b86-4ff5-a3f7-76b985e78117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.011262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bead30e-3b86-4ff5-a3f7-76b985e78117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.013339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bead30e-3b86-4ff5-a3f7-76b985e78117 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.027237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 866/1742] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:46.028683 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bead30e-3b86-4ff5-a3f7-76b985e78117 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.030538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5bead30e-3b86-4ff5-a3f7-76b985e78117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.047521 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bead30e-3b86-4ff5-a3f7-76b985e78117 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.063129 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.063878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.064232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.064578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] PATH_INFO: `/v3/users/b6f1d2749e6b47fcba4951a5df7518bf` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.065889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f1d2749e6b47fcba4951a5df7518bf)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.075393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.149131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a59e25a7434ad7bf394340fa810c58'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:46.160963 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 877/1743] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:45 2022] DELETE /identity/v3/users/e1a59e25a7434ad7bf394340fa810c58 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:46.161952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.176960 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.361124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:46.368360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f1d2749e6b47fcba4951a5df7518bf'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:46.387715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f20e5-135e-4f9e-887f-54af1053d016 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.403490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b27f4e-2fc0-468a-8038-0fcb052660e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '423ac00601f84e3d9c6cc6ee20eee6ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.404154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b27f4e-2fc0-468a-8038-0fcb052660e4 service placement] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.404523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b27f4e-2fc0-468a-8038-0fcb052660e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.404749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b27f4e-2fc0-468a-8038-0fcb052660e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.409916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-65b27f4e-2fc0-468a-8038-0fcb052660e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.436327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b27f4e-2fc0-468a-8038-0fcb052660e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.438590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b27f4e-2fc0-468a-8038-0fcb052660e4 service placement] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.453623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f1d2749e6b47fcba4951a5df7518bf'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:46.463308 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f1d2749e6b47fcba4951a5df7518bf'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:46.464420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f1d2749e6b47fcba4951a5df7518bf'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:46.467261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f1d2749e6b47fcba4951a5df7518bf'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:46.471189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 878/1744] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:46.474015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b27f4e-2fc0-468a-8038-0fcb052660e4 service placement] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.478101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-65b27f4e-2fc0-468a-8038-0fcb052660e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.505389 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 867/1745] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:46 2022] DELETE /identity/v3/users/b6f1d2749e6b47fcba4951a5df7518bf => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:46.506160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.510219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.620076 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b27f4e-2fc0-468a-8038-0fcb052660e4 service placement] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.641823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642946f6-fd23-4481-b691-2859fc66f4e0 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.653809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e671cd0-a23f-426f-920d-3966d1926b08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.654844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e671cd0-a23f-426f-920d-3966d1926b08 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.655396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e671cd0-a23f-426f-920d-3966d1926b08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.656197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e671cd0-a23f-426f-920d-3966d1926b08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.660815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-3e671cd0-a23f-426f-920d-3966d1926b08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.665808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:46.776447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a66cfb-abe0-459b-9f87-79b9a88026d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.779791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a66cfb-abe0-459b-9f87-79b9a88026d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.779791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a66cfb-abe0-459b-9f87-79b9a88026d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.779791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a66cfb-abe0-459b-9f87-79b9a88026d4 admin admin] PATH_INFO: `/v3/projects/483bcf92aca649f1b1e5d2f9a451b8f4/users/9204da722072476c89c4eb2e13a124a0/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.808828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a66cfb-abe0-459b-9f87-79b9a88026d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=483bcf92aca649f1b1e5d2f9a451b8f4, user_id=9204da722072476c89c4eb2e13a124a0, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.813786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a66cfb-abe0-459b-9f87-79b9a88026d4 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.835007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e671cd0-a23f-426f-920d-3966d1926b08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.836900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e671cd0-a23f-426f-920d-3966d1926b08 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.875596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 868/1746] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:46.901409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17491662-97f0-431c-a30f-0403eccc01ff None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.901409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17491662-97f0-431c-a30f-0403eccc01ff None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.901409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17491662-97f0-431c-a30f-0403eccc01ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.926219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-17491662-97f0-431c-a30f-0403eccc01ff None None] MFA Rules not processed for user `99068d55e19e4b3cbf9197ca46d86fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:46.928525 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-17491662-97f0-431c-a30f-0403eccc01ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.941763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 879/1747] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:46 2022] PUT /identity/v3/projects/483bcf92aca649f1b1e5d2f9a451b8f4/users/9204da722072476c89c4eb2e13a124a0/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:46.958852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a2b54-7cc3-41f0-9038-125e2a1fba7c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.959977 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a2b54-7cc3-41f0-9038-125e2a1fba7c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.962242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a2b54-7cc3-41f0-9038-125e2a1fba7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.008412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-eb8a2b54-7cc3-41f0-9038-125e2a1fba7c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:47.009824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-eb8a2b54-7cc3-41f0-9038-125e2a1fba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.120374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 869/1748] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:47.121473 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17491662-97f0-431c-a30f-0403eccc01ff None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:47.135074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-17491662-97f0-431c-a30f-0403eccc01ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.165949 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 880/1749] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:47.172280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c6cdc-3d11-4867-839a-13daf8dcb80c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.172280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c6cdc-3d11-4867-839a-13daf8dcb80c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.172280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c6cdc-3d11-4867-839a-13daf8dcb80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.172764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17491662-97f0-431c-a30f-0403eccc01ff None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:47.186979 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:47.187738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.188025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.188307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] PATH_INFO: `/v3/projects/e99d6872769b4e21a53750edd6a5d803` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.196380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99d6872769b4e21a53750edd6a5d803)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:47.202516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:47.246319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-819c6cdc-3d11-4867-839a-13daf8dcb80c None None] MFA Rules not processed for user `9204da722072476c89c4eb2e13a124a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:47.252293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-819c6cdc-3d11-4867-839a-13daf8dcb80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.382657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99d6872769b4e21a53750edd6a5d803', 'request_id': 'req-082db9a3-e00a-439d-9da6-e91038aff436'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.484534 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99d6872769b4e21a53750edd6a5d803', 'request_id': 'req-082db9a3-e00a-439d-9da6-e91038aff436'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.501799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99d6872769b4e21a53750edd6a5d803', 'request_id': 'req-082db9a3-e00a-439d-9da6-e91038aff436'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.516738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 881/1750] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:47.517688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c6cdc-3d11-4867-839a-13daf8dcb80c None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:47.521933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-819c6cdc-3d11-4867-839a-13daf8dcb80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.531104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] The token cache is being invalidate because project e99d6872769b4e21a53750edd6a5d803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:47.531596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.532401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.537883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 870/1751] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:47 2022] DELETE /identity/v3/projects/e99d6872769b4e21a53750edd6a5d803 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:47.537883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:47.537883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.650952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082db9a3-e00a-439d-9da6-e91038aff436 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:47.658373 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef05741-c1ec-43fd-bba0-8dab1ae55bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:47.659348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef05741-c1ec-43fd-bba0-8dab1ae55bee service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.660986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef05741-c1ec-43fd-bba0-8dab1ae55bee service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.661498 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef05741-c1ec-43fd-bba0-8dab1ae55bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.664648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-eef05741-c1ec-43fd-bba0-8dab1ae55bee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.666251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c6cdc-3d11-4867-839a-13daf8dcb80c None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:47.787511 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef05741-c1ec-43fd-bba0-8dab1ae55bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:47.789037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef05741-c1ec-43fd-bba0-8dab1ae55bee service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:47.807252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 871/1752] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:47.809107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef05741-c1ec-43fd-bba0-8dab1ae55bee service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:47.810001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-eef05741-c1ec-43fd-bba0-8dab1ae55bee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.876414 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5133ef5-fe3d-452c-be15-7830ea365904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:47.878407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133ef5-fe3d-452c-be15-7830ea365904 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.881720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133ef5-fe3d-452c-be15-7830ea365904 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.883774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133ef5-fe3d-452c-be15-7830ea365904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.891667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d5133ef5-fe3d-452c-be15-7830ea365904 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.066880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5133ef5-fe3d-452c-be15-7830ea365904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.069188 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5133ef5-fe3d-452c-be15-7830ea365904 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.074943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef05741-c1ec-43fd-bba0-8dab1ae55bee service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.096944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 882/1753] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:48.099916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5133ef5-fe3d-452c-be15-7830ea365904 service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.104677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d5133ef5-fe3d-452c-be15-7830ea365904 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.120137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5133ef5-fe3d-452c-be15-7830ea365904 service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.123355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256a879-4b14-4a38-9e70-4323b51d09be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '423ac00601f84e3d9c6cc6ee20eee6ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.125330 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a879-4b14-4a38-9e70-4323b51d09be service placement] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.125814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a879-4b14-4a38-9e70-4323b51d09be service placement] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.126267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a3d38-ddac-41be-814e-63347fcb9b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.126403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a879-4b14-4a38-9e70-4323b51d09be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.128227 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3d38-ddac-41be-814e-63347fcb9b15 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.128621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3d38-ddac-41be-814e-63347fcb9b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.129083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3d38-ddac-41be-814e-63347fcb9b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.129978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a3d38-ddac-41be-814e-63347fcb9b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.132551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a3d38-ddac-41be-814e-63347fcb9b15 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.139066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8256a879-4b14-4a38-9e70-4323b51d09be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.211935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256a879-4b14-4a38-9e70-4323b51d09be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.222979 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256a879-4b14-4a38-9e70-4323b51d09be service placement] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.268372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 883/1754] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:48 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:48.269267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a3d38-ddac-41be-814e-63347fcb9b15 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.275223 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d37a3d38-ddac-41be-814e-63347fcb9b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.290410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 872/1755] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:48.293226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef3363-c1fa-4459-af1e-069141223387 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.293226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef3363-c1fa-4459-af1e-069141223387 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.294238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef3363-c1fa-4459-af1e-069141223387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.334006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:48.411560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-22ef3363-c1fa-4459-af1e-069141223387 None None] MFA Rules not processed for user `2e47969dca184aec92e620fcd53d6a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:48.418833 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-22ef3363-c1fa-4459-af1e-069141223387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.506996 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a3d38-ddac-41be-814e-63347fcb9b15 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.522193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd5d6a-c8f1-48cd-a88c-075b5ee359e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.526321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd5d6a-c8f1-48cd-a88c-075b5ee359e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.526676 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd5d6a-c8f1-48cd-a88c-075b5ee359e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.526963 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd5d6a-c8f1-48cd-a88c-075b5ee359e3 admin admin] PATH_INFO: `/v3/users/ec17e3dfa63047109f321c2c207c4dc5` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.528961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd5d6a-c8f1-48cd-a88c-075b5ee359e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec17e3dfa63047109f321c2c207c4dc5)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.534626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd5d6a-c8f1-48cd-a88c-075b5ee359e3 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.560821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:48.679463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 873/1756] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:48.684233 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef3363-c1fa-4459-af1e-069141223387 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.705871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef3363-c1fa-4459-af1e-069141223387 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.719028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49143f-c146-42be-b093-f8a93d0f25df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.719671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49143f-c146-42be-b093-f8a93d0f25df admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.720495 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49143f-c146-42be-b093-f8a93d0f25df admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.720495 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49143f-c146-42be-b093-f8a93d0f25df admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.721003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49143f-c146-42be-b093-f8a93d0f25df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.723277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49143f-c146-42be-b093-f8a93d0f25df admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.868910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-88cd5d6a-c8f1-48cd-a88c-075b5ee359e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec17e3dfa63047109f321c2c207c4dc5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.880749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 874/1757] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:48 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:48.880749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d51dd-9a82-42a8-919b-988483bf0106 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.880749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d51dd-9a82-42a8-919b-988483bf0106 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.882950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d51dd-9a82-42a8-919b-988483bf0106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.905716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-88cd5d6a-c8f1-48cd-a88c-075b5ee359e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec17e3dfa63047109f321c2c207c4dc5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.906411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-88cd5d6a-c8f1-48cd-a88c-075b5ee359e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec17e3dfa63047109f321c2c207c4dc5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.921595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-88cd5d6a-c8f1-48cd-a88c-075b5ee359e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec17e3dfa63047109f321c2c207c4dc5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.942866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-093d51dd-9a82-42a8-919b-988483bf0106 None None] MFA Rules not processed for user `64be537a50754c838554d1a2e0a4177a`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:48.944149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-093d51dd-9a82-42a8-919b-988483bf0106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.017094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-88cd5d6a-c8f1-48cd-a88c-075b5ee359e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec17e3dfa63047109f321c2c207c4dc5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.030866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 884/1758] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:48 2022] DELETE /identity/v3/users/ec17e3dfa63047109f321c2c207c4dc5 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:49.030866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a97df-1fdf-44aa-867a-6bc1d2a48f77 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.030866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a97df-1fdf-44aa-867a-6bc1d2a48f77 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.030866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a97df-1fdf-44aa-867a-6bc1d2a48f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.101300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 875/1759] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:49.103898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d51dd-9a82-42a8-919b-988483bf0106 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.109901 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-3c9a97df-1fdf-44aa-867a-6bc1d2a48f77 None None] MFA Rules not processed for user `2e47969dca184aec92e620fcd53d6a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:49.111235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-093d51dd-9a82-42a8-919b-988483bf0106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.112037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3c9a97df-1fdf-44aa-867a-6bc1d2a48f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.133690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d51dd-9a82-42a8-919b-988483bf0106 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.252788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 885/1760] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:49.254190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a97df-1fdf-44aa-867a-6bc1d2a48f77 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.260961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3c9a97df-1fdf-44aa-867a-6bc1d2a48f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.274168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.274893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.275180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.275460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] PATH_INFO: `/v3/projects/67ba82a0b0534421b903b2688ed99b91` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.281594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ba82a0b0534421b903b2688ed99b91)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.283631 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.382753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a97df-1fdf-44aa-867a-6bc1d2a48f77 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.390743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22077b1d-b9da-4c5b-bbdd-a515f1c29209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.391832 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22077b1d-b9da-4c5b-bbdd-a515f1c29209 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.392336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22077b1d-b9da-4c5b-bbdd-a515f1c29209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.392828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22077b1d-b9da-4c5b-bbdd-a515f1c29209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.394823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22077b1d-b9da-4c5b-bbdd-a515f1c29209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.397062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22077b1d-b9da-4c5b-bbdd-a515f1c29209 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.415709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 886/1761] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:49.416453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22077b1d-b9da-4c5b-bbdd-a515f1c29209 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.419539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-22077b1d-b9da-4c5b-bbdd-a515f1c29209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.465051 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ba82a0b0534421b903b2688ed99b91', 'request_id': 'req-da9a825d-3c2e-4487-91b7-6a98d99a2268'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.555560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ba82a0b0534421b903b2688ed99b91', 'request_id': 'req-da9a825d-3c2e-4487-91b7-6a98d99a2268'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.562701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ba82a0b0534421b903b2688ed99b91', 'request_id': 'req-da9a825d-3c2e-4487-91b7-6a98d99a2268'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.566566 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22077b1d-b9da-4c5b-bbdd-a515f1c29209 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.594448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] The token cache is being invalidate because project 67ba82a0b0534421b903b2688ed99b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:49.594448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.594448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.596846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 876/1762] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:49 2022] DELETE /identity/v3/projects/67ba82a0b0534421b903b2688ed99b91 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:49.597746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.611728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.682009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94005b-807e-42df-81a6-cb61e742987a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.682931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94005b-807e-42df-81a6-cb61e742987a service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.683293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94005b-807e-42df-81a6-cb61e742987a service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.683681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94005b-807e-42df-81a6-cb61e742987a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.687210 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-be94005b-807e-42df-81a6-cb61e742987a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.744974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a825d-3c2e-4487-91b7-6a98d99a2268 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.751753 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bc9f1-8f18-4bfd-bab3-bd55fefc1f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.752475 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bc9f1-8f18-4bfd-bab3-bd55fefc1f33 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.752840 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bc9f1-8f18-4bfd-bab3-bd55fefc1f33 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.753348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94005b-807e-42df-81a6-cb61e742987a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.753519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bc9f1-8f18-4bfd-bab3-bd55fefc1f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.755192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94005b-807e-42df-81a6-cb61e742987a service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.755905 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-092bc9f1-8f18-4bfd-bab3-bd55fefc1f33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.777417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 887/1763] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:49.778676 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94005b-807e-42df-81a6-cb61e742987a service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.784416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-be94005b-807e-42df-81a6-cb61e742987a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.831558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bc9f1-8f18-4bfd-bab3-bd55fefc1f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.833377 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bc9f1-8f18-4bfd-bab3-bd55fefc1f33 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.846111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 877/1764] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:49.847543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bc9f1-8f18-4bfd-bab3-bd55fefc1f33 service nova] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.849452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-092bc9f1-8f18-4bfd-bab3-bd55fefc1f33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.883849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:49.955708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bc9f1-8f18-4bfd-bab3-bd55fefc1f33 service nova] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.967633 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.968363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.968724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.969068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] PATH_INFO: `/v3/projects/b09a85563b044182be8ac0a4e6f8f93a` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.971192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09a85563b044182be8ac0a4e6f8f93a)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.976391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:50.040107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94005b-807e-42df-81a6-cb61e742987a service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:50.055965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bacc50-eacc-45f9-ae08-d1a1a553ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:50.056667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bacc50-eacc-45f9-ae08-d1a1a553ce48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:50.056945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bacc50-eacc-45f9-ae08-d1a1a553ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:50.057223 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bacc50-eacc-45f9-ae08-d1a1a553ce48 admin admin] PATH_INFO: `/v3/projects/8ca2dad61d8347a1a8ae4d5332c00981/users/3d1d537ea42f4490a61cb7c9861abcd2/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:50.093664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bacc50-eacc-45f9-ae08-d1a1a553ce48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca2dad61d8347a1a8ae4d5332c00981, user_id=3d1d537ea42f4490a61cb7c9861abcd2, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:50.096987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bacc50-eacc-45f9-ae08-d1a1a553ce48 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:50.289966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 888/1765] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:49 2022] PUT /identity/v3/projects/8ca2dad61d8347a1a8ae4d5332c00981/users/3d1d537ea42f4490a61cb7c9861abcd2/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:50.291075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bacc50-eacc-45f9-ae08-d1a1a553ce48 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:50.297412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-08bacc50-eacc-45f9-ae08-d1a1a553ce48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:50.355083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09a85563b044182be8ac0a4e6f8f93a', 'request_id': 'req-09996be6-12f7-435b-aa1b-0909ea8136fc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.370261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:50.475061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09a85563b044182be8ac0a4e6f8f93a', 'request_id': 'req-09996be6-12f7-435b-aa1b-0909ea8136fc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.486297 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09a85563b044182be8ac0a4e6f8f93a', 'request_id': 'req-09996be6-12f7-435b-aa1b-0909ea8136fc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.522019 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] The token cache is being invalidate because project b09a85563b044182be8ac0a4e6f8f93a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:50.523213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.525303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.528077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 878/1766] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:49 2022] DELETE /identity/v3/projects/b09a85563b044182be8ac0a4e6f8f93a => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:50.532922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:50.537130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:50.551520 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bacc50-eacc-45f9-ae08-d1a1a553ce48 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:50.585319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe397664-3127-411a-8441-0ff6e8e8d4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:50.587308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe397664-3127-411a-8441-0ff6e8e8d4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:50.589714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe397664-3127-411a-8441-0ff6e8e8d4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:50.590814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe397664-3127-411a-8441-0ff6e8e8d4eb admin admin] PATH_INFO: `/v3/users/058b2c05646748a1913d201d6ddee1f7` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:50.597006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe397664-3127-411a-8441-0ff6e8e8d4eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=058b2c05646748a1913d201d6ddee1f7)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:50.605891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe397664-3127-411a-8441-0ff6e8e8d4eb admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:50.804457 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09996be6-12f7-435b-aa1b-0909ea8136fc admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:50.817791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaab67a-4b81-4bc9-9168-6b0f6cae82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:50.822733 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaab67a-4b81-4bc9-9168-6b0f6cae82f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:50.823200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaab67a-4b81-4bc9-9168-6b0f6cae82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:50.824450 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaab67a-4b81-4bc9-9168-6b0f6cae82f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:50.825336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaab67a-4b81-4bc9-9168-6b0f6cae82f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:50.828817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaab67a-4b81-4bc9-9168-6b0f6cae82f2 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:50.853508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 879/1767] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:50.861310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52995324-3598-443f-8fbf-56d86764010e None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:50.863430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52995324-3598-443f-8fbf-56d86764010e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:50.863886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52995324-3598-443f-8fbf-56d86764010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:50.941889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-52995324-3598-443f-8fbf-56d86764010e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:50.945789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-52995324-3598-443f-8fbf-56d86764010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:50.952647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-fe397664-3127-411a-8441-0ff6e8e8d4eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058b2c05646748a1913d201d6ddee1f7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.977590 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 880/1768] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:50.978301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52995324-3598-443f-8fbf-56d86764010e None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:50.996256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-fe397664-3127-411a-8441-0ff6e8e8d4eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058b2c05646748a1913d201d6ddee1f7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.996256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-fe397664-3127-411a-8441-0ff6e8e8d4eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058b2c05646748a1913d201d6ddee1f7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.009009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-fe397664-3127-411a-8441-0ff6e8e8d4eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058b2c05646748a1913d201d6ddee1f7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.016257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52995324-3598-443f-8fbf-56d86764010e None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.048089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5870bf9-6612-4c06-b72b-3ef4e3dd5612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.050715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5870bf9-6612-4c06-b72b-3ef4e3dd5612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.050960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5870bf9-6612-4c06-b72b-3ef4e3dd5612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.051239 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5870bf9-6612-4c06-b72b-3ef4e3dd5612 admin admin] PATH_INFO: `/v3/projects/8ca2dad61d8347a1a8ae4d5332c00981/users/3d1d537ea42f4490a61cb7c9861abcd2/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.060178 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5870bf9-6612-4c06-b72b-3ef4e3dd5612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca2dad61d8347a1a8ae4d5332c00981, user_id=3d1d537ea42f4490a61cb7c9861abcd2, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.067165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5870bf9-6612-4c06-b72b-3ef4e3dd5612 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.090691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 881/1769] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:50 2022] PUT /identity/v3/projects/8ca2dad61d8347a1a8ae4d5332c00981/users/3d1d537ea42f4490a61cb7c9861abcd2/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:51.093457 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d339f-f0c4-41ea-b19a-598bf9ea5bdb None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.095743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d339f-f0c4-41ea-b19a-598bf9ea5bdb None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.096344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d339f-f0c4-41ea-b19a-598bf9ea5bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.137903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-881d339f-f0c4-41ea-b19a-598bf9ea5bdb None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:51.139685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-881d339f-f0c4-41ea-b19a-598bf9ea5bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:51.173589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-fe397664-3127-411a-8441-0ff6e8e8d4eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058b2c05646748a1913d201d6ddee1f7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.183010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 889/1770] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:50 2022] DELETE /identity/v3/users/058b2c05646748a1913d201d6ddee1f7 => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:51.183010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32e39a-dfbe-47a6-b3a4-2c27688a5f51 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.183010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32e39a-dfbe-47a6-b3a4-2c27688a5f51 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.183010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32e39a-dfbe-47a6-b3a4-2c27688a5f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.245029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-df32e39a-dfbe-47a6-b3a4-2c27688a5f51 None None] MFA Rules not processed for user `3d1d537ea42f4490a61cb7c9861abcd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:51.246260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-df32e39a-dfbe-47a6-b3a4-2c27688a5f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:51.299364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 882/1771] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:51.304173 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d339f-f0c4-41ea-b19a-598bf9ea5bdb None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.335317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d339f-f0c4-41ea-b19a-598bf9ea5bdb None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.393496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:51.458683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 890/1772] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:51.479575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32e39a-dfbe-47a6-b3a4-2c27688a5f51 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.481006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-df32e39a-dfbe-47a6-b3a4-2c27688a5f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:51.572375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a503a8f-fa68-48f1-aad1-e77f77c4182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.573037 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a503a8f-fa68-48f1-aad1-e77f77c4182e admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.573330 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a503a8f-fa68-48f1-aad1-e77f77c4182e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.573617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a503a8f-fa68-48f1-aad1-e77f77c4182e admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.574324 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a503a8f-fa68-48f1-aad1-e77f77c4182e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:51.574678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a503a8f-fa68-48f1-aad1-e77f77c4182e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.591188 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a503a8f-fa68-48f1-aad1-e77f77c4182e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.659077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 883/1773] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:51.660130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a503a8f-fa68-48f1-aad1-e77f77c4182e admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.663115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32e39a-dfbe-47a6-b3a4-2c27688a5f51 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.677045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90055b8-f29c-40e3-a3e5-383d8087457b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.682921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90055b8-f29c-40e3-a3e5-383d8087457b service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.682921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90055b8-f29c-40e3-a3e5-383d8087457b service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.682921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90055b8-f29c-40e3-a3e5-383d8087457b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.696059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a503a8f-fa68-48f1-aad1-e77f77c4182e admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.732555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e5045-4371-42d4-8ea6-e5bac95f267d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.733627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5045-4371-42d4-8ea6-e5bac95f267d admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.734014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5045-4371-42d4-8ea6-e5bac95f267d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.734932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5045-4371-42d4-8ea6-e5bac95f267d admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.735696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e5045-4371-42d4-8ea6-e5bac95f267d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.737713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e5045-4371-42d4-8ea6-e5bac95f267d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.761251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90055b8-f29c-40e3-a3e5-383d8087457b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.770432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90055b8-f29c-40e3-a3e5-383d8087457b service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.853644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 891/1774] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:51.871954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a8a1e-b788-43c3-a32b-e9ea51e3446d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.872495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a8a1e-b788-43c3-a32b-e9ea51e3446d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.876060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a8a1e-b788-43c3-a32b-e9ea51e3446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.939387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 884/1775] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:51 2022] POST /identity/v3/projects => generated 375 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:51.940343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e5045-4371-42d4-8ea6-e5bac95f267d admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.958796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-3c9a8a1e-b788-43c3-a32b-e9ea51e3446d None None] MFA Rules not processed for user `2e47969dca184aec92e620fcd53d6a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:51.965060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3c9a8a1e-b788-43c3-a32b-e9ea51e3446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:52.136041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e5045-4371-42d4-8ea6-e5bac95f267d admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:52.150897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ff428-e484-4e5a-bad2-471d84a30302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:52.153705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ff428-e484-4e5a-bad2-471d84a30302 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:52.153705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ff428-e484-4e5a-bad2-471d84a30302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:52.153705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ff428-e484-4e5a-bad2-471d84a30302 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:52.153705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ff428-e484-4e5a-bad2-471d84a30302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:52.155833 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ff428-e484-4e5a-bad2-471d84a30302 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:52.200295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 892/1776] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:52.269301 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a8a1e-b788-43c3-a32b-e9ea51e3446d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:52.301630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 885/1777] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:51 2022] POST /identity/v3/users => generated 288 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:52.305578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ff428-e484-4e5a-bad2-471d84a30302 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:52.323595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ff428-e484-4e5a-bad2-471d84a30302 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:52.331645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70031e1a-b7de-47aa-bd75-088a881887e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:52.333819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70031e1a-b7de-47aa-bd75-088a881887e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:52.333819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70031e1a-b7de-47aa-bd75-088a881887e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:52.333819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70031e1a-b7de-47aa-bd75-088a881887e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:52.334186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70031e1a-b7de-47aa-bd75-088a881887e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:52.335920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70031e1a-b7de-47aa-bd75-088a881887e0 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:52.390381 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 886/1778] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:52.391467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70031e1a-b7de-47aa-bd75-088a881887e0 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:52.423870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70031e1a-b7de-47aa-bd75-088a881887e0 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:52.447719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaafb7-cf73-4eb1-841d-c4252b3b0ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:52.448375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaafb7-cf73-4eb1-841d-c4252b3b0ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:52.448661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaafb7-cf73-4eb1-841d-c4252b3b0ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:52.449053 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaafb7-cf73-4eb1-841d-c4252b3b0ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:52.449651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eaafb7-cf73-4eb1-841d-c4252b3b0ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:52.458887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eaafb7-cf73-4eb1-841d-c4252b3b0ce4 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:52.484801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a8a1e-b788-43c3-a32b-e9ea51e3446d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:52.485986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 887/1779] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:52.494080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaafb7-cf73-4eb1-841d-c4252b3b0ce4 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:52.499333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d178410-28d3-4401-a06c-0c45be063c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:52.504010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d178410-28d3-4401-a06c-0c45be063c41 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:52.505654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d178410-28d3-4401-a06c-0c45be063c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:52.506736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d178410-28d3-4401-a06c-0c45be063c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:52.516820 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8d178410-28d3-4401-a06c-0c45be063c41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:52.524722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaafb7-cf73-4eb1-841d-c4252b3b0ce4 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:52.542914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd48e12-1e9f-4624-9acc-90e3bab1b59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:52.562725 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd48e12-1e9f-4624-9acc-90e3bab1b59d admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:52.563060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd48e12-1e9f-4624-9acc-90e3bab1b59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:52.563965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd48e12-1e9f-4624-9acc-90e3bab1b59d admin admin] PATH_INFO: `/v3/projects/6df40c69575b408db6795130f3149754/users/618a72a2b0e14df4a7a49431af28aa83/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:52.643643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd48e12-1e9f-4624-9acc-90e3bab1b59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df40c69575b408db6795130f3149754, user_id=618a72a2b0e14df4a7a49431af28aa83, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:52.647196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd48e12-1e9f-4624-9acc-90e3bab1b59d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:52.711013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d178410-28d3-4401-a06c-0c45be063c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:52.712931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d178410-28d3-4401-a06c-0c45be063c41 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:52.725968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 893/1780] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:52.727139 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d178410-28d3-4401-a06c-0c45be063c41 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:52.729168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8d178410-28d3-4401-a06c-0c45be063c41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:52.745148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 888/1781] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:52 2022] PUT /identity/v3/projects/6df40c69575b408db6795130f3149754/users/618a72a2b0e14df4a7a49431af28aa83/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:52.760768 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8e11a-471f-480d-99ee-7989ddea9235 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:52.761305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8e11a-471f-480d-99ee-7989ddea9235 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:52.761740 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8e11a-471f-480d-99ee-7989ddea9235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:52.774618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d178410-28d3-4401-a06c-0c45be063c41 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:52.839348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8ce8e11a-471f-480d-99ee-7989ddea9235 None None] MFA Rules not processed for user `618a72a2b0e14df4a7a49431af28aa83`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:52.842957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8ce8e11a-471f-480d-99ee-7989ddea9235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:52.985447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:52.994453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:52.994453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:52.994453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] PATH_INFO: `/v3/projects/b7368543eba7463a8958354b054f953c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:52.994453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7368543eba7463a8958354b054f953c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:52.994453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:53.070519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 889/1782] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:53.074004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8e11a-471f-480d-99ee-7989ddea9235 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:53.115496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8e11a-471f-480d-99ee-7989ddea9235 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:53.132829 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ee462-4bbe-40a3-a446-6cc6686ebffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:53.138595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ee462-4bbe-40a3-a446-6cc6686ebffc admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.138595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ee462-4bbe-40a3-a446-6cc6686ebffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.138595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ee462-4bbe-40a3-a446-6cc6686ebffc admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.140820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ee462-4bbe-40a3-a446-6cc6686ebffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:53.143961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ee462-4bbe-40a3-a446-6cc6686ebffc admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:53.155572 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:53.191198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7368543eba7463a8958354b054f953c', 'request_id': 'req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.202705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7368543eba7463a8958354b054f953c', 'request_id': 'req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.275829 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7368543eba7463a8958354b054f953c', 'request_id': 'req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.297809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 890/1783] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:53 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:53.298783 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ee462-4bbe-40a3-a446-6cc6686ebffc admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:53.303190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] The token cache is being invalidate because project b7368543eba7463a8958354b054f953c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:53.309227 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.309227 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.311750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 894/1784] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:52 2022] DELETE /identity/v3/projects/b7368543eba7463a8958354b054f953c => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:53.315839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:53.320310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.418255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf1c3c-d210-4ee7-9d6f-d82e7d6da7a9 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:53.603648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ee462-4bbe-40a3-a446-6cc6686ebffc admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:53.609352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21231ea9-df23-4d01-ac15-23ed24d1657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:53.610085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21231ea9-df23-4d01-ac15-23ed24d1657a admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.610728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21231ea9-df23-4d01-ac15-23ed24d1657a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.611063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21231ea9-df23-4d01-ac15-23ed24d1657a admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.611975 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21231ea9-df23-4d01-ac15-23ed24d1657a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:53.614780 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21231ea9-df23-4d01-ac15-23ed24d1657a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:53.625663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:53.635011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.635011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.635011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] PATH_INFO: `/v3/users/9134be4895364412a818d0df9a37d700` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.635011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9134be4895364412a818d0df9a37d700)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:53.635011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:53.786961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 891/1785] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:53 2022] POST /identity/v3/users => generated 295 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:53.791787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21231ea9-df23-4d01-ac15-23ed24d1657a admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:53.798163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-21231ea9-df23-4d01-ac15-23ed24d1657a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.888864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21231ea9-df23-4d01-ac15-23ed24d1657a admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:53.892645 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9134be4895364412a818d0df9a37d700'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.927175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95501a05-dd03-4d22-b98a-affc9e28c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:53.927813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95501a05-dd03-4d22-b98a-affc9e28c677 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.931852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95501a05-dd03-4d22-b98a-affc9e28c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.933908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95501a05-dd03-4d22-b98a-affc9e28c677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.936927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95501a05-dd03-4d22-b98a-affc9e28c677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:53.940644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95501a05-dd03-4d22-b98a-affc9e28c677 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:53.958855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9134be4895364412a818d0df9a37d700'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.959907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9134be4895364412a818d0df9a37d700'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.984275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9134be4895364412a818d0df9a37d700'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.986559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 892/1786] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:53.987660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95501a05-dd03-4d22-b98a-affc9e28c677 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:53.991329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-95501a05-dd03-4d22-b98a-affc9e28c677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:54.028383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95501a05-dd03-4d22-b98a-affc9e28c677 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.048938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a70bd-fea6-4df0-b8e1-0da51ac655db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.049692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a70bd-fea6-4df0-b8e1-0da51ac655db admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.049992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a70bd-fea6-4df0-b8e1-0da51ac655db admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.050290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a70bd-fea6-4df0-b8e1-0da51ac655db admin admin] PATH_INFO: `/v3/projects/099404abe7834a7a865f6100ef5181cb/users/0d57f450bfb84584b274dfb59326c896/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.063146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9134be4895364412a818d0df9a37d700'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:54.073895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 895/1787] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:53 2022] DELETE /identity/v3/users/9134be4895364412a818d0df9a37d700 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:54.092955 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a70bd-fea6-4df0-b8e1-0da51ac655db admin admin] RBAC: Authorizing `identity:create_grant(project_id=099404abe7834a7a865f6100ef5181cb, user_id=0d57f450bfb84584b274dfb59326c896, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.105918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a70bd-fea6-4df0-b8e1-0da51ac655db admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.213845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 893/1788] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:53 2022] PUT /identity/v3/projects/099404abe7834a7a865f6100ef5181cb/users/0d57f450bfb84584b274dfb59326c896/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:54.214578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.248069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cd556-4b3d-4196-96e7-6dd703bbc1b2 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.251545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cd556-4b3d-4196-96e7-6dd703bbc1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.252063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:54.252928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cd556-4b3d-4196-96e7-6dd703bbc1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.354667 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b05cd556-4b3d-4196-96e7-6dd703bbc1b2 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:54.356002 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b05cd556-4b3d-4196-96e7-6dd703bbc1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:54.384098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c0b34-6dc6-4172-845c-f27b31b2df38 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.544042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6525d4-49d5-4048-9a5a-357089daf109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.544700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6525d4-49d5-4048-9a5a-357089daf109 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.544985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6525d4-49d5-4048-9a5a-357089daf109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.555294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6525d4-49d5-4048-9a5a-357089daf109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.556196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6525d4-49d5-4048-9a5a-357089daf109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.557780 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6525d4-49d5-4048-9a5a-357089daf109 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.558719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 894/1789] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:36:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:54.618253 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cd556-4b3d-4196-96e7-6dd703bbc1b2 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.621681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 896/1790] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:54.641936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cd556-4b3d-4196-96e7-6dd703bbc1b2 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.681347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cbb54-bfb3-4cd2-86bf-c90945c8793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.701755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cbb54-bfb3-4cd2-86bf-c90945c8793f admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.701755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cbb54-bfb3-4cd2-86bf-c90945c8793f admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.701755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cbb54-bfb3-4cd2-86bf-c90945c8793f admin admin] PATH_INFO: `/v3/projects/099404abe7834a7a865f6100ef5181cb/users/0d57f450bfb84584b274dfb59326c896/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.716616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cbb54-bfb3-4cd2-86bf-c90945c8793f admin admin] RBAC: Authorizing `identity:create_grant(project_id=099404abe7834a7a865f6100ef5181cb, user_id=0d57f450bfb84584b274dfb59326c896, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.746021 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cbb54-bfb3-4cd2-86bf-c90945c8793f admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.755031 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:54.801125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 895/1791] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:54 2022] PUT /identity/v3/projects/099404abe7834a7a865f6100ef5181cb/users/0d57f450bfb84584b274dfb59326c896/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:54.811242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c2e52-7db7-4706-9e53-206692663deb None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.811532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c2e52-7db7-4706-9e53-206692663deb None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.811813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c2e52-7db7-4706-9e53-206692663deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.893931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-120c2e52-7db7-4706-9e53-206692663deb None None] MFA Rules not processed for user `0d57f450bfb84584b274dfb59326c896`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:54.897863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-120c2e52-7db7-4706-9e53-206692663deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.087634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cbb54-bfb3-4cd2-86bf-c90945c8793f admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:55.089821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a94cbb54-bfb3-4cd2-86bf-c90945c8793f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.171364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 897/1792] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:55.271469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cbb54-bfb3-4cd2-86bf-c90945c8793f admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:55.278502 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6eda-d4d4-48e4-a2ef-0a3bc3e745fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:55.279151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6eda-d4d4-48e4-a2ef-0a3bc3e745fd service swift] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.279487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6eda-d4d4-48e4-a2ef-0a3bc3e745fd service swift] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.280421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6eda-d4d4-48e4-a2ef-0a3bc3e745fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.401329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baeb6e-11a7-406c-8b0f-47f1b2cc5f22 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.401624 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baeb6e-11a7-406c-8b0f-47f1b2cc5f22 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.402269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baeb6e-11a7-406c-8b0f-47f1b2cc5f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.437175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-49baeb6e-11a7-406c-8b0f-47f1b2cc5f22 None None] MFA Rules not processed for user `99068d55e19e4b3cbf9197ca46d86fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:55.442307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-49baeb6e-11a7-406c-8b0f-47f1b2cc5f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.452106 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b6eda-d4d4-48e4-a2ef-0a3bc3e745fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:55.453766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b6eda-d4d4-48e4-a2ef-0a3bc3e745fd service swift] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:55.464051 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 896/1793] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:36:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 02:36:55.636815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:55.681362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 898/1794] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:55.890933 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6eda-d4d4-48e4-a2ef-0a3bc3e745fd service swift] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:55.892566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f47b6eda-d4d4-48e4-a2ef-0a3bc3e745fd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.904988 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baeb6e-11a7-406c-8b0f-47f1b2cc5f22 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:55.908630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-49baeb6e-11a7-406c-8b0f-47f1b2cc5f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:56.104692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6eda-d4d4-48e4-a2ef-0a3bc3e745fd service swift] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:56.127221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e54bed-2420-4dee-a59a-ca667a92403a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:56.127961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54bed-2420-4dee-a59a-ca667a92403a service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.128697 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54bed-2420-4dee-a59a-ca667a92403a service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.128969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e54bed-2420-4dee-a59a-ca667a92403a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.132009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-00e54bed-2420-4dee-a59a-ca667a92403a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:56.341315 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baeb6e-11a7-406c-8b0f-47f1b2cc5f22 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:56.360885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efec4e3-7e22-4aa3-aedb-dfa094038f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:56.363541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec4e3-7e22-4aa3-aedb-dfa094038f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.363872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec4e3-7e22-4aa3-aedb-dfa094038f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.364159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efec4e3-7e22-4aa3-aedb-dfa094038f48 admin admin] PATH_INFO: `/v3/projects/0a76e135f6cf47889edeaa9963a6983c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.386515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efec4e3-7e22-4aa3-aedb-dfa094038f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a76e135f6cf47889edeaa9963a6983c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:56.401478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efec4e3-7e22-4aa3-aedb-dfa094038f48 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:56.427956 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e54bed-2420-4dee-a59a-ca667a92403a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:56.429619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e54bed-2420-4dee-a59a-ca667a92403a service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:56.468391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 897/1795] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:57.022127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4efec4e3-7e22-4aa3-aedb-dfa094038f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a76e135f6cf47889edeaa9963a6983c', 'request_id': 'req-4efec4e3-7e22-4aa3-aedb-dfa094038f48'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:57.030608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4efec4e3-7e22-4aa3-aedb-dfa094038f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a76e135f6cf47889edeaa9963a6983c', 'request_id': 'req-4efec4e3-7e22-4aa3-aedb-dfa094038f48'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:57.126621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4efec4e3-7e22-4aa3-aedb-dfa094038f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a76e135f6cf47889edeaa9963a6983c', 'request_id': 'req-4efec4e3-7e22-4aa3-aedb-dfa094038f48'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:57.146456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4efec4e3-7e22-4aa3-aedb-dfa094038f48 admin admin] The token cache is being invalidate because project 0a76e135f6cf47889edeaa9963a6983c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:57.149406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4efec4e3-7e22-4aa3-aedb-dfa094038f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:57.150676 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4efec4e3-7e22-4aa3-aedb-dfa094038f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:57.164513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 899/1796] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:55 2022] DELETE /identity/v3/projects/0a76e135f6cf47889edeaa9963a6983c => generated 0 bytes in 1255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:57.165442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bbd83-dcbb-4b1e-96e4-d5c690ed7db1 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:57.165919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bbd83-dcbb-4b1e-96e4-d5c690ed7db1 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:57.166028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bbd83-dcbb-4b1e-96e4-d5c690ed7db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:57.221466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c09bbd83-dcbb-4b1e-96e4-d5c690ed7db1 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:57.231641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c09bbd83-dcbb-4b1e-96e4-d5c690ed7db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:57.334659 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:57.470886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 898/1797] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:57.481047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec706ee-cfd7-47ba-a5f3-196930705ce2 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:57.481047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec706ee-cfd7-47ba-a5f3-196930705ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:57.481047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec706ee-cfd7-47ba-a5f3-196930705ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:57.575746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-7ec706ee-cfd7-47ba-a5f3-196930705ce2 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:57.582254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7ec706ee-cfd7-47ba-a5f3-196930705ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:57.607051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 900/1798] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:57.611442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bbd83-dcbb-4b1e-96e4-d5c690ed7db1 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:57.625886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bbd83-dcbb-4b1e-96e4-d5c690ed7db1 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:57.659223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48699b7-ee93-459a-a0eb-8a1e36de0075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:57.659878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48699b7-ee93-459a-a0eb-8a1e36de0075 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:57.660166 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48699b7-ee93-459a-a0eb-8a1e36de0075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:57.660445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48699b7-ee93-459a-a0eb-8a1e36de0075 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:57.661164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48699b7-ee93-459a-a0eb-8a1e36de0075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:57.661471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48699b7-ee93-459a-a0eb-8a1e36de0075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:57.663125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48699b7-ee93-459a-a0eb-8a1e36de0075 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:57.711990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 899/1799] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:57.715061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec706ee-cfd7-47ba-a5f3-196930705ce2 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:57.742438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec706ee-cfd7-47ba-a5f3-196930705ce2 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:57.757230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece8104-1c52-471f-a3e5-65bff89dd630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:57.758420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece8104-1c52-471f-a3e5-65bff89dd630 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:57.760751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece8104-1c52-471f-a3e5-65bff89dd630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:57.761184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece8104-1c52-471f-a3e5-65bff89dd630 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:57.762007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece8104-1c52-471f-a3e5-65bff89dd630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:57.764434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece8104-1c52-471f-a3e5-65bff89dd630 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:57.925436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 901/1800] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:57 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:57.929710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48699b7-ee93-459a-a0eb-8a1e36de0075 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:57.979847 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48699b7-ee93-459a-a0eb-8a1e36de0075 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:58.215717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1dee9-ca91-46aa-a1ef-dd68acff12e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:58.217297 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1dee9-ca91-46aa-a1ef-dd68acff12e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.217929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1dee9-ca91-46aa-a1ef-dd68acff12e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.218441 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1dee9-ca91-46aa-a1ef-dd68acff12e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.219517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1dee9-ca91-46aa-a1ef-dd68acff12e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:58.222876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1dee9-ca91-46aa-a1ef-dd68acff12e2 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:58.578523 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:58.616816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 900/1801] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:57 2022] POST /identity/v3/users => generated 289 bytes in 688 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:58.617760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece8104-1c52-471f-a3e5-65bff89dd630 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:58.647104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece8104-1c52-471f-a3e5-65bff89dd630 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:58.653462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2d238-186d-415f-adaf-d2575e6c7e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:58.655147 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2d238-186d-415f-adaf-d2575e6c7e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.658153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2d238-186d-415f-adaf-d2575e6c7e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.658918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6634e-cb6a-4f91-b658-69ff965963e0 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.658918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6634e-cb6a-4f91-b658-69ff965963e0 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.659218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6634e-cb6a-4f91-b658-69ff965963e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.669237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2d238-186d-415f-adaf-d2575e6c7e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.673415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2d238-186d-415f-adaf-d2575e6c7e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:58.676896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2d238-186d-415f-adaf-d2575e6c7e9b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:58.699480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-52d6634e-cb6a-4f91-b658-69ff965963e0 None None] MFA Rules not processed for user `1ac08ad57a8e442d89ba1881abf43cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:58.704200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 902/1802] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:58.705478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-52d6634e-cb6a-4f91-b658-69ff965963e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:58.715529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2d238-186d-415f-adaf-d2575e6c7e9b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:58.751808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2d238-186d-415f-adaf-d2575e6c7e9b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:58.786531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca72724-54d9-46d0-a495-340ee8a28092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:58.786531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72724-54d9-46d0-a495-340ee8a28092 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.786531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72724-54d9-46d0-a495-340ee8a28092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.786531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72724-54d9-46d0-a495-340ee8a28092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.787733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca72724-54d9-46d0-a495-340ee8a28092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:58.787733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca72724-54d9-46d0-a495-340ee8a28092 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:58.846326 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 903/1803] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:58.855037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1f872-3444-4cc0-8624-374123618cae None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.855506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1f872-3444-4cc0-8624-374123618cae None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.855941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1f872-3444-4cc0-8624-374123618cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.856697 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 901/1804] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Aug 4 02:36:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:58.857929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6634e-cb6a-4f91-b658-69ff965963e0 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:58.888094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6634e-cb6a-4f91-b658-69ff965963e0 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:58.926422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5149c46-abf5-4424-b292-24743ea0ff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:58.927177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5149c46-abf5-4424-b292-24743ea0ff06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.927461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5149c46-abf5-4424-b292-24743ea0ff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.927735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5149c46-abf5-4424-b292-24743ea0ff06 admin admin] PATH_INFO: `/v3/projects/220c954b2cff4f86abc2ba09c9e33326/users/8abacc0ec8cc4931b02c4bf37d445a0d/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.945148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-53d1f872-3444-4cc0-8624-374123618cae None None] MFA Rules not processed for user `64be537a50754c838554d1a2e0a4177a`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:58.945148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-53d1f872-3444-4cc0-8624-374123618cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:58.973808 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5149c46-abf5-4424-b292-24743ea0ff06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220c954b2cff4f86abc2ba09c9e33326, user_id=8abacc0ec8cc4931b02c4bf37d445a0d, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:58.976621 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5149c46-abf5-4424-b292-24743ea0ff06 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:59.078411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:59.082745 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 902/1805] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:58 2022] PUT /identity/v3/projects/220c954b2cff4f86abc2ba09c9e33326/users/8abacc0ec8cc4931b02c4bf37d445a0d/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:59.082745 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5149c46-abf5-4424-b292-24743ea0ff06 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:59.085597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 904/1806] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:59.092275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b5149c46-abf5-4424-b292-24743ea0ff06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:59.103152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130516e-4e2b-4366-9342-0afed369237e None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:59.105692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130516e-4e2b-4366-9342-0afed369237e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:59.106536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130516e-4e2b-4366-9342-0afed369237e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:59.206150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b130516e-4e2b-4366-9342-0afed369237e None None] MFA Rules not processed for user `8abacc0ec8cc4931b02c4bf37d445a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:59.207749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b130516e-4e2b-4366-9342-0afed369237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:59.260091 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5149c46-abf5-4424-b292-24743ea0ff06 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:59.286702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79924-e61c-4e46-9940-f3f74960db7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:59.289009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79924-e61c-4e46-9940-f3f74960db7c service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:59.289419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79924-e61c-4e46-9940-f3f74960db7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:59.290082 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79924-e61c-4e46-9940-f3f74960db7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:59.340079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a79924-e61c-4e46-9940-f3f74960db7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:59.340079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a79924-e61c-4e46-9940-f3f74960db7c service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:59.340079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 903/1807] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:59.347483 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 905/1808] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:36:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:59.365570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79924-e61c-4e46-9940-f3f74960db7c service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:59.367265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-46a79924-e61c-4e46-9940-f3f74960db7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:59.550995 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79924-e61c-4e46-9940-f3f74960db7c service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:59.594524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716846d8-70af-483c-8045-731a4986b4ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bd2ed69b324e85b8166135f045b840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:59.595192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716846d8-70af-483c-8045-731a4986b4ed service glance] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:59.599312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716846d8-70af-483c-8045-731a4986b4ed service glance] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:59.599664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716846d8-70af-483c-8045-731a4986b4ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:59.632141 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716846d8-70af-483c-8045-731a4986b4ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:59.634197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716846d8-70af-483c-8045-731a4986b4ed service glance] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:59.657594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 904/1809] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:00.636745 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:00.933932 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe2632-d802-4adb-a8f7-df2a0cdc0e6d None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:00.933932 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe2632-d802-4adb-a8f7-df2a0cdc0e6d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:00.933932 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe2632-d802-4adb-a8f7-df2a0cdc0e6d None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:00.933932 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 906/1810] 10.222.0.60 () {54 vars in 912 bytes} [Thu Aug 4 02:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:37:00.937130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5b846-0b10-46f5-bf60-323d52a14ac7 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:00.937130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5b846-0b10-46f5-bf60-323d52a14ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:00.937130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5b846-0b10-46f5-bf60-323d52a14ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:00.937130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-36a5b846-0b10-46f5-bf60-323d52a14ac7 None None] MFA Rules not processed for user `1ac08ad57a8e442d89ba1881abf43cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:00.937130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-36a5b846-0b10-46f5-bf60-323d52a14ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:00.937130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 905/1811] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:37:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:00.969234 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe2632-d802-4adb-a8f7-df2a0cdc0e6d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:00.987748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe2632-d802-4adb-a8f7-df2a0cdc0e6d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:00.992714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a0165-9745-444a-8851-d0533497af35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:00.993699 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a0165-9745-444a-8851-d0533497af35 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:00.994421 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a0165-9745-444a-8851-d0533497af35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:00.995075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a0165-9745-444a-8851-d0533497af35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:01.007275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a0165-9745-444a-8851-d0533497af35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:01.009303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a0165-9745-444a-8851-d0533497af35 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:01.020679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 907/1812] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:02.128291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1909849-2a00-468d-83cb-e317f6fede4f None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:02.128905 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1909849-2a00-468d-83cb-e317f6fede4f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:02.128905 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1909849-2a00-468d-83cb-e317f6fede4f None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:02.133846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 906/1813] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:37:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:37:02.149610 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002eb3-796d-4b13-823d-5e727af84a1c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:02.150721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002eb3-796d-4b13-823d-5e727af84a1c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:02.151256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a002eb3-796d-4b13-823d-5e727af84a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:02.251500 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-1a002eb3-796d-4b13-823d-5e727af84a1c None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:02.252812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1a002eb3-796d-4b13-823d-5e727af84a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:02.373874 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:02.516675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 908/1814] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:37:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:02.561363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b2ede-e962-4e51-bd75-ebf4b025b2b8 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:02.561987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b2ede-e962-4e51-bd75-ebf4b025b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:02.562478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b2ede-e962-4e51-bd75-ebf4b025b2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:02.614467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c73b2ede-e962-4e51-bd75-ebf4b025b2b8 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:02.616657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c73b2ede-e962-4e51-bd75-ebf4b025b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:02.816129 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 907/1815] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:37:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:02.834078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a002eb3-796d-4b13-823d-5e727af84a1c None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:02.836686 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1a002eb3-796d-4b13-823d-5e727af84a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:02.936012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b2ede-e962-4e51-bd75-ebf4b025b2b8 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:02.941596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c73b2ede-e962-4e51-bd75-ebf4b025b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:03.038141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a002eb3-796d-4b13-823d-5e727af84a1c None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:03.044019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b143eed-29d0-4a30-bc75-3b5ebe781d09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:03.045355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b143eed-29d0-4a30-bc75-3b5ebe781d09 service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:03.045926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b143eed-29d0-4a30-bc75-3b5ebe781d09 service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:03.046448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b143eed-29d0-4a30-bc75-3b5ebe781d09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:03.062846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b143eed-29d0-4a30-bc75-3b5ebe781d09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:03.062846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b143eed-29d0-4a30-bc75-3b5ebe781d09 service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:03.073468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 909/1816] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:37:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:37:03.236592 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b2ede-e962-4e51-bd75-ebf4b025b2b8 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:03.246117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6c437-fb75-431a-957b-6280dad52535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:03.249755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6c437-fb75-431a-957b-6280dad52535 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:03.250763 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6c437-fb75-431a-957b-6280dad52535 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:03.250763 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6c437-fb75-431a-957b-6280dad52535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:03.266901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-cee6c437-fb75-431a-957b-6280dad52535 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:03.333189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b143eed-29d0-4a30-bc75-3b5ebe781d09 service swift] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:03.335488 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7b143eed-29d0-4a30-bc75-3b5ebe781d09 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:03.387643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b143eed-29d0-4a30-bc75-3b5ebe781d09 service swift] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:03.411358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bc9bc-9290-43b3-b65d-e7de6945cabd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:03.415442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bc9bc-9290-43b3-b65d-e7de6945cabd service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:03.416335 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bc9bc-9290-43b3-b65d-e7de6945cabd service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:03.416685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bc9bc-9290-43b3-b65d-e7de6945cabd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:03.450072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bc9bc-9290-43b3-b65d-e7de6945cabd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:03.464036 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bc9bc-9290-43b3-b65d-e7de6945cabd service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:03.499571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 910/1817] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:03.513876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6c437-fb75-431a-957b-6280dad52535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:03.516101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6c437-fb75-431a-957b-6280dad52535 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:03.533879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 908/1818] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:04.118795 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c59b1f-9278-4979-8013-31e4b525d8a5 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:04.119498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c59b1f-9278-4979-8013-31e4b525d8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:04.119992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c59b1f-9278-4979-8013-31e4b525d8a5 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:04.121890 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 911/1819] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:37:04.164629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c62aa-1cc1-4e0b-8129-50359fbb8f27 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:04.165023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c62aa-1cc1-4e0b-8129-50359fbb8f27 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:04.165387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c62aa-1cc1-4e0b-8129-50359fbb8f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:04.214810 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:04.238732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e12c62aa-1cc1-4e0b-8129-50359fbb8f27 None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:04.246828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e12c62aa-1cc1-4e0b-8129-50359fbb8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:04.290134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 909/1820] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:37:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:04.876963 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c59b1f-9278-4979-8013-31e4b525d8a5 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:04.900290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c59b1f-9278-4979-8013-31e4b525d8a5 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:04.910000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6a354-8a9d-4ccf-a407-7b2e8e16fac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:04.911069 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6a354-8a9d-4ccf-a407-7b2e8e16fac6 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:04.911569 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6a354-8a9d-4ccf-a407-7b2e8e16fac6 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:04.912024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6a354-8a9d-4ccf-a407-7b2e8e16fac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:04.924919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6a354-8a9d-4ccf-a407-7b2e8e16fac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:04.927200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6a354-8a9d-4ccf-a407-7b2e8e16fac6 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:04.951099 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 912/1821] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:05.424797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:08.428533 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:08.622335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:08.898801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c62aa-1cc1-4e0b-8129-50359fbb8f27 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:08.900517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e12c62aa-1cc1-4e0b-8129-50359fbb8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:08.983132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c62aa-1cc1-4e0b-8129-50359fbb8f27 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:08.988209 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:08.988867 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:08.989154 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:08.989441 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] PATH_INFO: `/v3/users/9204da722072476c89c4eb2e13a124a0` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:08.990678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9204da722072476c89c4eb2e13a124a0)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:08.992800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:09.224711 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9204da722072476c89c4eb2e13a124a0'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:09.313421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9204da722072476c89c4eb2e13a124a0'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:09.320881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9204da722072476c89c4eb2e13a124a0'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:09.326141 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9204da722072476c89c4eb2e13a124a0'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:09.326141 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9204da722072476c89c4eb2e13a124a0'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:09.340458 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 910/1822] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:08 2022] DELETE /identity/v3/users/9204da722072476c89c4eb2e13a124a0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:09.344886 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c486702-572b-4e66-b838-6184fcc4f6df None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.345712 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c486702-572b-4e66-b838-6184fcc4f6df None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.346184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c486702-572b-4e66-b838-6184fcc4f6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.367994 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-1c486702-572b-4e66-b838-6184fcc4f6df None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:09.369218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1c486702-572b-4e66-b838-6184fcc4f6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:09.429841 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 913/1823] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:09.440219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:09.441658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:09.502324 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907af1c7-b4df-484f-9110-a68bf450c4cb admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:09.513506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050333e-15cc-4d62-8b2f-c99c15a20325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:09.514645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050333e-15cc-4d62-8b2f-c99c15a20325 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.515159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050333e-15cc-4d62-8b2f-c99c15a20325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.516133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050333e-15cc-4d62-8b2f-c99c15a20325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.531526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050333e-15cc-4d62-8b2f-c99c15a20325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:09.531526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050333e-15cc-4d62-8b2f-c99c15a20325 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:09.542699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 911/1824] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:09.788057 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:10.224870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:10.407564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c486702-572b-4e66-b838-6184fcc4f6df None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:10.409017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1c486702-572b-4e66-b838-6184fcc4f6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:10.422059 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c486702-572b-4e66-b838-6184fcc4f6df None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:10.427921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:10.429156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:10.429791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:10.430292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] PATH_INFO: `/v3/projects/483bcf92aca649f1b1e5d2f9a451b8f4` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:10.447471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] RBAC: Authorizing `identity:delete_project(project_id=483bcf92aca649f1b1e5d2f9a451b8f4)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:10.449694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:10.615164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483bcf92aca649f1b1e5d2f9a451b8f4', 'request_id': 'req-38d98c1d-4086-445b-b6cf-32668200989b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:10.630675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483bcf92aca649f1b1e5d2f9a451b8f4', 'request_id': 'req-38d98c1d-4086-445b-b6cf-32668200989b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:10.727526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483bcf92aca649f1b1e5d2f9a451b8f4', 'request_id': 'req-38d98c1d-4086-445b-b6cf-32668200989b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:10.764553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] The token cache is being invalidate because project 483bcf92aca649f1b1e5d2f9a451b8f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:10.765354 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:10.767383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:10.770521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 914/1825] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:10 2022] DELETE /identity/v3/projects/483bcf92aca649f1b1e5d2f9a451b8f4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:10.774396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050333e-15cc-4d62-8b2f-c99c15a20325 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:10.786570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050333e-15cc-4d62-8b2f-c99c15a20325 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:10.890530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716dc19-e283-48e2-98f7-a0905c2631c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:10.894148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716dc19-e283-48e2-98f7-a0905c2631c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:10.894148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716dc19-e283-48e2-98f7-a0905c2631c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:10.894148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716dc19-e283-48e2-98f7-a0905c2631c6 admin admin] PATH_INFO: `/v3/users/3d1d537ea42f4490a61cb7c9861abcd2` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:10.894148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716dc19-e283-48e2-98f7-a0905c2631c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d1d537ea42f4490a61cb7c9861abcd2)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:10.896197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716dc19-e283-48e2-98f7-a0905c2631c6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:11.179389 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e716dc19-e283-48e2-98f7-a0905c2631c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d1d537ea42f4490a61cb7c9861abcd2'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:11.289872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e716dc19-e283-48e2-98f7-a0905c2631c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d1d537ea42f4490a61cb7c9861abcd2'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:11.307177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e716dc19-e283-48e2-98f7-a0905c2631c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d1d537ea42f4490a61cb7c9861abcd2'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:11.309213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:11.310465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e716dc19-e283-48e2-98f7-a0905c2631c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d1d537ea42f4490a61cb7c9861abcd2'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:11.311814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e716dc19-e283-48e2-98f7-a0905c2631c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d1d537ea42f4490a61cb7c9861abcd2'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:11.338022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 912/1826] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:10 2022] DELETE /identity/v3/users/3d1d537ea42f4490a61cb7c9861abcd2 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:11.542471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:12.033506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:12.035022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:12.054773 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d98c1d-4086-445b-b6cf-32668200989b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:12.269797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd759692-07be-4c68-bc23-d6d843971bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:12.270458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd759692-07be-4c68-bc23-d6d843971bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:12.270840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd759692-07be-4c68-bc23-d6d843971bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:12.271487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd759692-07be-4c68-bc23-d6d843971bd2 admin admin] PATH_INFO: `/v3/projects/8ca2dad61d8347a1a8ae4d5332c00981` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:12.273149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd759692-07be-4c68-bc23-d6d843971bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca2dad61d8347a1a8ae4d5332c00981)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:12.275529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd759692-07be-4c68-bc23-d6d843971bd2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:12.492110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:12.557218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cd759692-07be-4c68-bc23-d6d843971bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca2dad61d8347a1a8ae4d5332c00981', 'request_id': 'req-cd759692-07be-4c68-bc23-d6d843971bd2'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:12.580995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cd759692-07be-4c68-bc23-d6d843971bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca2dad61d8347a1a8ae4d5332c00981', 'request_id': 'req-cd759692-07be-4c68-bc23-d6d843971bd2'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:12.667868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cd759692-07be-4c68-bc23-d6d843971bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca2dad61d8347a1a8ae4d5332c00981', 'request_id': 'req-cd759692-07be-4c68-bc23-d6d843971bd2'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:12.694394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cd759692-07be-4c68-bc23-d6d843971bd2 admin admin] The token cache is being invalidate because project 8ca2dad61d8347a1a8ae4d5332c00981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:12.694989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cd759692-07be-4c68-bc23-d6d843971bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:12.697368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cd759692-07be-4c68-bc23-d6d843971bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:12.699802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 915/1827] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:12 2022] DELETE /identity/v3/projects/8ca2dad61d8347a1a8ae4d5332c00981 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:12.705422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee55af-4985-4816-9339-9c4922d3d35e None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:12.705422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee55af-4985-4816-9339-9c4922d3d35e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:12.705422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee55af-4985-4816-9339-9c4922d3d35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:12.734313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e1ee55af-4985-4816-9339-9c4922d3d35e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:12.736386 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e1ee55af-4985-4816-9339-9c4922d3d35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:12.813251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 913/1828] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:12.817219 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853cd57-ad55-402f-b44c-4a7ee4ba0f91 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:12.820049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853cd57-ad55-402f-b44c-4a7ee4ba0f91 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:12.820560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853cd57-ad55-402f-b44c-4a7ee4ba0f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:12.861796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-3853cd57-ad55-402f-b44c-4a7ee4ba0f91 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:12.863248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3853cd57-ad55-402f-b44c-4a7ee4ba0f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:12.875867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 916/1829] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:12.879422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee55af-4985-4816-9339-9c4922d3d35e None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:12.898585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee55af-4985-4816-9339-9c4922d3d35e None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:12.904815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebae125-2233-4a25-81c3-39c4a318150f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:12.905454 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebae125-2233-4a25-81c3-39c4a318150f admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:12.905759 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebae125-2233-4a25-81c3-39c4a318150f admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:12.906210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebae125-2233-4a25-81c3-39c4a318150f admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:12.907209 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebae125-2233-4a25-81c3-39c4a318150f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:12.907540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebae125-2233-4a25-81c3-39c4a318150f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:12.909164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebae125-2233-4a25-81c3-39c4a318150f admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:12.930931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 914/1830] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:12.935989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853cd57-ad55-402f-b44c-4a7ee4ba0f91 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:12.951813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853cd57-ad55-402f-b44c-4a7ee4ba0f91 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:12.960857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8232e80-dfaf-46e9-a229-9e1f3950f5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:12.962410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8232e80-dfaf-46e9-a229-9e1f3950f5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:12.963088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8232e80-dfaf-46e9-a229-9e1f3950f5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:12.963536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8232e80-dfaf-46e9-a229-9e1f3950f5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:12.964395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8232e80-dfaf-46e9-a229-9e1f3950f5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:12.988248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8232e80-dfaf-46e9-a229-9e1f3950f5f6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:13.104610 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 917/1831] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:12 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:13.109375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebae125-2233-4a25-81c3-39c4a318150f admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:13.132445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebae125-2233-4a25-81c3-39c4a318150f admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:13.264649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55692a-92ce-4214-a372-3daefa35b5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:13.265438 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55692a-92ce-4214-a372-3daefa35b5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:13.265828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55692a-92ce-4214-a372-3daefa35b5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:13.266206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55692a-92ce-4214-a372-3daefa35b5c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:13.267156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55692a-92ce-4214-a372-3daefa35b5c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:13.269334 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55692a-92ce-4214-a372-3daefa35b5c9 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:13.383045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 915/1832] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:13 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:13.388194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8232e80-dfaf-46e9-a229-9e1f3950f5f6 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:13.399383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8232e80-dfaf-46e9-a229-9e1f3950f5f6 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:13.408297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35a818-74ae-421a-9a6a-aa813c7b3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:13.408297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35a818-74ae-421a-9a6a-aa813c7b3128 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:13.408297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35a818-74ae-421a-9a6a-aa813c7b3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:13.408297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35a818-74ae-421a-9a6a-aa813c7b3128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:13.408583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35a818-74ae-421a-9a6a-aa813c7b3128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:13.409590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35a818-74ae-421a-9a6a-aa813c7b3128 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:13.447515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 918/1833] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:13.448746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55692a-92ce-4214-a372-3daefa35b5c9 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:13.464208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55692a-92ce-4214-a372-3daefa35b5c9 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:13.470622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950e94b-9f08-4cc3-8eee-9742721ca83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:13.472517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950e94b-9f08-4cc3-8eee-9742721ca83d admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:13.472864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950e94b-9f08-4cc3-8eee-9742721ca83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:13.473156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950e94b-9f08-4cc3-8eee-9742721ca83d admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:13.473866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950e94b-9f08-4cc3-8eee-9742721ca83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:13.475528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950e94b-9f08-4cc3-8eee-9742721ca83d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:13.488840 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 916/1834] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:13.494280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35a818-74ae-421a-9a6a-aa813c7b3128 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:13.504607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35a818-74ae-421a-9a6a-aa813c7b3128 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:13.509811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02a4a7-74a5-471b-a514-759b69dc1e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:13.510737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02a4a7-74a5-471b-a514-759b69dc1e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:13.511194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02a4a7-74a5-471b-a514-759b69dc1e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:13.511884 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02a4a7-74a5-471b-a514-759b69dc1e24 admin admin] PATH_INFO: `/v3/projects/51d11195fb96472986b075499b34e216/users/04f304207e04495f84e6bbce478dc5f8/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:13.530690 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02a4a7-74a5-471b-a514-759b69dc1e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d11195fb96472986b075499b34e216, user_id=04f304207e04495f84e6bbce478dc5f8, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:13.533442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02a4a7-74a5-471b-a514-759b69dc1e24 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:13.634030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 919/1835] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:13 2022] PUT /identity/v3/projects/51d11195fb96472986b075499b34e216/users/04f304207e04495f84e6bbce478dc5f8/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:13.647820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c2059-8d49-4fae-b0fd-2fd034ab2c70 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:13.648331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c2059-8d49-4fae-b0fd-2fd034ab2c70 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:13.648824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c2059-8d49-4fae-b0fd-2fd034ab2c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:13.654713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:13.687508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b74c2059-8d49-4fae-b0fd-2fd034ab2c70 None None] MFA Rules not processed for user `04f304207e04495f84e6bbce478dc5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:13.689185 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b74c2059-8d49-4fae-b0fd-2fd034ab2c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:13.784089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 917/1836] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:13.785840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02a4a7-74a5-471b-a514-759b69dc1e24 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:13.864706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02a4a7-74a5-471b-a514-759b69dc1e24 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:13.872468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ceff-a9f3-46fd-b899-db8614289f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:13.873827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ceff-a9f3-46fd-b899-db8614289f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:13.874124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ceff-a9f3-46fd-b899-db8614289f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:13.874457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ceff-a9f3-46fd-b899-db8614289f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:13.875171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ceff-a9f3-46fd-b899-db8614289f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:13.877354 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ceff-a9f3-46fd-b899-db8614289f8a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:13.980743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 920/1837] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:13 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:13.984333 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c2059-8d49-4fae-b0fd-2fd034ab2c70 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:13.997300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c2059-8d49-4fae-b0fd-2fd034ab2c70 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:14.081734 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824cdf5-de0a-4f33-8bf3-13a5a112d75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:14.082382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824cdf5-de0a-4f33-8bf3-13a5a112d75c admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:14.082885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824cdf5-de0a-4f33-8bf3-13a5a112d75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:14.083423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824cdf5-de0a-4f33-8bf3-13a5a112d75c admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:14.084317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824cdf5-de0a-4f33-8bf3-13a5a112d75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:14.086419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824cdf5-de0a-4f33-8bf3-13a5a112d75c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:14.177146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 918/1838] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:13 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:14.180999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ceff-a9f3-46fd-b899-db8614289f8a admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:14.198835 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ceff-a9f3-46fd-b899-db8614289f8a admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:14.206150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc3a2e-f307-4624-918b-f6bacba915c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:14.207153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc3a2e-f307-4624-918b-f6bacba915c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:14.207671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc3a2e-f307-4624-918b-f6bacba915c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:14.208197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc3a2e-f307-4624-918b-f6bacba915c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:14.209116 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc3a2e-f307-4624-918b-f6bacba915c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:14.211032 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc3a2e-f307-4624-918b-f6bacba915c5 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:14.231959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 921/1839] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:14.233171 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824cdf5-de0a-4f33-8bf3-13a5a112d75c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:14.244461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824cdf5-de0a-4f33-8bf3-13a5a112d75c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:14.253881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eae97-419d-4f69-9370-ffc153c99c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:14.253881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eae97-419d-4f69-9370-ffc153c99c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:14.253881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eae97-419d-4f69-9370-ffc153c99c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:14.253881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eae97-419d-4f69-9370-ffc153c99c63 admin admin] PATH_INFO: `/v3/projects/f8325d2e7b054bf19f080e0a6369d9c0/users/29c2bd32803d4015a9ab3e0fc5636a4f/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:14.283750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37eae97-419d-4f69-9370-ffc153c99c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8325d2e7b054bf19f080e0a6369d9c0, user_id=29c2bd32803d4015a9ab3e0fc5636a4f, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:14.287462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37eae97-419d-4f69-9370-ffc153c99c63 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:14.391363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 919/1840] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:14 2022] PUT /identity/v3/projects/f8325d2e7b054bf19f080e0a6369d9c0/users/29c2bd32803d4015a9ab3e0fc5636a4f/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:14.395740 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc3a2e-f307-4624-918b-f6bacba915c5 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:14.418786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc3a2e-f307-4624-918b-f6bacba915c5 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:14.514318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c69d2-c902-48be-9434-4cd685d6d416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:14.515005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c69d2-c902-48be-9434-4cd685d6d416 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:14.515458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c69d2-c902-48be-9434-4cd685d6d416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:14.516020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c69d2-c902-48be-9434-4cd685d6d416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:14.516922 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c69d2-c902-48be-9434-4cd685d6d416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:14.518945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c69d2-c902-48be-9434-4cd685d6d416 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:14.535745 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eae97-419d-4f69-9370-ffc153c99c63 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:14.538070 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 922/1841] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:14.549811 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eae97-419d-4f69-9370-ffc153c99c63 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:14.557666 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6df1aa-5c1a-4814-8cbf-190969e4f16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:14.561664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6df1aa-5c1a-4814-8cbf-190969e4f16d admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:14.562205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6df1aa-5c1a-4814-8cbf-190969e4f16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:14.562694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6df1aa-5c1a-4814-8cbf-190969e4f16d admin admin] PATH_INFO: `/v3/projects/f8325d2e7b054bf19f080e0a6369d9c0/users/29c2bd32803d4015a9ab3e0fc5636a4f/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:14.569842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6df1aa-5c1a-4814-8cbf-190969e4f16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8325d2e7b054bf19f080e0a6369d9c0, user_id=29c2bd32803d4015a9ab3e0fc5636a4f, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:14.573097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6df1aa-5c1a-4814-8cbf-190969e4f16d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:14.605357 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdfc5b-f2c4-4ae6-933c-4b142da30c82 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:14.605642 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdfc5b-f2c4-4ae6-933c-4b142da30c82 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:14.605935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdfc5b-f2c4-4ae6-933c-4b142da30c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:14.626154 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 920/1842] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:14 2022] PUT /identity/v3/projects/f8325d2e7b054bf19f080e0a6369d9c0/users/29c2bd32803d4015a9ab3e0fc5636a4f/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:14.653037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-80bdfc5b-f2c4-4ae6-933c-4b142da30c82 None None] MFA Rules not processed for user `29c2bd32803d4015a9ab3e0fc5636a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:14.654619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-80bdfc5b-f2c4-4ae6-933c-4b142da30c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:14.803836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 923/1843] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:14.815877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6df1aa-5c1a-4814-8cbf-190969e4f16d admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:14.818315 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0f6df1aa-5c1a-4814-8cbf-190969e4f16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:14.915984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6df1aa-5c1a-4814-8cbf-190969e4f16d admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:14.920552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbf3c5-ab01-4322-ad89-098e72b5997a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:14.921189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbf3c5-ab01-4322-ad89-098e72b5997a service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:14.921474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbf3c5-ab01-4322-ad89-098e72b5997a service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:14.921753 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbf3c5-ab01-4322-ad89-098e72b5997a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:14.937365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbf3c5-ab01-4322-ad89-098e72b5997a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:14.939348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbf3c5-ab01-4322-ad89-098e72b5997a service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:14.964851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 921/1844] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:15.046048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdfc5b-f2c4-4ae6-933c-4b142da30c82 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:15.169458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdfc5b-f2c4-4ae6-933c-4b142da30c82 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:15.174812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:15.177115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:15.177115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:15.177115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] PATH_INFO: `/v3/users/04f304207e04495f84e6bbce478dc5f8` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:15.177406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f304207e04495f84e6bbce478dc5f8)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:15.179592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:15.420418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f304207e04495f84e6bbce478dc5f8'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.442045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f304207e04495f84e6bbce478dc5f8'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.443622 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f304207e04495f84e6bbce478dc5f8'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.454611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f304207e04495f84e6bbce478dc5f8'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.529540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f304207e04495f84e6bbce478dc5f8'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.539646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 924/1845] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:15 2022] DELETE /identity/v3/users/04f304207e04495f84e6bbce478dc5f8 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:15.542521 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b527ec-b9dc-4822-854e-a1eeab32f0c6 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:15.542850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b527ec-b9dc-4822-854e-a1eeab32f0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:15.543136 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b527ec-b9dc-4822-854e-a1eeab32f0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:15.575116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-92b527ec-b9dc-4822-854e-a1eeab32f0c6 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:15.581270 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-92b527ec-b9dc-4822-854e-a1eeab32f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:15.678516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 922/1846] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:15.691646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:15.694629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:15.785322 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c008-c06d-4584-bec8-6550997f0324 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:15.788979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad141a-894c-4835-8206-49a83ea66b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:15.789600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad141a-894c-4835-8206-49a83ea66b8f service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:15.789886 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad141a-894c-4835-8206-49a83ea66b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:15.790160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad141a-894c-4835-8206-49a83ea66b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:15.801241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad141a-894c-4835-8206-49a83ea66b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:15.802918 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad141a-894c-4835-8206-49a83ea66b8f service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:15.803118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8fd3f-cfc5-4dc6-bb42-2ce40c90232a None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:15.803483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8fd3f-cfc5-4dc6-bb42-2ce40c90232a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:15.803834 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8fd3f-cfc5-4dc6-bb42-2ce40c90232a None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:15.805574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 923/1847] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:37:15.813484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 925/1848] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:15.814312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fc7ef-e52c-445c-aec0-194c851e154c None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:15.815347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fc7ef-e52c-445c-aec0-194c851e154c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:15.815606 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fc7ef-e52c-445c-aec0-194c851e154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:15.837352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-284fc7ef-e52c-445c-aec0-194c851e154c None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:15.839055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-284fc7ef-e52c-445c-aec0-194c851e154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:15.929964 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 924/1849] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:37:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:15.932328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:15.944858 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad141a-894c-4835-8206-49a83ea66b8f service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:15.947176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a8ad141a-894c-4835-8206-49a83ea66b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:15.965727 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad141a-894c-4835-8206-49a83ea66b8f service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:15.971909 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b159be-e9c1-4cf9-b3a2-e2c5fdbe54c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:15.972504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b159be-e9c1-4cf9-b3a2-e2c5fdbe54c5 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:15.972980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b159be-e9c1-4cf9-b3a2-e2c5fdbe54c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:15.973267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b159be-e9c1-4cf9-b3a2-e2c5fdbe54c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:15.983434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b159be-e9c1-4cf9-b3a2-e2c5fdbe54c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:15.985067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b159be-e9c1-4cf9-b3a2-e2c5fdbe54c5 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:15.994004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:16.004493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 926/1850] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:16.425442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fc7ef-e52c-445c-aec0-194c851e154c None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:16.426988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-284fc7ef-e52c-445c-aec0-194c851e154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:16.465090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fc7ef-e52c-445c-aec0-194c851e154c None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:16.471213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:16.472076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.472618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.473071 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] PATH_INFO: `/v3/projects/51d11195fb96472986b075499b34e216` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.474982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d11195fb96472986b075499b34e216)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:16.478649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:16.609522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d11195fb96472986b075499b34e216', 'request_id': 'req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:16.726402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d11195fb96472986b075499b34e216', 'request_id': 'req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:16.734726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d11195fb96472986b075499b34e216', 'request_id': 'req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:16.754930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] The token cache is being invalidate because project 51d11195fb96472986b075499b34e216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:16.756054 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:16.756914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:16.758921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 925/1851] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:16 2022] DELETE /identity/v3/projects/51d11195fb96472986b075499b34e216 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:16.763400 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b159be-e9c1-4cf9-b3a2-e2c5fdbe54c5 service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:16.786813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b159be-e9c1-4cf9-b3a2-e2c5fdbe54c5 service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:16.881969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb507a-0238-4c5a-8ef1-94410d702016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:16.883168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb507a-0238-4c5a-8ef1-94410d702016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.883548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb507a-0238-4c5a-8ef1-94410d702016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.884122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb507a-0238-4c5a-8ef1-94410d702016 admin admin] PATH_INFO: `/v3/users/29c2bd32803d4015a9ab3e0fc5636a4f` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.885680 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb507a-0238-4c5a-8ef1-94410d702016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c2bd32803d4015a9ab3e0fc5636a4f)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:16.888521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb507a-0238-4c5a-8ef1-94410d702016 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:17.158248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bfdb507a-0238-4c5a-8ef1-94410d702016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c2bd32803d4015a9ab3e0fc5636a4f'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:17.172660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bfdb507a-0238-4c5a-8ef1-94410d702016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c2bd32803d4015a9ab3e0fc5636a4f'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:17.173403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bfdb507a-0238-4c5a-8ef1-94410d702016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c2bd32803d4015a9ab3e0fc5636a4f'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:17.180499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bfdb507a-0238-4c5a-8ef1-94410d702016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c2bd32803d4015a9ab3e0fc5636a4f'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:17.279614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bfdb507a-0238-4c5a-8ef1-94410d702016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c2bd32803d4015a9ab3e0fc5636a4f'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:17.286913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 927/1852] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:16 2022] DELETE /identity/v3/users/29c2bd32803d4015a9ab3e0fc5636a4f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:17.348149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:17.834656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:17.836159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:17.857991 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b6bdf-ddcf-4c58-acec-6d78f6a93b1e admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:17.917038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21db2e-bea0-4f98-a738-c7a54b932688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:17.917614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21db2e-bea0-4f98-a738-c7a54b932688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:17.917896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21db2e-bea0-4f98-a738-c7a54b932688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:17.918170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21db2e-bea0-4f98-a738-c7a54b932688 admin admin] PATH_INFO: `/v3/projects/f8325d2e7b054bf19f080e0a6369d9c0` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:17.919617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21db2e-bea0-4f98-a738-c7a54b932688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8325d2e7b054bf19f080e0a6369d9c0)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:17.921522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21db2e-bea0-4f98-a738-c7a54b932688 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:18.077197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-cb21db2e-bea0-4f98-a738-c7a54b932688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8325d2e7b054bf19f080e0a6369d9c0', 'request_id': 'req-cb21db2e-bea0-4f98-a738-c7a54b932688'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.164596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-cb21db2e-bea0-4f98-a738-c7a54b932688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8325d2e7b054bf19f080e0a6369d9c0', 'request_id': 'req-cb21db2e-bea0-4f98-a738-c7a54b932688'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.191840 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-cb21db2e-bea0-4f98-a738-c7a54b932688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8325d2e7b054bf19f080e0a6369d9c0', 'request_id': 'req-cb21db2e-bea0-4f98-a738-c7a54b932688'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.208343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-cb21db2e-bea0-4f98-a738-c7a54b932688 admin admin] The token cache is being invalidate because project f8325d2e7b054bf19f080e0a6369d9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:18.208861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-cb21db2e-bea0-4f98-a738-c7a54b932688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.209835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-cb21db2e-bea0-4f98-a738-c7a54b932688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.211890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 926/1853] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:17 2022] DELETE /identity/v3/projects/f8325d2e7b054bf19f080e0a6369d9c0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:18.218351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005dc40-b2e1-47c9-946b-c160941c0d30 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:18.218351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005dc40-b2e1-47c9-946b-c160941c0d30 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:18.218983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005dc40-b2e1-47c9-946b-c160941c0d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:18.246397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-c005dc40-b2e1-47c9-946b-c160941c0d30 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:18.250140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c005dc40-b2e1-47c9-946b-c160941c0d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:18.289713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:18.308318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 928/1854] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:18.316976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab09f4-8a96-4ce9-b542-03384d908590 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:18.317292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab09f4-8a96-4ce9-b542-03384d908590 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:18.317631 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab09f4-8a96-4ce9-b542-03384d908590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:18.338334 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-57ab09f4-8a96-4ce9-b542-03384d908590 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:18.339572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-57ab09f4-8a96-4ce9-b542-03384d908590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:18.347791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 927/1855] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:18.356260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005dc40-b2e1-47c9-946b-c160941c0d30 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:18.368665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005dc40-b2e1-47c9-946b-c160941c0d30 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:18.374318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6823a88-05f3-4d35-8a30-cb45e237b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:18.375016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823a88-05f3-4d35-8a30-cb45e237b551 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:18.375304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823a88-05f3-4d35-8a30-cb45e237b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:18.375588 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823a88-05f3-4d35-8a30-cb45e237b551 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:18.376302 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6823a88-05f3-4d35-8a30-cb45e237b551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:18.376662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6823a88-05f3-4d35-8a30-cb45e237b551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:18.378360 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6823a88-05f3-4d35-8a30-cb45e237b551 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:18.393282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 929/1856] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:37:18.397875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab09f4-8a96-4ce9-b542-03384d908590 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:18.409984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab09f4-8a96-4ce9-b542-03384d908590 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:18.415548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128170de-be09-406e-b521-fe8fb9ae084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:18.416428 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128170de-be09-406e-b521-fe8fb9ae084d admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:18.416866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128170de-be09-406e-b521-fe8fb9ae084d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:18.417563 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128170de-be09-406e-b521-fe8fb9ae084d admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:18.418408 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128170de-be09-406e-b521-fe8fb9ae084d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:18.421058 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128170de-be09-406e-b521-fe8fb9ae084d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:18.532231 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 928/1857] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:18 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:18.536440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6823a88-05f3-4d35-8a30-cb45e237b551 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:18.546772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6823a88-05f3-4d35-8a30-cb45e237b551 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:18.615790 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d2e6d-9e5c-4a33-a68c-11170a3b2719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:18.616421 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d2e6d-9e5c-4a33-a68c-11170a3b2719 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:18.616708 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d2e6d-9e5c-4a33-a68c-11170a3b2719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:18.616987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d2e6d-9e5c-4a33-a68c-11170a3b2719 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:18.617703 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d2e6d-9e5c-4a33-a68c-11170a3b2719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:18.619887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d2e6d-9e5c-4a33-a68c-11170a3b2719 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:18.734708 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 930/1858] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:18 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:18.738678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128170de-be09-406e-b521-fe8fb9ae084d admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:18.751858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128170de-be09-406e-b521-fe8fb9ae084d admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:18.756929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589f3b9-2f80-492d-aeec-84e93712ea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:18.757646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589f3b9-2f80-492d-aeec-84e93712ea94 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:18.763401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589f3b9-2f80-492d-aeec-84e93712ea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:18.763401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589f3b9-2f80-492d-aeec-84e93712ea94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:18.763401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589f3b9-2f80-492d-aeec-84e93712ea94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:18.763401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589f3b9-2f80-492d-aeec-84e93712ea94 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:18.776144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 929/1859] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:18.777642 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d2e6d-9e5c-4a33-a68c-11170a3b2719 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:18.789223 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d2e6d-9e5c-4a33-a68c-11170a3b2719 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:18.796187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c828fa7-7973-4f74-86e0-f8ddecea8779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:18.796843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c828fa7-7973-4f74-86e0-f8ddecea8779 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:18.797238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c828fa7-7973-4f74-86e0-f8ddecea8779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:18.797616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c828fa7-7973-4f74-86e0-f8ddecea8779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:18.798447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c828fa7-7973-4f74-86e0-f8ddecea8779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:18.800225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c828fa7-7973-4f74-86e0-f8ddecea8779 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:18.822754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 931/1860] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:18.824201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589f3b9-2f80-492d-aeec-84e93712ea94 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:18.835100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589f3b9-2f80-492d-aeec-84e93712ea94 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:18.841836 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edaca9-d5ee-419d-9b3b-4ff75111e01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:18.842847 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edaca9-d5ee-419d-9b3b-4ff75111e01b admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:18.843135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edaca9-d5ee-419d-9b3b-4ff75111e01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:18.843415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edaca9-d5ee-419d-9b3b-4ff75111e01b admin admin] PATH_INFO: `/v3/projects/9df2525b6dda42beba9ebda0dc031865/users/0be020a4abbb4898b56baf9a30bc973a/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:18.861446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edaca9-d5ee-419d-9b3b-4ff75111e01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df2525b6dda42beba9ebda0dc031865, user_id=0be020a4abbb4898b56baf9a30bc973a, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:18.864528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edaca9-d5ee-419d-9b3b-4ff75111e01b admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:18.937831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 930/1861] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:18 2022] PUT /identity/v3/projects/9df2525b6dda42beba9ebda0dc031865/users/0be020a4abbb4898b56baf9a30bc973a/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:18.950860 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf728e2-14ba-4b26-bcba-2b068ae56c30 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:18.950948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf728e2-14ba-4b26-bcba-2b068ae56c30 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:18.951194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf728e2-14ba-4b26-bcba-2b068ae56c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:18.979871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-eaf728e2-14ba-4b26-bcba-2b068ae56c30 None None] MFA Rules not processed for user `0be020a4abbb4898b56baf9a30bc973a`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:18.981009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-eaf728e2-14ba-4b26-bcba-2b068ae56c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:19.052336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 932/1862] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:19.056904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edaca9-d5ee-419d-9b3b-4ff75111e01b admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.131029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edaca9-d5ee-419d-9b3b-4ff75111e01b admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.135772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea522ca0-1422-4f22-b3d0-44dd82b0a634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.136409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522ca0-1422-4f22-b3d0-44dd82b0a634 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.136694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522ca0-1422-4f22-b3d0-44dd82b0a634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.136968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522ca0-1422-4f22-b3d0-44dd82b0a634 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.138426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea522ca0-1422-4f22-b3d0-44dd82b0a634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.140632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea522ca0-1422-4f22-b3d0-44dd82b0a634 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.266570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 931/1863] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:19 2022] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:19.270370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf728e2-14ba-4b26-bcba-2b068ae56c30 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.290006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf728e2-14ba-4b26-bcba-2b068ae56c30 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.375662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a575ba-51a4-4ff4-9b70-fb2716ee65a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.377595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a575ba-51a4-4ff4-9b70-fb2716ee65a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.378226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a575ba-51a4-4ff4-9b70-fb2716ee65a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.378771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a575ba-51a4-4ff4-9b70-fb2716ee65a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.379918 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a575ba-51a4-4ff4-9b70-fb2716ee65a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.382287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a575ba-51a4-4ff4-9b70-fb2716ee65a2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.455651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 933/1864] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:19 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:19.456397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea522ca0-1422-4f22-b3d0-44dd82b0a634 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.479762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea522ca0-1422-4f22-b3d0-44dd82b0a634 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.488118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250b02f-d590-41a2-95c7-4c838629cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.489311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b02f-d590-41a2-95c7-4c838629cf26 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.489815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b02f-d590-41a2-95c7-4c838629cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.490301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b02f-d590-41a2-95c7-4c838629cf26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.491473 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250b02f-d590-41a2-95c7-4c838629cf26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.493878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250b02f-d590-41a2-95c7-4c838629cf26 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.509779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 932/1865] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:19.515978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a575ba-51a4-4ff4-9b70-fb2716ee65a2 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.531346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a575ba-51a4-4ff4-9b70-fb2716ee65a2 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.536502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcf6b9-94a4-41e5-ae53-9172f09109c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.537515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf6b9-94a4-41e5-ae53-9172f09109c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.537886 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf6b9-94a4-41e5-ae53-9172f09109c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.538241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf6b9-94a4-41e5-ae53-9172f09109c3 admin admin] PATH_INFO: `/v3/projects/76bf4d33cff74a47a3a24aff5267726e/users/1800548df30e4d6a84af66b707a6bca4/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.560260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcf6b9-94a4-41e5-ae53-9172f09109c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bf4d33cff74a47a3a24aff5267726e, user_id=1800548df30e4d6a84af66b707a6bca4, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.563988 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcf6b9-94a4-41e5-ae53-9172f09109c3 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.635499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 934/1866] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:19 2022] PUT /identity/v3/projects/76bf4d33cff74a47a3a24aff5267726e/users/1800548df30e4d6a84af66b707a6bca4/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:19.641750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250b02f-d590-41a2-95c7-4c838629cf26 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.657021 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250b02f-d590-41a2-95c7-4c838629cf26 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.747323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfbf56-7283-4697-93a1-ab5a75011498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.748181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfbf56-7283-4697-93a1-ab5a75011498 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.749061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfbf56-7283-4697-93a1-ab5a75011498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.749061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfbf56-7283-4697-93a1-ab5a75011498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.750020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfbf56-7283-4697-93a1-ab5a75011498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.752516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfbf56-7283-4697-93a1-ab5a75011498 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.766635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 933/1867] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:19.772867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcf6b9-94a4-41e5-ae53-9172f09109c3 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.788813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcf6b9-94a4-41e5-ae53-9172f09109c3 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.794300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c939f3a-1fb4-4ec5-9333-a4185549eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.794961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c939f3a-1fb4-4ec5-9333-a4185549eead admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.795369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c939f3a-1fb4-4ec5-9333-a4185549eead admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.795561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c939f3a-1fb4-4ec5-9333-a4185549eead admin admin] PATH_INFO: `/v3/projects/76bf4d33cff74a47a3a24aff5267726e/users/1800548df30e4d6a84af66b707a6bca4/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.797817 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c939f3a-1fb4-4ec5-9333-a4185549eead admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bf4d33cff74a47a3a24aff5267726e, user_id=1800548df30e4d6a84af66b707a6bca4, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.800495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c939f3a-1fb4-4ec5-9333-a4185549eead admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.830571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 935/1868] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:19 2022] PUT /identity/v3/projects/76bf4d33cff74a47a3a24aff5267726e/users/1800548df30e4d6a84af66b707a6bca4/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:19.840766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4c547-491e-4e61-b036-1bb864316b4d None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.841305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4c547-491e-4e61-b036-1bb864316b4d None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.841804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4c547-491e-4e61-b036-1bb864316b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.894922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-fde4c547-491e-4e61-b036-1bb864316b4d None None] MFA Rules not processed for user `1800548df30e4d6a84af66b707a6bca4`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:19.896547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-fde4c547-491e-4e61-b036-1bb864316b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:19.987512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 934/1869] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:19.989099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:19.999112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c939f3a-1fb4-4ec5-9333-a4185549eead admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:20.000912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4c939f3a-1fb4-4ec5-9333-a4185549eead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:20.049982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:20.078126 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c939f3a-1fb4-4ec5-9333-a4185549eead admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:20.082285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4e01c-46fa-44fd-9dd2-af0176cd605b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:20.083137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4e01c-46fa-44fd-9dd2-af0176cd605b service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:20.083424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4e01c-46fa-44fd-9dd2-af0176cd605b service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:20.083716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4e01c-46fa-44fd-9dd2-af0176cd605b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:20.093947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4e01c-46fa-44fd-9dd2-af0176cd605b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:20.095567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4e01c-46fa-44fd-9dd2-af0176cd605b service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:20.105096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 936/1870] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:20.300329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4c547-491e-4e61-b036-1bb864316b4d None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:20.309915 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4c547-491e-4e61-b036-1bb864316b4d None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:20.314271 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cc446-56e0-486d-9385-09a5869ede3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:20.315005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cc446-56e0-486d-9385-09a5869ede3d service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:20.315524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cc446-56e0-486d-9385-09a5869ede3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:20.316005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cc446-56e0-486d-9385-09a5869ede3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:20.382039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cc446-56e0-486d-9385-09a5869ede3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:20.383678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cc446-56e0-486d-9385-09a5869ede3d service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:20.400085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 935/1871] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:21.156601 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4e01c-46fa-44fd-9dd2-af0176cd605b service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:21.245494 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4e01c-46fa-44fd-9dd2-af0176cd605b service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:21.251533 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:21.252190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:21.252502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:21.252727 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] PATH_INFO: `/v3/users/0be020a4abbb4898b56baf9a30bc973a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:21.253979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be020a4abbb4898b56baf9a30bc973a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:21.256248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:21.428504 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be020a4abbb4898b56baf9a30bc973a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:21.443484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be020a4abbb4898b56baf9a30bc973a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:21.444394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be020a4abbb4898b56baf9a30bc973a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:21.452188 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be020a4abbb4898b56baf9a30bc973a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:21.582293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be020a4abbb4898b56baf9a30bc973a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:21.599425 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 937/1872] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:21 2022] DELETE /identity/v3/users/0be020a4abbb4898b56baf9a30bc973a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:21.604599 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2cbe3-efed-4d57-93a7-88581301c6aa None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:21.605072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2cbe3-efed-4d57-93a7-88581301c6aa None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:21.605163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2cbe3-efed-4d57-93a7-88581301c6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:21.626923 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9ea2cbe3-efed-4d57-93a7-88581301c6aa None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:21.628888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9ea2cbe3-efed-4d57-93a7-88581301c6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:21.694435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 936/1873] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:21.704658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:21.706289 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:21.792942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f229d-caab-4ec7-9293-8e910dbacd24 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:21.799465 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c768d50-3f9e-4a3b-9684-5b749768d294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:21.800150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c768d50-3f9e-4a3b-9684-5b749768d294 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:21.801591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c768d50-3f9e-4a3b-9684-5b749768d294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:21.801591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c768d50-3f9e-4a3b-9684-5b749768d294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:21.815643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c768d50-3f9e-4a3b-9684-5b749768d294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:21.817186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c768d50-3f9e-4a3b-9684-5b749768d294 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:21.828336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 938/1874] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:22.353238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2cbe3-efed-4d57-93a7-88581301c6aa None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:22.354765 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9ea2cbe3-efed-4d57-93a7-88581301c6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:22.368288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c768d50-3f9e-4a3b-9684-5b749768d294 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:22.370866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0c768d50-3f9e-4a3b-9684-5b749768d294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:22.374000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2cbe3-efed-4d57-93a7-88581301c6aa None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:22.380187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576940f-a488-4a47-9735-aee2ea6ba494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:22.381417 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576940f-a488-4a47-9735-aee2ea6ba494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:22.381726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576940f-a488-4a47-9735-aee2ea6ba494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:22.382168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576940f-a488-4a47-9735-aee2ea6ba494 admin admin] PATH_INFO: `/v3/users/618a72a2b0e14df4a7a49431af28aa83` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:22.383462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576940f-a488-4a47-9735-aee2ea6ba494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=618a72a2b0e14df4a7a49431af28aa83)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:22.385919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576940f-a488-4a47-9735-aee2ea6ba494 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:22.388140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c768d50-3f9e-4a3b-9684-5b749768d294 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:22.402411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:22.404083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:22.404440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:22.404823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] PATH_INFO: `/v3/projects/9df2525b6dda42beba9ebda0dc031865` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:22.406625 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df2525b6dda42beba9ebda0dc031865)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:22.408674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:22.561864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f576940f-a488-4a47-9735-aee2ea6ba494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '618a72a2b0e14df4a7a49431af28aa83'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.562097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df2525b6dda42beba9ebda0dc031865', 'request_id': 'req-4739caeb-2f05-4db3-98d3-924590d29e64'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.567673 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df2525b6dda42beba9ebda0dc031865', 'request_id': 'req-4739caeb-2f05-4db3-98d3-924590d29e64'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.616072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f576940f-a488-4a47-9735-aee2ea6ba494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '618a72a2b0e14df4a7a49431af28aa83'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.624515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f576940f-a488-4a47-9735-aee2ea6ba494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '618a72a2b0e14df4a7a49431af28aa83'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.625195 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f576940f-a488-4a47-9735-aee2ea6ba494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '618a72a2b0e14df4a7a49431af28aa83'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.625815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f576940f-a488-4a47-9735-aee2ea6ba494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '618a72a2b0e14df4a7a49431af28aa83'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.649738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 937/1875] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:22 2022] DELETE /identity/v3/users/618a72a2b0e14df4a7a49431af28aa83 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:22.651197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322ea6a-b45a-4acf-8a30-0e11ac72f88d None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:22.651563 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322ea6a-b45a-4acf-8a30-0e11ac72f88d None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:22.652171 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322ea6a-b45a-4acf-8a30-0e11ac72f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:22.672436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-1322ea6a-b45a-4acf-8a30-0e11ac72f88d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:22.673859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1322ea6a-b45a-4acf-8a30-0e11ac72f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:22.706533 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df2525b6dda42beba9ebda0dc031865', 'request_id': 'req-4739caeb-2f05-4db3-98d3-924590d29e64'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.718928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] The token cache is being invalidate because project 9df2525b6dda42beba9ebda0dc031865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:22.719225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.719957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.721554 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 939/1876] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:22 2022] DELETE /identity/v3/projects/9df2525b6dda42beba9ebda0dc031865 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:22.725383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:22.728974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:22.740208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 938/1877] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:22.752708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322ea6a-b45a-4acf-8a30-0e11ac72f88d None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:22.755304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1322ea6a-b45a-4acf-8a30-0e11ac72f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:22.796593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739caeb-2f05-4db3-98d3-924590d29e64 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:22.801487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:22.802132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:22.802417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:22.802724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] PATH_INFO: `/v3/users/1800548df30e4d6a84af66b707a6bca4` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:22.804149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1800548df30e4d6a84af66b707a6bca4)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:22.806020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:22.818249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322ea6a-b45a-4acf-8a30-0e11ac72f88d None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:22.822323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2614a-9119-44ca-b4ed-d230328f5f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:22.823014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2614a-9119-44ca-b4ed-d230328f5f26 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:22.823301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2614a-9119-44ca-b4ed-d230328f5f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:22.823581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2614a-9119-44ca-b4ed-d230328f5f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:22.840912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2614a-9119-44ca-b4ed-d230328f5f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:22.843264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2614a-9119-44ca-b4ed-d230328f5f26 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:22.860288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 939/1878] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:22.874438 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:22.919593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:22.980776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1800548df30e4d6a84af66b707a6bca4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.998196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1800548df30e4d6a84af66b707a6bca4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.000247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1800548df30e4d6a84af66b707a6bca4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.007476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1800548df30e4d6a84af66b707a6bca4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.068168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1800548df30e4d6a84af66b707a6bca4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.079569 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 940/1879] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:22 2022] DELETE /identity/v3/users/1800548df30e4d6a84af66b707a6bca4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:23.606627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2614a-9119-44ca-b4ed-d230328f5f26 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:23.608314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-aeb2614a-9119-44ca-b4ed-d230328f5f26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:23.623033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2614a-9119-44ca-b4ed-d230328f5f26 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:23.691464 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:23.692123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.692414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.692702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] PATH_INFO: `/v3/projects/6df40c69575b408db6795130f3149754` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:23.695077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df40c69575b408db6795130f3149754)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:23.697017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:23.740307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:23.740307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:23.755130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fd729-06c6-4f90-82bd-bda46185d766 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:23.789934 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae1557-609d-42a2-9d4c-77780f172cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:23.791953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae1557-609d-42a2-9d4c-77780f172cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.791953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae1557-609d-42a2-9d4c-77780f172cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.792255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae1557-609d-42a2-9d4c-77780f172cc4 admin admin] PATH_INFO: `/v3/projects/76bf4d33cff74a47a3a24aff5267726e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:23.795597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae1557-609d-42a2-9d4c-77780f172cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76bf4d33cff74a47a3a24aff5267726e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:23.797921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae1557-609d-42a2-9d4c-77780f172cc4 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:23.834765 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df40c69575b408db6795130f3149754', 'request_id': 'req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.930980 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df40c69575b408db6795130f3149754', 'request_id': 'req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.937626 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df40c69575b408db6795130f3149754', 'request_id': 'req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.950368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] The token cache is being invalidate because project 6df40c69575b408db6795130f3149754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:23.950585 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-2dae1557-609d-42a2-9d4c-77780f172cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76bf4d33cff74a47a3a24aff5267726e', 'request_id': 'req-2dae1557-609d-42a2-9d4c-77780f172cc4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.950880 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.951576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.953143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 940/1880] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:23 2022] DELETE /identity/v3/projects/6df40c69575b408db6795130f3149754 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:23.956871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-2dae1557-609d-42a2-9d4c-77780f172cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76bf4d33cff74a47a3a24aff5267726e', 'request_id': 'req-2dae1557-609d-42a2-9d4c-77780f172cc4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.956997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:23.958382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:24.020652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82ca8c-9a5c-45b0-b020-246a2a0bcefa admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.034336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-2dae1557-609d-42a2-9d4c-77780f172cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76bf4d33cff74a47a3a24aff5267726e', 'request_id': 'req-2dae1557-609d-42a2-9d4c-77780f172cc4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.071549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-2dae1557-609d-42a2-9d4c-77780f172cc4 admin admin] The token cache is being invalidate because project 76bf4d33cff74a47a3a24aff5267726e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:24.071969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-2dae1557-609d-42a2-9d4c-77780f172cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.072969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-2dae1557-609d-42a2-9d4c-77780f172cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.075872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 941/1881] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:23 2022] DELETE /identity/v3/projects/76bf4d33cff74a47a3a24aff5267726e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:24.080850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8cd27-5764-4fac-8830-ccb69274ab5d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.081690 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8cd27-5764-4fac-8830-ccb69274ab5d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.082020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8cd27-5764-4fac-8830-ccb69274ab5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.088686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:24.089484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.090448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.091398 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] PATH_INFO: `/v3/users/0d57f450bfb84584b274dfb59326c896` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.092837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d57f450bfb84584b274dfb59326c896)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:24.094945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:24.106735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-01d8cd27-5764-4fac-8830-ccb69274ab5d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:24.108272 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-01d8cd27-5764-4fac-8830-ccb69274ab5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:24.116958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 942/1882] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:24.137098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f8a9c-e5c5-4125-b11a-24249de93b53 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.137098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f8a9c-e5c5-4125-b11a-24249de93b53 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.137098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f8a9c-e5c5-4125-b11a-24249de93b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.149607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-d06f8a9c-e5c5-4125-b11a-24249de93b53 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:24.151101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d06f8a9c-e5c5-4125-b11a-24249de93b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:24.154249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:24.162631 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 943/1883] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:24.166783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f8a9c-e5c5-4125-b11a-24249de93b53 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:24.176390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f8a9c-e5c5-4125-b11a-24249de93b53 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.181398 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c30e2-d149-4379-827d-41a0d5450ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:24.182095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c30e2-d149-4379-827d-41a0d5450ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.182617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c30e2-d149-4379-827d-41a0d5450ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.183008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c30e2-d149-4379-827d-41a0d5450ad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.183817 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c30e2-d149-4379-827d-41a0d5450ad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:24.185004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c30e2-d149-4379-827d-41a0d5450ad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:24.187096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c30e2-d149-4379-827d-41a0d5450ad9 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:24.201887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 944/1884] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:37:24.206014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c30e2-d149-4379-827d-41a0d5450ad9 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:24.218338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c30e2-d149-4379-827d-41a0d5450ad9 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.223442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73e8f9-db72-4a36-a1dd-8045270a7d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:24.224115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73e8f9-db72-4a36-a1dd-8045270a7d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.224406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73e8f9-db72-4a36-a1dd-8045270a7d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.224686 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73e8f9-db72-4a36-a1dd-8045270a7d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.225360 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73e8f9-db72-4a36-a1dd-8045270a7d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:24.227381 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73e8f9-db72-4a36-a1dd-8045270a7d5c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:24.240912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d57f450bfb84584b274dfb59326c896'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.312651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d57f450bfb84584b274dfb59326c896'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.323479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d57f450bfb84584b274dfb59326c896'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.324513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d57f450bfb84584b274dfb59326c896'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.327292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d57f450bfb84584b274dfb59326c896'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.334759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 945/1885] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:24 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:24.355167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 941/1886] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:23 2022] DELETE /identity/v3/users/0d57f450bfb84584b274dfb59326c896 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:24.356288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73e8f9-db72-4a36-a1dd-8045270a7d5c admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:24.359295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-de73e8f9-db72-4a36-a1dd-8045270a7d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:24.470007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73e8f9-db72-4a36-a1dd-8045270a7d5c admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.549057 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d8a4-67b6-4b20-b368-f66b82d5b88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:24.550004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d8a4-67b6-4b20-b368-f66b82d5b88e admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.550391 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d8a4-67b6-4b20-b368-f66b82d5b88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.550796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d8a4-67b6-4b20-b368-f66b82d5b88e admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.551786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498d8a4-67b6-4b20-b368-f66b82d5b88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:24.553919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498d8a4-67b6-4b20-b368-f66b82d5b88e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:24.656489 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 946/1887] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:24 2022] POST /identity/v3/users => generated 287 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:24.661837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:24.673788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bdd72-2ed1-4559-92b2-156c9e830664 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.679170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd3ea8-0341-4939-bc79-3cc8eea9ca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:24.680135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd3ea8-0341-4939-bc79-3cc8eea9ca01 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.680565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd3ea8-0341-4939-bc79-3cc8eea9ca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.680984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd3ea8-0341-4939-bc79-3cc8eea9ca01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.681837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd3ea8-0341-4939-bc79-3cc8eea9ca01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:24.683657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd3ea8-0341-4939-bc79-3cc8eea9ca01 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:24.703738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 942/1888] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:24.704913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d8a4-67b6-4b20-b368-f66b82d5b88e admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:24.718254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d8a4-67b6-4b20-b368-f66b82d5b88e admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.725230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1754367-36e4-43f6-b1ee-a4ce06d05515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:24.725868 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1754367-36e4-43f6-b1ee-a4ce06d05515 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.726156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1754367-36e4-43f6-b1ee-a4ce06d05515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.726643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1754367-36e4-43f6-b1ee-a4ce06d05515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.727673 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1754367-36e4-43f6-b1ee-a4ce06d05515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:24.729301 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1754367-36e4-43f6-b1ee-a4ce06d05515 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:24.742529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 947/1889] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:24.744692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd3ea8-0341-4939-bc79-3cc8eea9ca01 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:24.755689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd3ea8-0341-4939-bc79-3cc8eea9ca01 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.760467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:24.767933 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f56056-d6b4-46ff-9b61-83fb9ff35053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:24.767933 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f56056-d6b4-46ff-9b61-83fb9ff35053 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.767933 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f56056-d6b4-46ff-9b61-83fb9ff35053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.767933 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f56056-d6b4-46ff-9b61-83fb9ff35053 admin admin] PATH_INFO: `/v3/projects/9483a04c7fe24657a940a7d2c7fd6672/users/98cd27889e354fc3b35f880927e6147f/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.781224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f56056-d6b4-46ff-9b61-83fb9ff35053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9483a04c7fe24657a940a7d2c7fd6672, user_id=98cd27889e354fc3b35f880927e6147f, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:24.783938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f56056-d6b4-46ff-9b61-83fb9ff35053 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:24.874772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1754367-36e4-43f6-b1ee-a4ce06d05515 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:24.874892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 943/1890] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:24 2022] PUT /identity/v3/projects/9483a04c7fe24657a940a7d2c7fd6672/users/98cd27889e354fc3b35f880927e6147f/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:24.878127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c1754367-36e4-43f6-b1ee-a4ce06d05515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:24.895519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849b273-abb5-4703-813e-a4f58abe223e None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.896204 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1754367-36e4-43f6-b1ee-a4ce06d05515 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.897463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849b273-abb5-4703-813e-a4f58abe223e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.898017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849b273-abb5-4703-813e-a4f58abe223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.945949 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-5849b273-abb5-4703-813e-a4f58abe223e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:24.949195 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5849b273-abb5-4703-813e-a4f58abe223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:25.002741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf7296-a42c-4582-b8bf-01c82651fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.003521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7296-a42c-4582-b8bf-01c82651fb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.003813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7296-a42c-4582-b8bf-01c82651fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.004090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7296-a42c-4582-b8bf-01c82651fb5d admin admin] PATH_INFO: `/v3/projects/099404abe7834a7a865f6100ef5181cb` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.005385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf7296-a42c-4582-b8bf-01c82651fb5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=099404abe7834a7a865f6100ef5181cb)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.007417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf7296-a42c-4582-b8bf-01c82651fb5d admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.050237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 944/1891] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:25.062411 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849b273-abb5-4703-813e-a4f58abe223e None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.069389 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5849b273-abb5-4703-813e-a4f58abe223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:25.125251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849b273-abb5-4703-813e-a4f58abe223e None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.133850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c67e-0867-47d2-b555-e5a7ff2dcac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.133850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c67e-0867-47d2-b555-e5a7ff2dcac3 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.133850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c67e-0867-47d2-b555-e5a7ff2dcac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.133850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c67e-0867-47d2-b555-e5a7ff2dcac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.142099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9c67e-0867-47d2-b555-e5a7ff2dcac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.143630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9c67e-0867-47d2-b555-e5a7ff2dcac3 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.162693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 945/1892] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:25.194192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-91cf7296-a42c-4582-b8bf-01c82651fb5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099404abe7834a7a865f6100ef5181cb', 'request_id': 'req-91cf7296-a42c-4582-b8bf-01c82651fb5d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.200683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-91cf7296-a42c-4582-b8bf-01c82651fb5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099404abe7834a7a865f6100ef5181cb', 'request_id': 'req-91cf7296-a42c-4582-b8bf-01c82651fb5d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.280518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-91cf7296-a42c-4582-b8bf-01c82651fb5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099404abe7834a7a865f6100ef5181cb', 'request_id': 'req-91cf7296-a42c-4582-b8bf-01c82651fb5d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.294362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-91cf7296-a42c-4582-b8bf-01c82651fb5d admin admin] The token cache is being invalidate because project 099404abe7834a7a865f6100ef5181cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:25.294947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-91cf7296-a42c-4582-b8bf-01c82651fb5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.295721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-91cf7296-a42c-4582-b8bf-01c82651fb5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.298005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 948/1893] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:24 2022] DELETE /identity/v3/projects/099404abe7834a7a865f6100ef5181cb => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:25.302261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92eba-3e06-4c1d-addf-6c137a4f90bf None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.302723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92eba-3e06-4c1d-addf-6c137a4f90bf None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.307659 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92eba-3e06-4c1d-addf-6c137a4f90bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.323593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-19d92eba-3e06-4c1d-addf-6c137a4f90bf None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:25.325921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-19d92eba-3e06-4c1d-addf-6c137a4f90bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:25.423717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 946/1894] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:25.433057 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9c00f-62c3-4a61-b617-bc287fe16ba3 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.433150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9c00f-62c3-4a61-b617-bc287fe16ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.433502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9c00f-62c3-4a61-b617-bc287fe16ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.462437 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-bbc9c00f-62c3-4a61-b617-bc287fe16ba3 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:25.464013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-bbc9c00f-62c3-4a61-b617-bc287fe16ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:25.474205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 949/1895] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:25.478800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92eba-3e06-4c1d-addf-6c137a4f90bf None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.490197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92eba-3e06-4c1d-addf-6c137a4f90bf None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.495583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf77a8a-dd61-4737-a141-6c5b1fc33d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.496635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77a8a-dd61-4737-a141-6c5b1fc33d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.497465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77a8a-dd61-4737-a141-6c5b1fc33d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.498012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77a8a-dd61-4737-a141-6c5b1fc33d16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.502981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf77a8a-dd61-4737-a141-6c5b1fc33d16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:25.502981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf77a8a-dd61-4737-a141-6c5b1fc33d16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.502981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf77a8a-dd61-4737-a141-6c5b1fc33d16 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.515448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 947/1896] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:25.523239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9c00f-62c3-4a61-b617-bc287fe16ba3 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.534697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9c00f-62c3-4a61-b617-bc287fe16ba3 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.541235 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fb726-061b-41b7-a633-e3fd28c4bed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.547119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fb726-061b-41b7-a633-e3fd28c4bed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.547119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fb726-061b-41b7-a633-e3fd28c4bed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.547119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fb726-061b-41b7-a633-e3fd28c4bed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.547119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fb726-061b-41b7-a633-e3fd28c4bed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.547119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fb726-061b-41b7-a633-e3fd28c4bed6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.681068 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 950/1897] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:25 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:25.686187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf77a8a-dd61-4737-a141-6c5b1fc33d16 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.697646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf77a8a-dd61-4737-a141-6c5b1fc33d16 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.800118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868a1b2-9d1b-4264-940f-cce7720bacaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.800757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868a1b2-9d1b-4264-940f-cce7720bacaf admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.801968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868a1b2-9d1b-4264-940f-cce7720bacaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.802255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868a1b2-9d1b-4264-940f-cce7720bacaf admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.803134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868a1b2-9d1b-4264-940f-cce7720bacaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.806012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868a1b2-9d1b-4264-940f-cce7720bacaf admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.829414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:25.913549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:25.951407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 948/1898] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:25 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:25.951544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fb726-061b-41b7-a633-e3fd28c4bed6 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.963341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fb726-061b-41b7-a633-e3fd28c4bed6 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.968976 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88104d-e7e3-4d04-860a-6432b85d910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.969663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88104d-e7e3-4d04-860a-6432b85d910a admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.970021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88104d-e7e3-4d04-860a-6432b85d910a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.970369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88104d-e7e3-4d04-860a-6432b85d910a admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.971188 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88104d-e7e3-4d04-860a-6432b85d910a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.981030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88104d-e7e3-4d04-860a-6432b85d910a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.983030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 951/1899] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:25.987243 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868a1b2-9d1b-4264-940f-cce7720bacaf admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.997227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868a1b2-9d1b-4264-940f-cce7720bacaf admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.006465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d46cb8-6603-4c09-ae1f-fde26635769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.007143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d46cb8-6603-4c09-ae1f-fde26635769e admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.007430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d46cb8-6603-4c09-ae1f-fde26635769e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.007707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d46cb8-6603-4c09-ae1f-fde26635769e admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.008649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d46cb8-6603-4c09-ae1f-fde26635769e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.010662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d46cb8-6603-4c09-ae1f-fde26635769e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.035874 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 949/1900] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:26.049164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88104d-e7e3-4d04-860a-6432b85d910a admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:26.074589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88104d-e7e3-4d04-860a-6432b85d910a admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.085674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7f391-0e69-49d0-963a-bb0c26f67d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.086747 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7f391-0e69-49d0-963a-bb0c26f67d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.087107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7f391-0e69-49d0-963a-bb0c26f67d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.087468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7f391-0e69-49d0-963a-bb0c26f67d5a admin admin] PATH_INFO: `/v3/projects/cf149f5c45214e87a040091d8d5a8555/users/6567139ea7ac4e399c2d326126f59245/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.104587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7f391-0e69-49d0-963a-bb0c26f67d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf149f5c45214e87a040091d8d5a8555, user_id=6567139ea7ac4e399c2d326126f59245, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.108040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7f391-0e69-49d0-963a-bb0c26f67d5a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.311885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 952/1901] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:26 2022] PUT /identity/v3/projects/cf149f5c45214e87a040091d8d5a8555/users/6567139ea7ac4e399c2d326126f59245/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:26.326793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9e0f-2277-4da7-b4b1-5bb444c900c7 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.327147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9e0f-2277-4da7-b4b1-5bb444c900c7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.327510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9e0f-2277-4da7-b4b1-5bb444c900c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.357839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-180d9e0f-2277-4da7-b4b1-5bb444c900c7 None None] MFA Rules not processed for user `6567139ea7ac4e399c2d326126f59245`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:26.359228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-180d9e0f-2277-4da7-b4b1-5bb444c900c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:26.477928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 950/1902] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:26.479617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7f391-0e69-49d0-963a-bb0c26f67d5a admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:26.592319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7f391-0e69-49d0-963a-bb0c26f67d5a admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.597181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cf341-1c64-43e2-a1ad-ad70afadc115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.600584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cf341-1c64-43e2-a1ad-ad70afadc115 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.600584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cf341-1c64-43e2-a1ad-ad70afadc115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.600584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cf341-1c64-43e2-a1ad-ad70afadc115 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.600584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cf341-1c64-43e2-a1ad-ad70afadc115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.601158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cf341-1c64-43e2-a1ad-ad70afadc115 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.704120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 953/1903] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:26 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:26.708018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9e0f-2277-4da7-b4b1-5bb444c900c7 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:26.730014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9e0f-2277-4da7-b4b1-5bb444c900c7 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.827414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f616-dc40-465f-82a4-b8d1b4da2aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.828057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f616-dc40-465f-82a4-b8d1b4da2aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.828345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f616-dc40-465f-82a4-b8d1b4da2aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.828627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f616-dc40-465f-82a4-b8d1b4da2aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.829309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78f616-dc40-465f-82a4-b8d1b4da2aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.832285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78f616-dc40-465f-82a4-b8d1b4da2aa9 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.938302 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 951/1904] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:26 2022] POST /identity/v3/users => generated 296 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:26.943108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cf341-1c64-43e2-a1ad-ad70afadc115 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:26.956569 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cf341-1c64-43e2-a1ad-ad70afadc115 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.968349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f8090-179e-4c36-ab8b-669a2de9c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.968349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f8090-179e-4c36-ab8b-669a2de9c4dc admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.968349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f8090-179e-4c36-ab8b-669a2de9c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.968769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f8090-179e-4c36-ab8b-669a2de9c4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.969587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f8090-179e-4c36-ab8b-669a2de9c4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.971539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f8090-179e-4c36-ab8b-669a2de9c4dc admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.991367 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 954/1905] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:26.992213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f616-dc40-465f-82a4-b8d1b4da2aa9 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:27.012101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f616-dc40-465f-82a4-b8d1b4da2aa9 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:27.019988 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748dbf0-7462-42f2-8b4b-9ff132d261e4 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.020290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748dbf0-7462-42f2-8b4b-9ff132d261e4 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.020642 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748dbf0-7462-42f2-8b4b-9ff132d261e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.038015 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc320a1-94a3-445a-85a3-d2835402e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:27.039230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc320a1-94a3-445a-85a3-d2835402e92a admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.042815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc320a1-94a3-445a-85a3-d2835402e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.043329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc320a1-94a3-445a-85a3-d2835402e92a admin admin] PATH_INFO: `/v3/projects/4fe9d833f35d481aa778165a335fecb4/users/d9020d33427c49b2916d0a58f5939784/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.081976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc320a1-94a3-445a-85a3-d2835402e92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe9d833f35d481aa778165a335fecb4, user_id=d9020d33427c49b2916d0a58f5939784, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:27.085193 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc320a1-94a3-445a-85a3-d2835402e92a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:27.098368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-8748dbf0-7462-42f2-8b4b-9ff132d261e4 None None] MFA Rules not processed for user `98cd27889e354fc3b35f880927e6147f`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:27.099855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8748dbf0-7462-42f2-8b4b-9ff132d261e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:27.202521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 955/1906] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:27.205404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748dbf0-7462-42f2-8b4b-9ff132d261e4 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:27.206991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8748dbf0-7462-42f2-8b4b-9ff132d261e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:27.220933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748dbf0-7462-42f2-8b4b-9ff132d261e4 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:27.225612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eca56c-fdb4-4162-8fec-87d1500473c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:27.226232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eca56c-fdb4-4162-8fec-87d1500473c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.226543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eca56c-fdb4-4162-8fec-87d1500473c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.226935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eca56c-fdb4-4162-8fec-87d1500473c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.227656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eca56c-fdb4-4162-8fec-87d1500473c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:27.229642 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eca56c-fdb4-4162-8fec-87d1500473c2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:27.253325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 952/1907] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:26 2022] PUT /identity/v3/projects/4fe9d833f35d481aa778165a335fecb4/users/d9020d33427c49b2916d0a58f5939784/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:27.257198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc320a1-94a3-445a-85a3-d2835402e92a admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:27.328018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc320a1-94a3-445a-85a3-d2835402e92a admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:27.333358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7385c-2e1f-4240-b509-0173bd541b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:27.333990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7385c-2e1f-4240-b509-0173bd541b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.334297 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7385c-2e1f-4240-b509-0173bd541b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.334903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7385c-2e1f-4240-b509-0173bd541b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.335949 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7385c-2e1f-4240-b509-0173bd541b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:27.337977 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:27.339636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7385c-2e1f-4240-b509-0173bd541b79 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:27.353444 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 953/1908] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:27.356029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7385c-2e1f-4240-b509-0173bd541b79 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:27.361941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 956/1909] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:27 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:27.366591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eca56c-fdb4-4162-8fec-87d1500473c2 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:27.370321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7385c-2e1f-4240-b509-0173bd541b79 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:27.381726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:27.444883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89871157-f79a-4f05-bf9e-9779bc06f55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:27.445589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89871157-f79a-4f05-bf9e-9779bc06f55d admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.445878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89871157-f79a-4f05-bf9e-9779bc06f55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.446771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89871157-f79a-4f05-bf9e-9779bc06f55d admin admin] PATH_INFO: `/v3/projects/4fe9d833f35d481aa778165a335fecb4/users/d9020d33427c49b2916d0a58f5939784/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.448284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89871157-f79a-4f05-bf9e-9779bc06f55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe9d833f35d481aa778165a335fecb4, user_id=d9020d33427c49b2916d0a58f5939784, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:27.451509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eca56c-fdb4-4162-8fec-87d1500473c2 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:27.452111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89871157-f79a-4f05-bf9e-9779bc06f55d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:27.456750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258149e-42cc-479e-bcb3-d050da0e00ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:27.457530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258149e-42cc-479e-bcb3-d050da0e00ed admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.457928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258149e-42cc-479e-bcb3-d050da0e00ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.458311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258149e-42cc-479e-bcb3-d050da0e00ed admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.459138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258149e-42cc-479e-bcb3-d050da0e00ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:27.461656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258149e-42cc-479e-bcb3-d050da0e00ed admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:27.466065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 954/1910] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:27 2022] PUT /identity/v3/projects/4fe9d833f35d481aa778165a335fecb4/users/d9020d33427c49b2916d0a58f5939784/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:27.483128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eb78c-e154-467f-bb0d-40407ea2a589 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.483424 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eb78c-e154-467f-bb0d-40407ea2a589 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.483691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eb78c-e154-467f-bb0d-40407ea2a589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.516045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b55eb78c-e154-467f-bb0d-40407ea2a589 None None] MFA Rules not processed for user `d9020d33427c49b2916d0a58f5939784`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:27.517302 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b55eb78c-e154-467f-bb0d-40407ea2a589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:27.549691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 957/1911] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:27 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:27.561083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258149e-42cc-479e-bcb3-d050da0e00ed admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:27.579849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258149e-42cc-479e-bcb3-d050da0e00ed admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:27.646634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 955/1912] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:27.661609 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eb78c-e154-467f-bb0d-40407ea2a589 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:27.663835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b55eb78c-e154-467f-bb0d-40407ea2a589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:27.664638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac33bec-1c82-4c8b-b7af-c530cdb3e441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:27.665376 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac33bec-1c82-4c8b-b7af-c530cdb3e441 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.665668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac33bec-1c82-4c8b-b7af-c530cdb3e441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.666754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac33bec-1c82-4c8b-b7af-c530cdb3e441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.671168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac33bec-1c82-4c8b-b7af-c530cdb3e441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:27.674436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac33bec-1c82-4c8b-b7af-c530cdb3e441 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:27.689885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 958/1913] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:27.693901 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac33bec-1c82-4c8b-b7af-c530cdb3e441 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:27.706015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac33bec-1c82-4c8b-b7af-c530cdb3e441 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:27.713669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf4d93-1b06-49bf-a7a5-27a73ef79412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:27.714781 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4d93-1b06-49bf-a7a5-27a73ef79412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.720327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4d93-1b06-49bf-a7a5-27a73ef79412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.720327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf4d93-1b06-49bf-a7a5-27a73ef79412 admin admin] PATH_INFO: `/v3/projects/f04197f8a0704a71a5f4506a2e64f7ce/users/d7466f6a0b164dbfba03f33b8467f926/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.735257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf4d93-1b06-49bf-a7a5-27a73ef79412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04197f8a0704a71a5f4506a2e64f7ce, user_id=d7466f6a0b164dbfba03f33b8467f926, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:27.738143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf4d93-1b06-49bf-a7a5-27a73ef79412 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:27.744308 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eb78c-e154-467f-bb0d-40407ea2a589 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:27.749105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9664014-0076-4848-a90b-54a554a51312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:27.749731 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9664014-0076-4848-a90b-54a554a51312 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.750018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9664014-0076-4848-a90b-54a554a51312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.750296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9664014-0076-4848-a90b-54a554a51312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.759843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9664014-0076-4848-a90b-54a554a51312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:27.761224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9664014-0076-4848-a90b-54a554a51312 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:27.771804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 956/1914] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:27.833173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 959/1915] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:27 2022] PUT /identity/v3/projects/f04197f8a0704a71a5f4506a2e64f7ce/users/d7466f6a0b164dbfba03f33b8467f926/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:27.838910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9664014-0076-4848-a90b-54a554a51312 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:27.852846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9664014-0076-4848-a90b-54a554a51312 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:27.927045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae6af3-0812-459f-b9ac-8052d9a283c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:27.928132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae6af3-0812-459f-b9ac-8052d9a283c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.928574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae6af3-0812-459f-b9ac-8052d9a283c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.928912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae6af3-0812-459f-b9ac-8052d9a283c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.929635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae6af3-0812-459f-b9ac-8052d9a283c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:27.931426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae6af3-0812-459f-b9ac-8052d9a283c5 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:27.944613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 957/1916] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:27.948439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf4d93-1b06-49bf-a7a5-27a73ef79412 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:27.960615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf4d93-1b06-49bf-a7a5-27a73ef79412 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:27.966125 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42948e4-7bc0-44b4-b229-f38a512d1890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:27.966952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42948e4-7bc0-44b4-b229-f38a512d1890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.967304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42948e4-7bc0-44b4-b229-f38a512d1890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.967655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42948e4-7bc0-44b4-b229-f38a512d1890 admin admin] PATH_INFO: `/v3/projects/f04197f8a0704a71a5f4506a2e64f7ce/users/d7466f6a0b164dbfba03f33b8467f926/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.969785 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42948e4-7bc0-44b4-b229-f38a512d1890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04197f8a0704a71a5f4506a2e64f7ce, user_id=d7466f6a0b164dbfba03f33b8467f926, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:27.972611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42948e4-7bc0-44b4-b229-f38a512d1890 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:27.984791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 960/1917] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:27 2022] PUT /identity/v3/projects/f04197f8a0704a71a5f4506a2e64f7ce/users/d7466f6a0b164dbfba03f33b8467f926/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:28.444094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:29.022325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:29.174089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae6af3-0812-459f-b9ac-8052d9a283c5 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:29.246156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae6af3-0812-459f-b9ac-8052d9a283c5 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:29.319141 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7b700-387b-4649-9106-e71fafdbfd53 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9020d33427c49b2916d0a58f5939784', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fe9d833f35d481aa778165a335fecb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:29.320283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7b700-387b-4649-9106-e71fafdbfd53 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:29.320799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7b700-387b-4649-9106-e71fafdbfd53 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:29.321283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7b700-387b-4649-9106-e71fafdbfd53 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:29.322253 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7b700-387b-4649-9106-e71fafdbfd53 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:29.322885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7b700-387b-4649-9106-e71fafdbfd53 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:29.325636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7b700-387b-4649-9106-e71fafdbfd53 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:29.341669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 958/1918] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:29.346827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42948e4-7bc0-44b4-b229-f38a512d1890 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:29.370711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42948e4-7bc0-44b4-b229-f38a512d1890 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:29.379784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355ae67-43c7-47bc-96b9-9dff8f627c55 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9020d33427c49b2916d0a58f5939784', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fe9d833f35d481aa778165a335fecb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:29.380685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355ae67-43c7-47bc-96b9-9dff8f627c55 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:29.381165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355ae67-43c7-47bc-96b9-9dff8f627c55 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:29.381452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355ae67-43c7-47bc-96b9-9dff8f627c55 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:29.382129 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355ae67-43c7-47bc-96b9-9dff8f627c55 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:29.384088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355ae67-43c7-47bc-96b9-9dff8f627c55 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:29.519008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 961/1919] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:29 2022] POST /identity/v3/projects => generated 354 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:29.522715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7b700-387b-4649-9106-e71fafdbfd53 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:29.534343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7b700-387b-4649-9106-e71fafdbfd53 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:29.616497 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a740d-7dae-44ff-addb-a55c51e6d856 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9020d33427c49b2916d0a58f5939784', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fe9d833f35d481aa778165a335fecb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:29.617266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a740d-7dae-44ff-addb-a55c51e6d856 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:29.617637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a740d-7dae-44ff-addb-a55c51e6d856 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:29.617986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a740d-7dae-44ff-addb-a55c51e6d856 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:29.619235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a740d-7dae-44ff-addb-a55c51e6d856 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:29.625369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a740d-7dae-44ff-addb-a55c51e6d856 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:29.625369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a740d-7dae-44ff-addb-a55c51e6d856 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:29.634759 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 959/1920] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:29.703671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355ae67-43c7-47bc-96b9-9dff8f627c55 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:29.726050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355ae67-43c7-47bc-96b9-9dff8f627c55 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:29.733571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257429a-c542-4d07-b29a-34574126fee5 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9020d33427c49b2916d0a58f5939784', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fe9d833f35d481aa778165a335fecb4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:29.734709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257429a-c542-4d07-b29a-34574126fee5 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:29.735488 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257429a-c542-4d07-b29a-34574126fee5 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:29.736045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257429a-c542-4d07-b29a-34574126fee5 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] PATH_INFO: `/v3/projects/59806c37d2c0430fbf261067ab09e96d` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:29.739169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257429a-c542-4d07-b29a-34574126fee5 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59806c37d2c0430fbf261067ab09e96d)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:29.741509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257429a-c542-4d07-b29a-34574126fee5 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:29.893749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b257429a-c542-4d07-b29a-34574126fee5 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59806c37d2c0430fbf261067ab09e96d', 'request_id': 'req-b257429a-c542-4d07-b29a-34574126fee5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:29.899729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b257429a-c542-4d07-b29a-34574126fee5 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59806c37d2c0430fbf261067ab09e96d', 'request_id': 'req-b257429a-c542-4d07-b29a-34574126fee5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:29.975834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b257429a-c542-4d07-b29a-34574126fee5 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59806c37d2c0430fbf261067ab09e96d', 'request_id': 'req-b257429a-c542-4d07-b29a-34574126fee5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:29.997883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b257429a-c542-4d07-b29a-34574126fee5 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] The token cache is being invalidate because project 59806c37d2c0430fbf261067ab09e96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:30.008476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b257429a-c542-4d07-b29a-34574126fee5 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:30.008476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b257429a-c542-4d07-b29a-34574126fee5 tempest-VolumeQuotaClassesTest-645354083 tempest-VolumeQuotaClassesTest-645354083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:30.008476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 962/1921] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:29 2022] DELETE /identity/v3/projects/59806c37d2c0430fbf261067ab09e96d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:30.015423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ed2d-c6d0-45d8-96c8-cbc50d23f9cc None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:30.015718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ed2d-c6d0-45d8-96c8-cbc50d23f9cc None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:30.016006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24ed2d-c6d0-45d8-96c8-cbc50d23f9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:30.096567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-ee24ed2d-c6d0-45d8-96c8-cbc50d23f9cc None None] MFA Rules not processed for user `d7466f6a0b164dbfba03f33b8467f926`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:30.098915 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ee24ed2d-c6d0-45d8-96c8-cbc50d23f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:30.203336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:30.237149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 960/1922] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:30.243507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013d5b7-3cfe-4b89-84e8-4f59466940eb None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:30.243925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013d5b7-3cfe-4b89-84e8-4f59466940eb None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:30.245301 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013d5b7-3cfe-4b89-84e8-4f59466940eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:30.275880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-7013d5b7-3cfe-4b89-84e8-4f59466940eb None None] MFA Rules not processed for user `98cd27889e354fc3b35f880927e6147f`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:30.277640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7013d5b7-3cfe-4b89-84e8-4f59466940eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:30.353635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 963/1923] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:30.365616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ed2d-c6d0-45d8-96c8-cbc50d23f9cc None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:30.369782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ee24ed2d-c6d0-45d8-96c8-cbc50d23f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:30.417019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:30.473909 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24ed2d-c6d0-45d8-96c8-cbc50d23f9cc None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:30.479859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52054ca0-d3b2-4098-a902-5b6ba5786553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:30.480511 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054ca0-d3b2-4098-a902-5b6ba5786553 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:30.480860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054ca0-d3b2-4098-a902-5b6ba5786553 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:30.481723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054ca0-d3b2-4098-a902-5b6ba5786553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:30.483869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-52054ca0-d3b2-4098-a902-5b6ba5786553 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:30.495237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52054ca0-d3b2-4098-a902-5b6ba5786553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:30.497470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52054ca0-d3b2-4098-a902-5b6ba5786553 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:30.508412 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 961/1924] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:30.908034 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013d5b7-3cfe-4b89-84e8-4f59466940eb None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:30.910246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7013d5b7-3cfe-4b89-84e8-4f59466940eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:31.021421 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013d5b7-3cfe-4b89-84e8-4f59466940eb None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:31.027416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:31.028288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.029062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.029573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] PATH_INFO: `/v3/users/6567139ea7ac4e399c2d326126f59245` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.031092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6567139ea7ac4e399c2d326126f59245)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:31.034112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:31.365187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6567139ea7ac4e399c2d326126f59245'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.379935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6567139ea7ac4e399c2d326126f59245'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.381061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6567139ea7ac4e399c2d326126f59245'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.388710 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6567139ea7ac4e399c2d326126f59245'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.439905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6567139ea7ac4e399c2d326126f59245'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.450058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 964/1925] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:30 2022] DELETE /identity/v3/users/6567139ea7ac4e399c2d326126f59245 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:31.455683 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0e91c-c27a-4948-b660-1d2bb45db551 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.456216 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0e91c-c27a-4948-b660-1d2bb45db551 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.456414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0e91c-c27a-4948-b660-1d2bb45db551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.487903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-cea0e91c-c27a-4948-b660-1d2bb45db551 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:31.489553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-cea0e91c-c27a-4948-b660-1d2bb45db551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:31.575762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 962/1926] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:31.583329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:31.587538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:31.671081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e50ec-61bb-40a8-b8c7-4869edb470e8 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:31.676820 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c76c5-0205-4e16-9a26-06a467e358d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:31.679438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c76c5-0205-4e16-9a26-06a467e358d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.679438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c76c5-0205-4e16-9a26-06a467e358d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.679438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c76c5-0205-4e16-9a26-06a467e358d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.698278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c76c5-0205-4e16-9a26-06a467e358d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:31.702603 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c76c5-0205-4e16-9a26-06a467e358d6 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:31.725959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:31.732542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 965/1927] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:31.813173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:32.771034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0e91c-c27a-4948-b660-1d2bb45db551 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:32.771034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-cea0e91c-c27a-4948-b660-1d2bb45db551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:32.807899 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0e91c-c27a-4948-b660-1d2bb45db551 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:32.821359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:32.822030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:32.822555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:32.823002 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] PATH_INFO: `/v3/projects/cf149f5c45214e87a040091d8d5a8555` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:32.824489 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf149f5c45214e87a040091d8d5a8555)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:32.827869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:32.979814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf149f5c45214e87a040091d8d5a8555', 'request_id': 'req-16a4cf52-09a7-414a-86fa-8b50d802effc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.079390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf149f5c45214e87a040091d8d5a8555', 'request_id': 'req-16a4cf52-09a7-414a-86fa-8b50d802effc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.085388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf149f5c45214e87a040091d8d5a8555', 'request_id': 'req-16a4cf52-09a7-414a-86fa-8b50d802effc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.097947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] The token cache is being invalidate because project cf149f5c45214e87a040091d8d5a8555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:33.098516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.099357 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.101192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 963/1928] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:32 2022] DELETE /identity/v3/projects/cf149f5c45214e87a040091d8d5a8555 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:33.105255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c76c5-0205-4e16-9a26-06a467e358d6 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:33.116612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c76c5-0205-4e16-9a26-06a467e358d6 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:33.187285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ff0d6-e3a2-4d58-96c2-17fcc033783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:33.188369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff0d6-e3a2-4d58-96c2-17fcc033783a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.188873 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff0d6-e3a2-4d58-96c2-17fcc033783a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.189368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff0d6-e3a2-4d58-96c2-17fcc033783a admin admin] PATH_INFO: `/v3/users/d9020d33427c49b2916d0a58f5939784` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.190915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ff0d6-e3a2-4d58-96c2-17fcc033783a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9020d33427c49b2916d0a58f5939784)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:33.193422 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ff0d6-e3a2-4d58-96c2-17fcc033783a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:33.453103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-7e2ff0d6-e3a2-4d58-96c2-17fcc033783a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9020d33427c49b2916d0a58f5939784'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.468069 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-7e2ff0d6-e3a2-4d58-96c2-17fcc033783a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9020d33427c49b2916d0a58f5939784'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.468767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-7e2ff0d6-e3a2-4d58-96c2-17fcc033783a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9020d33427c49b2916d0a58f5939784'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.476823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-7e2ff0d6-e3a2-4d58-96c2-17fcc033783a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9020d33427c49b2916d0a58f5939784'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.565344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-7e2ff0d6-e3a2-4d58-96c2-17fcc033783a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9020d33427c49b2916d0a58f5939784'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.575725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 966/1929] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:33 2022] DELETE /identity/v3/users/d9020d33427c49b2916d0a58f5939784 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:33.590554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:33.732367 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:34.591724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:34.593723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:34.608459 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4cf52-09a7-414a-86fa-8b50d802effc admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:34.686103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a88724-e495-4dd2-9673-43d7bc5dd781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:34.686946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a88724-e495-4dd2-9673-43d7bc5dd781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:34.687238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a88724-e495-4dd2-9673-43d7bc5dd781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:34.687519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a88724-e495-4dd2-9673-43d7bc5dd781 admin admin] PATH_INFO: `/v3/projects/4fe9d833f35d481aa778165a335fecb4` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:34.688814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a88724-e495-4dd2-9673-43d7bc5dd781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe9d833f35d481aa778165a335fecb4)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:34.690957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a88724-e495-4dd2-9673-43d7bc5dd781 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:34.801100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f7a88724-e495-4dd2-9673-43d7bc5dd781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe9d833f35d481aa778165a335fecb4', 'request_id': 'req-f7a88724-e495-4dd2-9673-43d7bc5dd781'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:34.862562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f7a88724-e495-4dd2-9673-43d7bc5dd781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe9d833f35d481aa778165a335fecb4', 'request_id': 'req-f7a88724-e495-4dd2-9673-43d7bc5dd781'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:34.870948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f7a88724-e495-4dd2-9673-43d7bc5dd781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe9d833f35d481aa778165a335fecb4', 'request_id': 'req-f7a88724-e495-4dd2-9673-43d7bc5dd781'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:34.896472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f7a88724-e495-4dd2-9673-43d7bc5dd781 admin admin] The token cache is being invalidate because project 4fe9d833f35d481aa778165a335fecb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:34.897371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f7a88724-e495-4dd2-9673-43d7bc5dd781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:34.898088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f7a88724-e495-4dd2-9673-43d7bc5dd781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:34.900181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 964/1930] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:34 2022] DELETE /identity/v3/projects/4fe9d833f35d481aa778165a335fecb4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:34.909872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972153-bd60-443e-a065-e3fa3f877de6 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:34.912704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972153-bd60-443e-a065-e3fa3f877de6 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:34.912704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972153-bd60-443e-a065-e3fa3f877de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:34.961978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-ca972153-bd60-443e-a065-e3fa3f877de6 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:34.968310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-ca972153-bd60-443e-a065-e3fa3f877de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:35.066519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 967/1931] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:35.076822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1509a-6d77-4093-80af-ea20362a5a59 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:35.077030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1509a-6d77-4093-80af-ea20362a5a59 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:35.077333 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1509a-6d77-4093-80af-ea20362a5a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:35.102321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6dd1509a-6d77-4093-80af-ea20362a5a59 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:35.103589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6dd1509a-6d77-4093-80af-ea20362a5a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:35.112417 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 965/1932] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:35.116802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca972153-bd60-443e-a065-e3fa3f877de6 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:35.127040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca972153-bd60-443e-a065-e3fa3f877de6 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:35.132415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bd2f5-a0a7-4cc2-8877-ed5d40534c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:35.133043 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bd2f5-a0a7-4cc2-8877-ed5d40534c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:35.133417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bd2f5-a0a7-4cc2-8877-ed5d40534c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:35.133590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bd2f5-a0a7-4cc2-8877-ed5d40534c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:35.135102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bd2f5-a0a7-4cc2-8877-ed5d40534c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:35.135418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bd2f5-a0a7-4cc2-8877-ed5d40534c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:35.138239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bd2f5-a0a7-4cc2-8877-ed5d40534c69 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:35.157514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 968/1933] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:35.158626 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1509a-6d77-4093-80af-ea20362a5a59 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:35.170575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1509a-6d77-4093-80af-ea20362a5a59 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:35.177218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf3d9d-c8a5-4fc2-a9ca-b6bd7865249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:35.178292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf3d9d-c8a5-4fc2-a9ca-b6bd7865249e admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:35.178617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf3d9d-c8a5-4fc2-a9ca-b6bd7865249e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:35.178734 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf3d9d-c8a5-4fc2-a9ca-b6bd7865249e admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:35.179423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf3d9d-c8a5-4fc2-a9ca-b6bd7865249e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:35.181407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf3d9d-c8a5-4fc2-a9ca-b6bd7865249e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:35.291993 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 966/1934] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:35 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:35.296340 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bd2f5-a0a7-4cc2-8877-ed5d40534c69 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:35.308825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bd2f5-a0a7-4cc2-8877-ed5d40534c69 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:35.395208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c424bb8-d198-4a95-b905-539f3a9ccfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:35.396165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c424bb8-d198-4a95-b905-539f3a9ccfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:35.396507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c424bb8-d198-4a95-b905-539f3a9ccfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:35.396793 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c424bb8-d198-4a95-b905-539f3a9ccfe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:35.397471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c424bb8-d198-4a95-b905-539f3a9ccfe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:35.400550 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c424bb8-d198-4a95-b905-539f3a9ccfe9 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:35.488811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 969/1935] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:35 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:35.490767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf3d9d-c8a5-4fc2-a9ca-b6bd7865249e admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:35.502326 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf3d9d-c8a5-4fc2-a9ca-b6bd7865249e admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:35.507467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ec49f-e500-490f-af92-b702405444ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:35.515935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec49f-e500-490f-af92-b702405444ee admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:35.515935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec49f-e500-490f-af92-b702405444ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:35.515935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec49f-e500-490f-af92-b702405444ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:35.515935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ec49f-e500-490f-af92-b702405444ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:35.515935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ec49f-e500-490f-af92-b702405444ee admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:35.526323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 967/1936] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:35.527703 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c424bb8-d198-4a95-b905-539f3a9ccfe9 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:35.539021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c424bb8-d198-4a95-b905-539f3a9ccfe9 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:35.548304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e61731-0f4a-4551-a7e3-75621d3527cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:35.549132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e61731-0f4a-4551-a7e3-75621d3527cd admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:35.549499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e61731-0f4a-4551-a7e3-75621d3527cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:35.549848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e61731-0f4a-4551-a7e3-75621d3527cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:35.550811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e61731-0f4a-4551-a7e3-75621d3527cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:35.552677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e61731-0f4a-4551-a7e3-75621d3527cd admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:35.570028 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 970/1937] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:35.576965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ec49f-e500-490f-af92-b702405444ee admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:35.588792 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ec49f-e500-490f-af92-b702405444ee admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:35.593797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0a3e7-5048-43f1-a180-508008d1760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:35.595203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0a3e7-5048-43f1-a180-508008d1760b admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:35.595699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0a3e7-5048-43f1-a180-508008d1760b admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:35.596203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0a3e7-5048-43f1-a180-508008d1760b admin admin] PATH_INFO: `/v3/projects/856570d4392d40f2bb29694ea0dfc3de/users/acf0abc37c7d4ce781157cae06da9280/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:35.615771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0a3e7-5048-43f1-a180-508008d1760b admin admin] RBAC: Authorizing `identity:create_grant(project_id=856570d4392d40f2bb29694ea0dfc3de, user_id=acf0abc37c7d4ce781157cae06da9280, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:35.618506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0a3e7-5048-43f1-a180-508008d1760b admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:35.742295 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 968/1938] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:35 2022] PUT /identity/v3/projects/856570d4392d40f2bb29694ea0dfc3de/users/acf0abc37c7d4ce781157cae06da9280/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:35.752347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c159b-80c6-4b0c-8a0f-52dcb4b152cf None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:35.752644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c159b-80c6-4b0c-8a0f-52dcb4b152cf None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:35.752933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c159b-80c6-4b0c-8a0f-52dcb4b152cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:35.793344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-312c159b-80c6-4b0c-8a0f-52dcb4b152cf None None] MFA Rules not processed for user `acf0abc37c7d4ce781157cae06da9280`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:35.795133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-312c159b-80c6-4b0c-8a0f-52dcb4b152cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:35.878889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 971/1939] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:35.879968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0a3e7-5048-43f1-a180-508008d1760b admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:35.905226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c159b-80c6-4b0c-8a0f-52dcb4b152cf None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:35.906946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-312c159b-80c6-4b0c-8a0f-52dcb4b152cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:35.953976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0a3e7-5048-43f1-a180-508008d1760b admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:35.956789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:35.960638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e888b-9d73-46fa-96a0-9fe47ee0acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:35.961486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e888b-9d73-46fa-96a0-9fe47ee0acc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:35.961839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e888b-9d73-46fa-96a0-9fe47ee0acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:35.962182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e888b-9d73-46fa-96a0-9fe47ee0acc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:35.964459 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e888b-9d73-46fa-96a0-9fe47ee0acc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:35.975962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e888b-9d73-46fa-96a0-9fe47ee0acc9 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:35.977531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c159b-80c6-4b0c-8a0f-52dcb4b152cf None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:35.982564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6451d-d64c-44a1-8919-b629e384992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:35.983230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6451d-d64c-44a1-8919-b629e384992b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:35.983936 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6451d-d64c-44a1-8919-b629e384992b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:35.984362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6451d-d64c-44a1-8919-b629e384992b admin admin] PATH_INFO: `/v3/users/01edd8ec787c401f9f385da421e3a534` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:35.985590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6451d-d64c-44a1-8919-b629e384992b admin admin] RBAC: Authorizing `identity:delete_user(user_id=01edd8ec787c401f9f385da421e3a534)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:35.987606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6451d-d64c-44a1-8919-b629e384992b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:35.994921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:36.083518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 969/1940] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:35 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:36.084740 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e888b-9d73-46fa-96a0-9fe47ee0acc9 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:36.163656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e888b-9d73-46fa-96a0-9fe47ee0acc9 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:36.169624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c27825-6637-4d07-a368-7f6f63de8ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:36.170093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27825-6637-4d07-a368-7f6f63de8ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:36.170477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27825-6637-4d07-a368-7f6f63de8ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:36.170859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27825-6637-4d07-a368-7f6f63de8ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:36.171795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c27825-6637-4d07-a368-7f6f63de8ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:36.175088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c27825-6637-4d07-a368-7f6f63de8ac5 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:36.333490 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 970/1941] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:36 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:36.335502 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c27825-6637-4d07-a368-7f6f63de8ac5 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:36.340950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-32f6451d-d64c-44a1-8919-b629e384992b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01edd8ec787c401f9f385da421e3a534'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:36.349736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c27825-6637-4d07-a368-7f6f63de8ac5 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:36.355238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-32f6451d-d64c-44a1-8919-b629e384992b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01edd8ec787c401f9f385da421e3a534'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:36.356344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-32f6451d-d64c-44a1-8919-b629e384992b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01edd8ec787c401f9f385da421e3a534'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:36.358208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772c044-3be1-478e-be40-806c8e8f9c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:36.358882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772c044-3be1-478e-be40-806c8e8f9c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:36.359304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772c044-3be1-478e-be40-806c8e8f9c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:36.359594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772c044-3be1-478e-be40-806c8e8f9c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:36.361820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772c044-3be1-478e-be40-806c8e8f9c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:36.363512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772c044-3be1-478e-be40-806c8e8f9c5c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:36.366999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-32f6451d-d64c-44a1-8919-b629e384992b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01edd8ec787c401f9f385da421e3a534'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:36.379396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 971/1942] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:36.383574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772c044-3be1-478e-be40-806c8e8f9c5c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:36.385640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0772c044-3be1-478e-be40-806c8e8f9c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:36.409420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:36.415194 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772c044-3be1-478e-be40-806c8e8f9c5c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:36.420939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d70d5-a720-4375-a1a7-1ef375c39e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:36.423252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d70d5-a720-4375-a1a7-1ef375c39e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:36.423252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d70d5-a720-4375-a1a7-1ef375c39e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:36.423252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d70d5-a720-4375-a1a7-1ef375c39e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:36.423252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d70d5-a720-4375-a1a7-1ef375c39e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:36.424385 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d70d5-a720-4375-a1a7-1ef375c39e13 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:36.435423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 972/1943] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:36.439739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d70d5-a720-4375-a1a7-1ef375c39e13 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:36.446172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-32f6451d-d64c-44a1-8919-b629e384992b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01edd8ec787c401f9f385da421e3a534'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:36.449723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d70d5-a720-4375-a1a7-1ef375c39e13 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:36.456182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 972/1944] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:35 2022] DELETE /identity/v3/users/01edd8ec787c401f9f385da421e3a534 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:36.460459 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84c197-c7a5-41f3-876b-09881ff39b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:36.460678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d8096-863d-4229-929f-12052c898915 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:36.460977 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d8096-863d-4229-929f-12052c898915 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:36.461263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d8096-863d-4229-929f-12052c898915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:36.461445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84c197-c7a5-41f3-876b-09881ff39b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:36.461973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84c197-c7a5-41f3-876b-09881ff39b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:36.461973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84c197-c7a5-41f3-876b-09881ff39b84 admin admin] PATH_INFO: `/v3/projects/92834f3f95a94f0eb19359b08d2f1504/users/ef802f277b4d4c889710a4158c604315/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:36.477702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84c197-c7a5-41f3-876b-09881ff39b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92834f3f95a94f0eb19359b08d2f1504, user_id=ef802f277b4d4c889710a4158c604315, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:36.480439 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84c197-c7a5-41f3-876b-09881ff39b84 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:36.480847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-d61d8096-863d-4229-929f-12052c898915 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:36.482911 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d61d8096-863d-4229-929f-12052c898915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:36.546715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 973/1945] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:36.554077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d8096-863d-4229-929f-12052c898915 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:36.555518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d61d8096-863d-4229-929f-12052c898915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:36.561318 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 973/1946] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:36 2022] PUT /identity/v3/projects/92834f3f95a94f0eb19359b08d2f1504/users/ef802f277b4d4c889710a4158c604315/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:36.572802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6207fe0-473b-4cbf-a407-90684393cb03 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:36.573155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6207fe0-473b-4cbf-a407-90684393cb03 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:36.573452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6207fe0-473b-4cbf-a407-90684393cb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:36.607241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-a6207fe0-473b-4cbf-a407-90684393cb03 None None] MFA Rules not processed for user `ef802f277b4d4c889710a4158c604315`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:36.608418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a6207fe0-473b-4cbf-a407-90684393cb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:36.645044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d8096-863d-4229-929f-12052c898915 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:36.688187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 974/1947] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:36.692886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6207fe0-473b-4cbf-a407-90684393cb03 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:36.723323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71085c3f-e6e9-473b-9705-088b4b63b347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:36.724535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71085c3f-e6e9-473b-9705-088b4b63b347 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:36.725132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71085c3f-e6e9-473b-9705-088b4b63b347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:36.725621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71085c3f-e6e9-473b-9705-088b4b63b347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:36.768563 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6207fe0-473b-4cbf-a407-90684393cb03 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:36.775061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc95705-5a77-4cea-a89c-5c66b6ef3bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:36.775819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc95705-5a77-4cea-a89c-5c66b6ef3bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:36.776160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc95705-5a77-4cea-a89c-5c66b6ef3bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:36.778690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc95705-5a77-4cea-a89c-5c66b6ef3bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:36.778690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc95705-5a77-4cea-a89c-5c66b6ef3bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:36.779900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc95705-5a77-4cea-a89c-5c66b6ef3bbe admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:36.818511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71085c3f-e6e9-473b-9705-088b4b63b347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:36.820188 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71085c3f-e6e9-473b-9705-088b4b63b347 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:36.829929 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:36.832163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 974/1948] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:36.888034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 975/1949] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:36 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:36.892176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71085c3f-e6e9-473b-9705-088b4b63b347 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:36.921194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71085c3f-e6e9-473b-9705-088b4b63b347 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:37.007200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae3bc0-f724-4a46-85a5-2fa50aba6f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:37.007923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae3bc0-f724-4a46-85a5-2fa50aba6f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:37.008112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae3bc0-f724-4a46-85a5-2fa50aba6f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:37.008394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae3bc0-f724-4a46-85a5-2fa50aba6f92 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:37.009111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae3bc0-f724-4a46-85a5-2fa50aba6f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:37.011100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae3bc0-f724-4a46-85a5-2fa50aba6f92 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:37.138441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 975/1950] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:36 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:37.144858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc95705-5a77-4cea-a89c-5c66b6ef3bbe admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:37.157515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc95705-5a77-4cea-a89c-5c66b6ef3bbe admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:37.163865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb0f20-a2e0-4aa1-9605-a83a8ec6cfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:37.164571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb0f20-a2e0-4aa1-9605-a83a8ec6cfaf admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:37.164785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb0f20-a2e0-4aa1-9605-a83a8ec6cfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:37.165592 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb0f20-a2e0-4aa1-9605-a83a8ec6cfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:37.165985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb0f20-a2e0-4aa1-9605-a83a8ec6cfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:37.168494 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb0f20-a2e0-4aa1-9605-a83a8ec6cfaf admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:37.185566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 976/1951] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:37.187230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae3bc0-f724-4a46-85a5-2fa50aba6f92 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:37.188889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:37.199446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae3bc0-f724-4a46-85a5-2fa50aba6f92 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:37.206088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9a092-1a49-4835-b713-93cf43981d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:37.207093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9a092-1a49-4835-b713-93cf43981d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:37.207538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9a092-1a49-4835-b713-93cf43981d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:37.207927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9a092-1a49-4835-b713-93cf43981d48 admin admin] PATH_INFO: `/v3/projects/fbfda8667b8542e8886a5b36ee41de83/users/5c2e05ba52664f26a5d43045733b5d6b/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:37.226435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9a092-1a49-4835-b713-93cf43981d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfda8667b8542e8886a5b36ee41de83, user_id=5c2e05ba52664f26a5d43045733b5d6b, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:37.229519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9a092-1a49-4835-b713-93cf43981d48 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:37.337709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 976/1952] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:37 2022] PUT /identity/v3/projects/fbfda8667b8542e8886a5b36ee41de83/users/5c2e05ba52664f26a5d43045733b5d6b/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:37.341908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb0f20-a2e0-4aa1-9605-a83a8ec6cfaf admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:37.351970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb0f20-a2e0-4aa1-9605-a83a8ec6cfaf admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:37.411407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ccbf0-eb16-4f98-8dbd-cb32852a6179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:37.412264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ccbf0-eb16-4f98-8dbd-cb32852a6179 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:37.412547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ccbf0-eb16-4f98-8dbd-cb32852a6179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:37.412895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ccbf0-eb16-4f98-8dbd-cb32852a6179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:37.413643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ccbf0-eb16-4f98-8dbd-cb32852a6179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:37.415376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ccbf0-eb16-4f98-8dbd-cb32852a6179 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:37.421287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9a092-1a49-4835-b713-93cf43981d48 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:37.423722 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b2d9a092-1a49-4835-b713-93cf43981d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:37.431618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 977/1953] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:37.437844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ccbf0-eb16-4f98-8dbd-cb32852a6179 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:37.446911 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9a092-1a49-4835-b713-93cf43981d48 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:37.448557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ccbf0-eb16-4f98-8dbd-cb32852a6179 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:37.452852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:37.453518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:37.453864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:37.454150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] PATH_INFO: `/v3/projects/3e2ea8e413ef416fbe828cdf5e02de4e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:37.455792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2ea8e413ef416fbe828cdf5e02de4e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:37.456292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a540-c2e8-4518-8670-8acb2972db77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:37.457197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a540-c2e8-4518-8670-8acb2972db77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:37.457687 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a540-c2e8-4518-8670-8acb2972db77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:37.458169 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a540-c2e8-4518-8670-8acb2972db77 admin admin] PATH_INFO: `/v3/projects/fbfda8667b8542e8886a5b36ee41de83/users/5c2e05ba52664f26a5d43045733b5d6b/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:37.458522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:37.471865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a540-c2e8-4518-8670-8acb2972db77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfda8667b8542e8886a5b36ee41de83, user_id=5c2e05ba52664f26a5d43045733b5d6b, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:37.476302 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a540-c2e8-4518-8670-8acb2972db77 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:37.492324 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 978/1954] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:37 2022] PUT /identity/v3/projects/fbfda8667b8542e8886a5b36ee41de83/users/5c2e05ba52664f26a5d43045733b5d6b/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:37.503345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f666cff-ea15-4f57-994d-668b44009ff2 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:37.503659 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f666cff-ea15-4f57-994d-668b44009ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:37.503935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f666cff-ea15-4f57-994d-668b44009ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:37.532566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-5f666cff-ea15-4f57-994d-668b44009ff2 None None] MFA Rules not processed for user `5c2e05ba52664f26a5d43045733b5d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:37.533890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5f666cff-ea15-4f57-994d-668b44009ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:37.596449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2ea8e413ef416fbe828cdf5e02de4e', 'request_id': 'req-603a0862-eda8-4c06-acbb-dba33d722617'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:37.602264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2ea8e413ef416fbe828cdf5e02de4e', 'request_id': 'req-603a0862-eda8-4c06-acbb-dba33d722617'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:37.608949 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 979/1955] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:37.620149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f666cff-ea15-4f57-994d-668b44009ff2 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:37.621760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5f666cff-ea15-4f57-994d-668b44009ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:37.644778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2ea8e413ef416fbe828cdf5e02de4e', 'request_id': 'req-603a0862-eda8-4c06-acbb-dba33d722617'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:37.665428 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] The token cache is being invalidate because project 3e2ea8e413ef416fbe828cdf5e02de4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:37.665798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:37.666625 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:37.668665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 977/1956] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:37 2022] DELETE /identity/v3/projects/3e2ea8e413ef416fbe828cdf5e02de4e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:37.673076 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:37.674820 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:37.692753 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f666cff-ea15-4f57-994d-668b44009ff2 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:37.748450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a0862-eda8-4c06-acbb-dba33d722617 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:37.753472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2ef23-1db0-4ac5-93dd-a19264bcfa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:37.753745 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d87e4-5fd3-403a-8a95-e8717b2d1cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:37.754410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d87e4-5fd3-403a-8a95-e8717b2d1cec service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:37.754879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d87e4-5fd3-403a-8a95-e8717b2d1cec service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:37.755001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2ef23-1db0-4ac5-93dd-a19264bcfa15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:37.755164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2ef23-1db0-4ac5-93dd-a19264bcfa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:37.755267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d87e4-5fd3-403a-8a95-e8717b2d1cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:37.755442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2ef23-1db0-4ac5-93dd-a19264bcfa15 admin admin] PATH_INFO: `/v3/users/f0ca79f038f54818b781f6bb15af24a7` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:37.756981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-211d87e4-5fd3-403a-8a95-e8717b2d1cec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:37.757102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2ef23-1db0-4ac5-93dd-a19264bcfa15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ca79f038f54818b781f6bb15af24a7)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:37.759612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2ef23-1db0-4ac5-93dd-a19264bcfa15 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:37.844524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d87e4-5fd3-403a-8a95-e8717b2d1cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:37.845981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d87e4-5fd3-403a-8a95-e8717b2d1cec service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:37.858078 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 980/1957] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:37.974663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-80d2ef23-1db0-4ac5-93dd-a19264bcfa15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ca79f038f54818b781f6bb15af24a7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:37.988882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-80d2ef23-1db0-4ac5-93dd-a19264bcfa15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ca79f038f54818b781f6bb15af24a7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:37.989732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-80d2ef23-1db0-4ac5-93dd-a19264bcfa15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ca79f038f54818b781f6bb15af24a7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:37.998108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-80d2ef23-1db0-4ac5-93dd-a19264bcfa15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ca79f038f54818b781f6bb15af24a7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:38.096826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-80d2ef23-1db0-4ac5-93dd-a19264bcfa15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ca79f038f54818b781f6bb15af24a7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:38.099767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:38.103828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 978/1958] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:37 2022] DELETE /identity/v3/users/f0ca79f038f54818b781f6bb15af24a7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:38.401192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:38.586341 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d87e4-5fd3-403a-8a95-e8717b2d1cec service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:38.608387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d87e4-5fd3-403a-8a95-e8717b2d1cec service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:38.698795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:38.699495 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:38.700091 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:38.701254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c admin admin] PATH_INFO: `/v3/projects/d9d69c03fcc34c259f2d3bbd9d5da94c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:38.702939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d69c03fcc34c259f2d3bbd9d5da94c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:38.705301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:38.771208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:38.822827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d69c03fcc34c259f2d3bbd9d5da94c', 'request_id': 'req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:38.942204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d69c03fcc34c259f2d3bbd9d5da94c', 'request_id': 'req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:38.948454 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d69c03fcc34c259f2d3bbd9d5da94c', 'request_id': 'req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:38.960544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c admin admin] The token cache is being invalidate because project d9d69c03fcc34c259f2d3bbd9d5da94c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:38.960768 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:38.961421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0deb389a-cf50-4ed0-b81e-5bac054c0b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:38.963031 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 981/1959] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:38 2022] DELETE /identity/v3/projects/d9d69c03fcc34c259f2d3bbd9d5da94c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:38.969168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10116c98-f024-48c9-8258-da279d6f83dc None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:38.969742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10116c98-f024-48c9-8258-da279d6f83dc None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:38.970305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10116c98-f024-48c9-8258-da279d6f83dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:38.993263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-10116c98-f024-48c9-8258-da279d6f83dc None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:38.994824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-10116c98-f024-48c9-8258-da279d6f83dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:39.074218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 979/1960] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:39.083337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a08fe7-9940-4982-83e7-2ef225f6ac19 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:39.083941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a08fe7-9940-4982-83e7-2ef225f6ac19 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:39.085893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a08fe7-9940-4982-83e7-2ef225f6ac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:39.109126 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-a3a08fe7-9940-4982-83e7-2ef225f6ac19 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:39.114638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a3a08fe7-9940-4982-83e7-2ef225f6ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:39.120673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 982/1961] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:39.125195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10116c98-f024-48c9-8258-da279d6f83dc None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:39.131262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:39.137332 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10116c98-f024-48c9-8258-da279d6f83dc None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:39.143019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262dc74-b198-4ac7-b52f-0035465b6c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:39.143662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262dc74-b198-4ac7-b52f-0035465b6c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:39.143942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262dc74-b198-4ac7-b52f-0035465b6c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:39.144573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262dc74-b198-4ac7-b52f-0035465b6c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:39.145278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262dc74-b198-4ac7-b52f-0035465b6c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:39.145744 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262dc74-b198-4ac7-b52f-0035465b6c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:39.147453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262dc74-b198-4ac7-b52f-0035465b6c57 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:39.161385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 980/1962] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:37:39.173602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a08fe7-9940-4982-83e7-2ef225f6ac19 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:39.174890 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262dc74-b198-4ac7-b52f-0035465b6c57 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:39.176443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c262dc74-b198-4ac7-b52f-0035465b6c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:39.186046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a08fe7-9940-4982-83e7-2ef225f6ac19 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:39.191415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d0db5-0d65-4c1d-9358-4d3c47d256b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:39.192105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d0db5-0d65-4c1d-9358-4d3c47d256b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:39.192509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d0db5-0d65-4c1d-9358-4d3c47d256b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:39.192859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d0db5-0d65-4c1d-9358-4d3c47d256b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:39.193579 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d0db5-0d65-4c1d-9358-4d3c47d256b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:39.195566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d0db5-0d65-4c1d-9358-4d3c47d256b0 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:39.249851 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262dc74-b198-4ac7-b52f-0035465b6c57 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:39.249851 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d27a6-5ebf-4384-82ba-efd397aee71f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:39.250582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d27a6-5ebf-4384-82ba-efd397aee71f service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:39.250875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d27a6-5ebf-4384-82ba-efd397aee71f service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:39.251650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d27a6-5ebf-4384-82ba-efd397aee71f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:39.253778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-378d27a6-5ebf-4384-82ba-efd397aee71f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:39.316391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 983/1963] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:39 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:39.320625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d0db5-0d65-4c1d-9358-4d3c47d256b0 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:39.325406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d27a6-5ebf-4384-82ba-efd397aee71f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:39.326947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d27a6-5ebf-4384-82ba-efd397aee71f service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:39.337788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 981/1964] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:39.398247 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d0db5-0d65-4c1d-9358-4d3c47d256b0 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:39.406467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77118470-1300-460b-b9d7-376c1d63b9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:39.412070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77118470-1300-460b-b9d7-376c1d63b9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:39.412070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77118470-1300-460b-b9d7-376c1d63b9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:39.412070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77118470-1300-460b-b9d7-376c1d63b9f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:39.412070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77118470-1300-460b-b9d7-376c1d63b9f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:39.412070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77118470-1300-460b-b9d7-376c1d63b9f7 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:39.494645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 984/1965] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:39 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:39.499487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d27a6-5ebf-4384-82ba-efd397aee71f service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:39.515850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d27a6-5ebf-4384-82ba-efd397aee71f service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:39.521493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c49a42-c509-494b-81e0-c56bc4ed4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:39.522372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c49a42-c509-494b-81e0-c56bc4ed4bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:39.522837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c49a42-c509-494b-81e0-c56bc4ed4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:39.523293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c49a42-c509-494b-81e0-c56bc4ed4bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:39.524738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c49a42-c509-494b-81e0-c56bc4ed4bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:39.527235 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c49a42-c509-494b-81e0-c56bc4ed4bc4 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:39.541332 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 982/1966] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:39.546158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77118470-1300-460b-b9d7-376c1d63b9f7 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:39.557367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77118470-1300-460b-b9d7-376c1d63b9f7 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:39.564291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9021655-80c4-4504-b156-6912cd7b8e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:39.564912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9021655-80c4-4504-b156-6912cd7b8e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:39.565201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9021655-80c4-4504-b156-6912cd7b8e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:39.565482 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9021655-80c4-4504-b156-6912cd7b8e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:39.566188 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9021655-80c4-4504-b156-6912cd7b8e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:39.567850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9021655-80c4-4504-b156-6912cd7b8e1e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:39.580029 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 985/1967] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:39.584462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c49a42-c509-494b-81e0-c56bc4ed4bc4 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:39.595190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c49a42-c509-494b-81e0-c56bc4ed4bc4 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:39.599995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d455e-083c-4a94-a7ca-f0868f8a4be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:39.600671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d455e-083c-4a94-a7ca-f0868f8a4be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:39.600959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d455e-083c-4a94-a7ca-f0868f8a4be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:39.601237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d455e-083c-4a94-a7ca-f0868f8a4be5 admin admin] PATH_INFO: `/v3/projects/3bf8286df66e46729dc2686295e44789/users/6ed294443b574e39bd47731c87117bf4/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:39.619656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d455e-083c-4a94-a7ca-f0868f8a4be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf8286df66e46729dc2686295e44789, user_id=6ed294443b574e39bd47731c87117bf4, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:39.622681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d455e-083c-4a94-a7ca-f0868f8a4be5 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:39.729073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 983/1968] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:39 2022] PUT /identity/v3/projects/3bf8286df66e46729dc2686295e44789/users/6ed294443b574e39bd47731c87117bf4/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:39.737838 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50101-e1aa-4beb-a78c-f53da068d533 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:39.738352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50101-e1aa-4beb-a78c-f53da068d533 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:39.738447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50101-e1aa-4beb-a78c-f53da068d533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:39.767764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-dba50101-e1aa-4beb-a78c-f53da068d533 None None] MFA Rules not processed for user `6ed294443b574e39bd47731c87117bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:39.769116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-dba50101-e1aa-4beb-a78c-f53da068d533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:39.805778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:39.847137 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 986/1969] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:39.852805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d455e-083c-4a94-a7ca-f0868f8a4be5 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:39.941780 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d455e-083c-4a94-a7ca-f0868f8a4be5 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:39.947309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47c4e-499a-4dc2-a6d4-2a99aa717c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:39.947973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47c4e-499a-4dc2-a6d4-2a99aa717c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:39.948261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47c4e-499a-4dc2-a6d4-2a99aa717c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:39.948547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47c4e-499a-4dc2-a6d4-2a99aa717c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:39.949257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f47c4e-499a-4dc2-a6d4-2a99aa717c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:39.953561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f47c4e-499a-4dc2-a6d4-2a99aa717c57 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.020917 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 984/1970] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:39 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:40.024506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba50101-e1aa-4beb-a78c-f53da068d533 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.041651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba50101-e1aa-4beb-a78c-f53da068d533 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.173892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8af6f-8dc8-45d9-b109-d931a9441114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.174706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8af6f-8dc8-45d9-b109-d931a9441114 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.175072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8af6f-8dc8-45d9-b109-d931a9441114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.175426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8af6f-8dc8-45d9-b109-d931a9441114 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.176978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8af6f-8dc8-45d9-b109-d931a9441114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:40.179910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8af6f-8dc8-45d9-b109-d931a9441114 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.185846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:40.299569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 987/1971] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:40 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:40.303819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47c4e-499a-4dc2-a6d4-2a99aa717c57 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.326739 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47c4e-499a-4dc2-a6d4-2a99aa717c57 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.333948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76a2d9-010a-4a9a-96b6-61b0d77ec447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.334665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76a2d9-010a-4a9a-96b6-61b0d77ec447 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.334951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76a2d9-010a-4a9a-96b6-61b0d77ec447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.335287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76a2d9-010a-4a9a-96b6-61b0d77ec447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.335999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76a2d9-010a-4a9a-96b6-61b0d77ec447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:40.337623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76a2d9-010a-4a9a-96b6-61b0d77ec447 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.349789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 985/1972] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:40.358635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8af6f-8dc8-45d9-b109-d931a9441114 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.369259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8af6f-8dc8-45d9-b109-d931a9441114 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.376563 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4ec2d-3f6e-4a43-8857-e7b75c86242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.377256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4ec2d-3f6e-4a43-8857-e7b75c86242c admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.377535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4ec2d-3f6e-4a43-8857-e7b75c86242c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.377828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4ec2d-3f6e-4a43-8857-e7b75c86242c admin admin] PATH_INFO: `/v3/projects/56565ed0c9854c4cb196dfb313c23035/users/89b0efcefdfc48b6bf502f0e66e24111/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.395371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4ec2d-3f6e-4a43-8857-e7b75c86242c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56565ed0c9854c4cb196dfb313c23035, user_id=89b0efcefdfc48b6bf502f0e66e24111, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:40.398089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4ec2d-3f6e-4a43-8857-e7b75c86242c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.475064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 988/1973] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:40 2022] PUT /identity/v3/projects/56565ed0c9854c4cb196dfb313c23035/users/89b0efcefdfc48b6bf502f0e66e24111/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:40.479228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76a2d9-010a-4a9a-96b6-61b0d77ec447 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.490045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76a2d9-010a-4a9a-96b6-61b0d77ec447 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.565445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966aee76-9dd5-4490-9230-c003085d0e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.566183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966aee76-9dd5-4490-9230-c003085d0e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.566608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966aee76-9dd5-4490-9230-c003085d0e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.566911 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966aee76-9dd5-4490-9230-c003085d0e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.567610 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966aee76-9dd5-4490-9230-c003085d0e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:40.569430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966aee76-9dd5-4490-9230-c003085d0e84 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.582995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 986/1974] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:40.586255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4ec2d-3f6e-4a43-8857-e7b75c86242c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.602830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4ec2d-3f6e-4a43-8857-e7b75c86242c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.610821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609f94d-fd9b-4b19-8d1a-4a12f4b45050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.611641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609f94d-fd9b-4b19-8d1a-4a12f4b45050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.612051 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609f94d-fd9b-4b19-8d1a-4a12f4b45050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.612416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609f94d-fd9b-4b19-8d1a-4a12f4b45050 admin admin] PATH_INFO: `/v3/projects/56565ed0c9854c4cb196dfb313c23035/users/89b0efcefdfc48b6bf502f0e66e24111/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.614872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609f94d-fd9b-4b19-8d1a-4a12f4b45050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56565ed0c9854c4cb196dfb313c23035, user_id=89b0efcefdfc48b6bf502f0e66e24111, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:40.617673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609f94d-fd9b-4b19-8d1a-4a12f4b45050 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.630084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 989/1975] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:40 2022] PUT /identity/v3/projects/56565ed0c9854c4cb196dfb313c23035/users/89b0efcefdfc48b6bf502f0e66e24111/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:40.640831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037e9ee-c0ef-47a6-b74c-651fd0b89657 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.641124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037e9ee-c0ef-47a6-b74c-651fd0b89657 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.641426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037e9ee-c0ef-47a6-b74c-651fd0b89657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.672844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-6037e9ee-c0ef-47a6-b74c-651fd0b89657 None None] MFA Rules not processed for user `89b0efcefdfc48b6bf502f0e66e24111`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:40.674260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-6037e9ee-c0ef-47a6-b74c-651fd0b89657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:40.714368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:40.748822 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 987/1976] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:40.759958 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609f94d-fd9b-4b19-8d1a-4a12f4b45050 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.761950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0609f94d-fd9b-4b19-8d1a-4a12f4b45050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:40.823100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609f94d-fd9b-4b19-8d1a-4a12f4b45050 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.827535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c29786-358f-479a-b2e0-217eba3f7ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.828871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c29786-358f-479a-b2e0-217eba3f7ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.828871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c29786-358f-479a-b2e0-217eba3f7ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.828871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c29786-358f-479a-b2e0-217eba3f7ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.838254 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c29786-358f-479a-b2e0-217eba3f7ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:40.839741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c29786-358f-479a-b2e0-217eba3f7ec2 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.852152 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 990/1977] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:41.274113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037e9ee-c0ef-47a6-b74c-651fd0b89657 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:41.286211 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037e9ee-c0ef-47a6-b74c-651fd0b89657 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:41.291480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5c815-5398-427b-a33e-87ddb7cd6e05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:41.292396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5c815-5398-427b-a33e-87ddb7cd6e05 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:41.293037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5c815-5398-427b-a33e-87ddb7cd6e05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:41.293864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5c815-5398-427b-a33e-87ddb7cd6e05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:41.380445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5c815-5398-427b-a33e-87ddb7cd6e05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:41.384344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5c815-5398-427b-a33e-87ddb7cd6e05 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:41.397925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 988/1978] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:41.515431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:41.652690 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:42.296736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:42.660129 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c29786-358f-479a-b2e0-217eba3f7ec2 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:42.663350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-43c29786-358f-479a-b2e0-217eba3f7ec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:42.736583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c29786-358f-479a-b2e0-217eba3f7ec2 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:42.741464 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757de56-48a4-4fb6-a39a-fc138eef6e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:42.742119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757de56-48a4-4fb6-a39a-fc138eef6e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:42.742406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757de56-48a4-4fb6-a39a-fc138eef6e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:42.742721 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757de56-48a4-4fb6-a39a-fc138eef6e58 admin admin] PATH_INFO: `/v3/users/d8bc44049ca2427883806568abab2681` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:42.742834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:42.744419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757de56-48a4-4fb6-a39a-fc138eef6e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8bc44049ca2427883806568abab2681)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:42.746349 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757de56-48a4-4fb6-a39a-fc138eef6e58 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:42.940089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0757de56-48a4-4fb6-a39a-fc138eef6e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8bc44049ca2427883806568abab2681'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:42.999321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0757de56-48a4-4fb6-a39a-fc138eef6e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8bc44049ca2427883806568abab2681'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:43.009220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0757de56-48a4-4fb6-a39a-fc138eef6e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8bc44049ca2427883806568abab2681'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:43.010512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0757de56-48a4-4fb6-a39a-fc138eef6e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8bc44049ca2427883806568abab2681'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:43.011281 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0757de56-48a4-4fb6-a39a-fc138eef6e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8bc44049ca2427883806568abab2681'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:43.032044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 991/1979] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:42 2022] DELETE /identity/v3/users/d8bc44049ca2427883806568abab2681 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:43.176913 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:43.332863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5c815-5398-427b-a33e-87ddb7cd6e05 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:43.346149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5c815-5398-427b-a33e-87ddb7cd6e05 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:43.413051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1705a-e604-420f-873d-054e71768c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:43.413842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1705a-e604-420f-873d-054e71768c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:43.414131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1705a-e604-420f-873d-054e71768c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:43.414430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1705a-e604-420f-873d-054e71768c81 admin admin] PATH_INFO: `/v3/projects/a9b0b8e8bfa74696bea98b9aa0f19951` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:43.415697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1705a-e604-420f-873d-054e71768c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b0b8e8bfa74696bea98b9aa0f19951)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:43.417631 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1705a-e604-420f-873d-054e71768c81 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:43.558396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-75a1705a-e604-420f-873d-054e71768c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'request_id': 'req-75a1705a-e604-420f-873d-054e71768c81'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:43.566115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-75a1705a-e604-420f-873d-054e71768c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'request_id': 'req-75a1705a-e604-420f-873d-054e71768c81'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:43.647305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-75a1705a-e604-420f-873d-054e71768c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b0b8e8bfa74696bea98b9aa0f19951', 'request_id': 'req-75a1705a-e604-420f-873d-054e71768c81'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:43.677802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-75a1705a-e604-420f-873d-054e71768c81 admin admin] The token cache is being invalidate because project a9b0b8e8bfa74696bea98b9aa0f19951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:43.678109 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-75a1705a-e604-420f-873d-054e71768c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:43.682901 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-75a1705a-e604-420f-873d-054e71768c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:43.687666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 989/1980] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:43 2022] DELETE /identity/v3/projects/a9b0b8e8bfa74696bea98b9aa0f19951 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:43.693859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0efff-34b4-488b-ab21-1e119bf08be4 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:43.694683 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0efff-34b4-488b-ab21-1e119bf08be4 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:43.695148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0efff-34b4-488b-ab21-1e119bf08be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:43.725072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-32b0efff-34b4-488b-ab21-1e119bf08be4 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:43.726824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-32b0efff-34b4-488b-ab21-1e119bf08be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:43.810011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 992/1981] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:43.818555 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e20523-df74-4182-96f4-24c71042ac1c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:43.819067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e20523-df74-4182-96f4-24c71042ac1c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:43.819311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e20523-df74-4182-96f4-24c71042ac1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:43.846618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-20e20523-df74-4182-96f4-24c71042ac1c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:43.848218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-20e20523-df74-4182-96f4-24c71042ac1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:43.857731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 990/1982] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:43.865491 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0efff-34b4-488b-ab21-1e119bf08be4 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:43.877202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0efff-34b4-488b-ab21-1e119bf08be4 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:43.882184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faa2b0-604f-4c2f-be6e-b81a6830cf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:43.882843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faa2b0-604f-4c2f-be6e-b81a6830cf3a admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:43.883134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faa2b0-604f-4c2f-be6e-b81a6830cf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:43.883407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faa2b0-604f-4c2f-be6e-b81a6830cf3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:43.884103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4faa2b0-604f-4c2f-be6e-b81a6830cf3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:43.884401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4faa2b0-604f-4c2f-be6e-b81a6830cf3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:43.886148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4faa2b0-604f-4c2f-be6e-b81a6830cf3a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:43.898343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 993/1983] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:43.904285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e20523-df74-4182-96f4-24c71042ac1c None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:43.914079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e20523-df74-4182-96f4-24c71042ac1c None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:43.919577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46721df3-c08d-4749-8c06-f30d9fd0d552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:43.920185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46721df3-c08d-4749-8c06-f30d9fd0d552 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:43.920475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46721df3-c08d-4749-8c06-f30d9fd0d552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:43.920779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46721df3-c08d-4749-8c06-f30d9fd0d552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:43.921447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46721df3-c08d-4749-8c06-f30d9fd0d552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:43.923425 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46721df3-c08d-4749-8c06-f30d9fd0d552 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:44.022833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 991/1984] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:43 2022] POST /identity/v3/projects => generated 361 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:44.027291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faa2b0-604f-4c2f-be6e-b81a6830cf3a admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:44.037292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faa2b0-604f-4c2f-be6e-b81a6830cf3a admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:44.046371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:44.099146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c1112-dbc6-4cb6-b3e8-196605ad8a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:44.099781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c1112-dbc6-4cb6-b3e8-196605ad8a33 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:44.100068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c1112-dbc6-4cb6-b3e8-196605ad8a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:44.100345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c1112-dbc6-4cb6-b3e8-196605ad8a33 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:44.101023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c1112-dbc6-4cb6-b3e8-196605ad8a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:44.102992 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c1112-dbc6-4cb6-b3e8-196605ad8a33 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:44.217724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 994/1985] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:44 2022] POST /identity/v3/users => generated 281 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:44.221845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46721df3-c08d-4749-8c06-f30d9fd0d552 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:44.232589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46721df3-c08d-4749-8c06-f30d9fd0d552 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:44.237542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31743906-5e1c-47be-8216-cc1dc43d01e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:44.238128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31743906-5e1c-47be-8216-cc1dc43d01e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:44.238417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31743906-5e1c-47be-8216-cc1dc43d01e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:44.238748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31743906-5e1c-47be-8216-cc1dc43d01e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:44.239484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31743906-5e1c-47be-8216-cc1dc43d01e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:44.241105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31743906-5e1c-47be-8216-cc1dc43d01e2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:44.251500 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 992/1986] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:44.256562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c1112-dbc6-4cb6-b3e8-196605ad8a33 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:44.267424 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c1112-dbc6-4cb6-b3e8-196605ad8a33 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:44.272137 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516caef-3903-48ab-8081-5368f9600ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:44.272754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516caef-3903-48ab-8081-5368f9600ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:44.273046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516caef-3903-48ab-8081-5368f9600ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:44.273330 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516caef-3903-48ab-8081-5368f9600ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:44.274070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516caef-3903-48ab-8081-5368f9600ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:44.275749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516caef-3903-48ab-8081-5368f9600ce2 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:44.287668 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 995/1987] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:44.292115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31743906-5e1c-47be-8216-cc1dc43d01e2 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:44.302102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31743906-5e1c-47be-8216-cc1dc43d01e2 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:44.306947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dacd0-8039-4ce5-b19f-58499e4150c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:44.307661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dacd0-8039-4ce5-b19f-58499e4150c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:44.308045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dacd0-8039-4ce5-b19f-58499e4150c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:44.308550 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dacd0-8039-4ce5-b19f-58499e4150c2 admin admin] PATH_INFO: `/v3/projects/1bdd443025ba43c39ff20e7ef3cb1719/users/ad2ec186327d43bfa7486095feeff81b/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:44.323248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dacd0-8039-4ce5-b19f-58499e4150c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdd443025ba43c39ff20e7ef3cb1719, user_id=ad2ec186327d43bfa7486095feeff81b, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:44.326666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dacd0-8039-4ce5-b19f-58499e4150c2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:44.416689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 993/1988] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:44 2022] PUT /identity/v3/projects/1bdd443025ba43c39ff20e7ef3cb1719/users/ad2ec186327d43bfa7486095feeff81b/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:44.428312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce68d78-e6f3-4bb0-80e7-6defe307757f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:44.432048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce68d78-e6f3-4bb0-80e7-6defe307757f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:44.432048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce68d78-e6f3-4bb0-80e7-6defe307757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:44.458581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-2ce68d78-e6f3-4bb0-80e7-6defe307757f None None] MFA Rules not processed for user `ad2ec186327d43bfa7486095feeff81b`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:44.460740 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2ce68d78-e6f3-4bb0-80e7-6defe307757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:44.527785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 996/1989] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:44.532609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dacd0-8039-4ce5-b19f-58499e4150c2 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:44.594341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dacd0-8039-4ce5-b19f-58499e4150c2 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:44.599288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e58af0-e5d2-45d4-8c2f-5c8d63724ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:44.600023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e58af0-e5d2-45d4-8c2f-5c8d63724ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:44.600340 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e58af0-e5d2-45d4-8c2f-5c8d63724ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:44.600627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e58af0-e5d2-45d4-8c2f-5c8d63724ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:44.607274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e58af0-e5d2-45d4-8c2f-5c8d63724ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:44.607274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e58af0-e5d2-45d4-8c2f-5c8d63724ec2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:44.615090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce68d78-e6f3-4bb0-80e7-6defe307757f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:44.616780 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2ce68d78-e6f3-4bb0-80e7-6defe307757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:44.673015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 994/1990] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:44 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:44.674086 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e58af0-e5d2-45d4-8c2f-5c8d63724ec2 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:44.674388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce68d78-e6f3-4bb0-80e7-6defe307757f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:44.737034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63c934-2230-4606-b114-751825d3f00c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:44.737752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63c934-2230-4606-b114-751825d3f00c service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:44.738124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63c934-2230-4606-b114-751825d3f00c service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:44.738408 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63c934-2230-4606-b114-751825d3f00c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:44.739516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e58af0-e5d2-45d4-8c2f-5c8d63724ec2 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:44.740278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1c63c934-2230-4606-b114-751825d3f00c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:44.748893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81680c-0e52-4593-b427-05d284b06235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:44.748893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81680c-0e52-4593-b427-05d284b06235 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:44.748893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81680c-0e52-4593-b427-05d284b06235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:44.748893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81680c-0e52-4593-b427-05d284b06235 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:44.749320 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81680c-0e52-4593-b427-05d284b06235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:44.750567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81680c-0e52-4593-b427-05d284b06235 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:44.804641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63c934-2230-4606-b114-751825d3f00c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:44.806106 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63c934-2230-4606-b114-751825d3f00c service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:44.816461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 997/1991] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:44.853725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 995/1992] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:44 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:44.858212 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63c934-2230-4606-b114-751825d3f00c service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:44.870621 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63c934-2230-4606-b114-751825d3f00c service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:44.877630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb64ace-e3a3-42d4-9061-0cb2afb4c69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:44.878425 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb64ace-e3a3-42d4-9061-0cb2afb4c69f admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:44.893134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb64ace-e3a3-42d4-9061-0cb2afb4c69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:44.893134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb64ace-e3a3-42d4-9061-0cb2afb4c69f admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:44.893134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb64ace-e3a3-42d4-9061-0cb2afb4c69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:44.893134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb64ace-e3a3-42d4-9061-0cb2afb4c69f admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:44.897035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 998/1993] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:44.901005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81680c-0e52-4593-b427-05d284b06235 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:44.913336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81680c-0e52-4593-b427-05d284b06235 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:44.920546 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a773fb-5eeb-4d88-8340-5bace1df3a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:44.922012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a773fb-5eeb-4d88-8340-5bace1df3a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:44.922376 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a773fb-5eeb-4d88-8340-5bace1df3a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:44.923071 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a773fb-5eeb-4d88-8340-5bace1df3a53 admin admin] PATH_INFO: `/v3/projects/03935f1157e34b8fac28563205c7b6b2/users/0bb69351e1804decbcb97c075f060f8f/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:44.949577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a773fb-5eeb-4d88-8340-5bace1df3a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03935f1157e34b8fac28563205c7b6b2, user_id=0bb69351e1804decbcb97c075f060f8f, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:44.955412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a773fb-5eeb-4d88-8340-5bace1df3a53 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:45.069705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 996/1994] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:44 2022] PUT /identity/v3/projects/03935f1157e34b8fac28563205c7b6b2/users/0bb69351e1804decbcb97c075f060f8f/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:45.073762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb64ace-e3a3-42d4-9061-0cb2afb4c69f admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:45.085138 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb64ace-e3a3-42d4-9061-0cb2afb4c69f admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:45.147718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858e5d1-1e82-497b-a830-ebf7bf273148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:45.152754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858e5d1-1e82-497b-a830-ebf7bf273148 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:45.152754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858e5d1-1e82-497b-a830-ebf7bf273148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:45.152754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858e5d1-1e82-497b-a830-ebf7bf273148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:45.152754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858e5d1-1e82-497b-a830-ebf7bf273148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:45.152754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858e5d1-1e82-497b-a830-ebf7bf273148 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:45.165449 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 999/1995] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:45.167174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a773fb-5eeb-4d88-8340-5bace1df3a53 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:45.178714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a773fb-5eeb-4d88-8340-5bace1df3a53 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:45.183445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004851a-e0ae-4974-aeb4-a5ed2b9c886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:45.184113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004851a-e0ae-4974-aeb4-a5ed2b9c886b admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:45.185167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004851a-e0ae-4974-aeb4-a5ed2b9c886b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:45.185499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004851a-e0ae-4974-aeb4-a5ed2b9c886b admin admin] PATH_INFO: `/v3/projects/03935f1157e34b8fac28563205c7b6b2/users/0bb69351e1804decbcb97c075f060f8f/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:45.187719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004851a-e0ae-4974-aeb4-a5ed2b9c886b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03935f1157e34b8fac28563205c7b6b2, user_id=0bb69351e1804decbcb97c075f060f8f, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:45.190369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004851a-e0ae-4974-aeb4-a5ed2b9c886b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:45.201711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 997/1996] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:45 2022] PUT /identity/v3/projects/03935f1157e34b8fac28563205c7b6b2/users/0bb69351e1804decbcb97c075f060f8f/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:45.215465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bf54d-612c-4adb-9d35-77d9cf0d0557 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:45.215823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bf54d-612c-4adb-9d35-77d9cf0d0557 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:45.216108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bf54d-612c-4adb-9d35-77d9cf0d0557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:45.227296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:45.246684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-865bf54d-612c-4adb-9d35-77d9cf0d0557 None None] MFA Rules not processed for user `0bb69351e1804decbcb97c075f060f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:45.248715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-865bf54d-612c-4adb-9d35-77d9cf0d0557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:45.320205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1000/1997] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:45.624716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004851a-e0ae-4974-aeb4-a5ed2b9c886b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:45.626610 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7004851a-e0ae-4974-aeb4-a5ed2b9c886b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:45.685621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004851a-e0ae-4974-aeb4-a5ed2b9c886b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:45.689379 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b213b-7701-4081-b615-9acd75085bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:45.690007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b213b-7701-4081-b615-9acd75085bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:45.690295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b213b-7701-4081-b615-9acd75085bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:45.690631 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b213b-7701-4081-b615-9acd75085bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:45.699891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b213b-7701-4081-b615-9acd75085bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:45.701811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b213b-7701-4081-b615-9acd75085bc7 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:45.711564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 998/1998] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:45.914023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:46.319164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:47.108755 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:47.119756 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bf54d-612c-4adb-9d35-77d9cf0d0557 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:47.186820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bf54d-612c-4adb-9d35-77d9cf0d0557 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:47.193311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:47.194105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:47.194302 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:47.194694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] PATH_INFO: `/v3/users/ad2ec186327d43bfa7486095feeff81b` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:47.195853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2ec186327d43bfa7486095feeff81b)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:47.197839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:47.408278 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2ec186327d43bfa7486095feeff81b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:47.468314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2ec186327d43bfa7486095feeff81b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:47.475926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2ec186327d43bfa7486095feeff81b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:47.476702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2ec186327d43bfa7486095feeff81b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:47.477312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2ec186327d43bfa7486095feeff81b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:47.496135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1001/1999] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:47 2022] DELETE /identity/v3/users/ad2ec186327d43bfa7486095feeff81b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:47.501340 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd0e6-d09e-4444-954b-c9708260a1d9 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:47.501661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd0e6-d09e-4444-954b-c9708260a1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:47.501948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfd0e6-d09e-4444-954b-c9708260a1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:47.520925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-1fcfd0e6-d09e-4444-954b-c9708260a1d9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:47.522125 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1fcfd0e6-d09e-4444-954b-c9708260a1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:47.591677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 999/2000] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:47.599963 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:47.601388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:47.658098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2665093-68ca-40f2-a3ee-ed7956466fd9 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:47.661752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a315f4b-1be4-40fb-bf17-2a178e99a369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:47.662369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315f4b-1be4-40fb-bf17-2a178e99a369 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:47.662681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315f4b-1be4-40fb-bf17-2a178e99a369 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:47.662960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315f4b-1be4-40fb-bf17-2a178e99a369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:47.672772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a315f4b-1be4-40fb-bf17-2a178e99a369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:47.674288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a315f4b-1be4-40fb-bf17-2a178e99a369 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:47.683814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1002/2001] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:48.108098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:48.228858 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfd0e6-d09e-4444-954b-c9708260a1d9 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:48.230360 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1fcfd0e6-d09e-4444-954b-c9708260a1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:48.242618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfd0e6-d09e-4444-954b-c9708260a1d9 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:48.248137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:48.248791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:48.249083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:48.249362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] PATH_INFO: `/v3/projects/1bdd443025ba43c39ff20e7ef3cb1719` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:48.250591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bdd443025ba43c39ff20e7ef3cb1719)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:48.252560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:48.275354 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:48.402449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bdd443025ba43c39ff20e7ef3cb1719', 'request_id': 'req-639c6f48-fde0-47bc-94cd-4e5070f16745'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:48.408421 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bdd443025ba43c39ff20e7ef3cb1719', 'request_id': 'req-639c6f48-fde0-47bc-94cd-4e5070f16745'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:48.542226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bdd443025ba43c39ff20e7ef3cb1719', 'request_id': 'req-639c6f48-fde0-47bc-94cd-4e5070f16745'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:48.558116 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] The token cache is being invalidate because project 1bdd443025ba43c39ff20e7ef3cb1719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:48.558116 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:48.558832 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:48.561038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1000/2002] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:48 2022] DELETE /identity/v3/projects/1bdd443025ba43c39ff20e7ef3cb1719 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:48.565093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a315f4b-1be4-40fb-bf17-2a178e99a369 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:48.577110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a315f4b-1be4-40fb-bf17-2a178e99a369 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:48.641337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:48.642068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:48.642363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:48.642678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] PATH_INFO: `/v3/users/0bb69351e1804decbcb97c075f060f8f` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:48.643973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb69351e1804decbcb97c075f060f8f)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:48.645902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:48.720393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:48.722303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:48.782708 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c6f48-fde0-47bc-94cd-4e5070f16745 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:48.786416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb6494-d8ef-4762-86cb-ac754d819d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:48.787258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb6494-d8ef-4762-86cb-ac754d819d1a service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:48.787544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb6494-d8ef-4762-86cb-ac754d819d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:48.787828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb6494-d8ef-4762-86cb-ac754d819d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:48.789605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-aadb6494-d8ef-4762-86cb-ac754d819d1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:48.831646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb69351e1804decbcb97c075f060f8f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:48.854285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb6494-d8ef-4762-86cb-ac754d819d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:48.855842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb6494-d8ef-4762-86cb-ac754d819d1a service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:48.865485 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1001/2003] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:48.913908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb69351e1804decbcb97c075f060f8f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:48.921558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb69351e1804decbcb97c075f060f8f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:48.922274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb69351e1804decbcb97c075f060f8f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:48.922898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb69351e1804decbcb97c075f060f8f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:48.940309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1003/2004] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:48 2022] DELETE /identity/v3/users/0bb69351e1804decbcb97c075f060f8f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:49.391509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb6494-d8ef-4762-86cb-ac754d819d1a service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:49.393277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-aadb6494-d8ef-4762-86cb-ac754d819d1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:49.409168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb6494-d8ef-4762-86cb-ac754d819d1a service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:49.439816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:49.472055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627a670-3c4f-4ffa-8386-b0b149af3e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:49.472719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627a670-3c4f-4ffa-8386-b0b149af3e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:49.473005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627a670-3c4f-4ffa-8386-b0b149af3e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:49.473288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627a670-3c4f-4ffa-8386-b0b149af3e59 admin admin] PATH_INFO: `/v3/projects/03935f1157e34b8fac28563205c7b6b2` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:49.474443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627a670-3c4f-4ffa-8386-b0b149af3e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03935f1157e34b8fac28563205c7b6b2)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:49.476458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627a670-3c4f-4ffa-8386-b0b149af3e59 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:49.577117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:49.587705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:49.589364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:49.646271 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2289542-a57c-47b0-8a15-a7dd38535a86 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:49.662858 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4627a670-3c4f-4ffa-8386-b0b149af3e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03935f1157e34b8fac28563205c7b6b2', 'request_id': 'req-4627a670-3c4f-4ffa-8386-b0b149af3e59'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:49.662858 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4627a670-3c4f-4ffa-8386-b0b149af3e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03935f1157e34b8fac28563205c7b6b2', 'request_id': 'req-4627a670-3c4f-4ffa-8386-b0b149af3e59'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:49.753551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:49.754032 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4627a670-3c4f-4ffa-8386-b0b149af3e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03935f1157e34b8fac28563205c7b6b2', 'request_id': 'req-4627a670-3c4f-4ffa-8386-b0b149af3e59'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:49.756335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf75697-7b87-4e31-a8be-5dc2aa3d778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:49.757547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf75697-7b87-4e31-a8be-5dc2aa3d778d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:49.757843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf75697-7b87-4e31-a8be-5dc2aa3d778d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:49.758176 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf75697-7b87-4e31-a8be-5dc2aa3d778d admin admin] PATH_INFO: `/v3/users/acf0abc37c7d4ce781157cae06da9280` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:49.760284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf75697-7b87-4e31-a8be-5dc2aa3d778d admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf0abc37c7d4ce781157cae06da9280)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:49.763140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf75697-7b87-4e31-a8be-5dc2aa3d778d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:49.772237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4627a670-3c4f-4ffa-8386-b0b149af3e59 admin admin] The token cache is being invalidate because project 03935f1157e34b8fac28563205c7b6b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:49.772799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4627a670-3c4f-4ffa-8386-b0b149af3e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:49.773748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4627a670-3c4f-4ffa-8386-b0b149af3e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:49.776591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1002/2005] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:49 2022] DELETE /identity/v3/projects/03935f1157e34b8fac28563205c7b6b2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:49.783647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4124a-7c73-4a0c-9e78-99bed5ff4967 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:49.784408 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4124a-7c73-4a0c-9e78-99bed5ff4967 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:49.784873 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4124a-7c73-4a0c-9e78-99bed5ff4967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:49.813784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-66e4124a-7c73-4a0c-9e78-99bed5ff4967 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:49.814951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-66e4124a-7c73-4a0c-9e78-99bed5ff4967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:49.826614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1003/2006] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:49.831786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373ec0d-b596-42bb-b733-a4491a5b5af5 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:49.832078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373ec0d-b596-42bb-b733-a4491a5b5af5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:49.832557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373ec0d-b596-42bb-b733-a4491a5b5af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:49.853179 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-a373ec0d-b596-42bb-b733-a4491a5b5af5 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:49.854384 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a373ec0d-b596-42bb-b733-a4491a5b5af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:49.863312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1004/2007] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:49.867679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373ec0d-b596-42bb-b733-a4491a5b5af5 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:49.878045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373ec0d-b596-42bb-b733-a4491a5b5af5 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:49.882788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02aba5-7585-4757-8887-3c607d82142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:49.883384 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02aba5-7585-4757-8887-3c607d82142c admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:49.883667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02aba5-7585-4757-8887-3c607d82142c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:49.884015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02aba5-7585-4757-8887-3c607d82142c admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:49.884711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02aba5-7585-4757-8887-3c607d82142c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:49.885019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02aba5-7585-4757-8887-3c607d82142c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:49.888589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02aba5-7585-4757-8887-3c607d82142c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:49.908351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1005/2008] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:37:49.908351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02aba5-7585-4757-8887-3c607d82142c admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:49.917887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02aba5-7585-4757-8887-3c607d82142c admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:49.922985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2abf9-48bb-42d2-955c-a7e155d547da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:49.923604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2abf9-48bb-42d2-955c-a7e155d547da admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:49.923915 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2abf9-48bb-42d2-955c-a7e155d547da admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:49.924193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2abf9-48bb-42d2-955c-a7e155d547da admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:49.924890 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2abf9-48bb-42d2-955c-a7e155d547da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:49.926891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2abf9-48bb-42d2-955c-a7e155d547da admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:49.969132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-ecf75697-7b87-4e31-a8be-5dc2aa3d778d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf0abc37c7d4ce781157cae06da9280'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:50.007323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1006/2009] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:49 2022] POST /identity/v3/projects => generated 357 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:50.011346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2abf9-48bb-42d2-955c-a7e155d547da admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:50.017674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-ecf75697-7b87-4e31-a8be-5dc2aa3d778d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf0abc37c7d4ce781157cae06da9280'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:50.026396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-ecf75697-7b87-4e31-a8be-5dc2aa3d778d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf0abc37c7d4ce781157cae06da9280'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:50.027588 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-ecf75697-7b87-4e31-a8be-5dc2aa3d778d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf0abc37c7d4ce781157cae06da9280'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:50.028333 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-ecf75697-7b87-4e31-a8be-5dc2aa3d778d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf0abc37c7d4ce781157cae06da9280'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:50.048335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1004/2010] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:49 2022] DELETE /identity/v3/users/acf0abc37c7d4ce781157cae06da9280 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:50.052815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8554326-6f85-442c-a9d2-7f22791e0194 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:50.053190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8554326-6f85-442c-a9d2-7f22791e0194 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:50.053477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8554326-6f85-442c-a9d2-7f22791e0194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:50.074514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e8554326-6f85-442c-a9d2-7f22791e0194 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:50.075859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e8554326-6f85-442c-a9d2-7f22791e0194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:50.085962 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2abf9-48bb-42d2-955c-a7e155d547da admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:50.136467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1005/2011] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:50.146996 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8554326-6f85-442c-a9d2-7f22791e0194 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:50.148605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e8554326-6f85-442c-a9d2-7f22791e0194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:50.154924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f12de-94f9-4d88-82b0-8bf96856dc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:50.155609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f12de-94f9-4d88-82b0-8bf96856dc22 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:50.155893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f12de-94f9-4d88-82b0-8bf96856dc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:50.156169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f12de-94f9-4d88-82b0-8bf96856dc22 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:50.156913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f12de-94f9-4d88-82b0-8bf96856dc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:50.158931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f12de-94f9-4d88-82b0-8bf96856dc22 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:50.181582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:50.213948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8554326-6f85-442c-a9d2-7f22791e0194 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:50.217851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e8a60-65bb-42ec-9056-04188c9a920b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:50.218473 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e8a60-65bb-42ec-9056-04188c9a920b service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:50.218797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e8a60-65bb-42ec-9056-04188c9a920b service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:50.219098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e8a60-65bb-42ec-9056-04188c9a920b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:50.227942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e8a60-65bb-42ec-9056-04188c9a920b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:50.229404 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e8a60-65bb-42ec-9056-04188c9a920b service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:50.239471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1006/2012] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:50.310006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1007/2013] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:50 2022] POST /identity/v3/users => generated 279 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:50.314461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e8a60-65bb-42ec-9056-04188c9a920b service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:50.316230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-738e8a60-65bb-42ec-9056-04188c9a920b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:50.330232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e8a60-65bb-42ec-9056-04188c9a920b service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:50.335931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47661ca-b51a-4daf-a4a6-0e1cdbfc02ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:50.336557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47661ca-b51a-4daf-a4a6-0e1cdbfc02ed admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:50.336838 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47661ca-b51a-4daf-a4a6-0e1cdbfc02ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:50.339773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47661ca-b51a-4daf-a4a6-0e1cdbfc02ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:50.339773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47661ca-b51a-4daf-a4a6-0e1cdbfc02ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:50.339773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47661ca-b51a-4daf-a4a6-0e1cdbfc02ed admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:50.350713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1007/2014] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:50.354798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f12de-94f9-4d88-82b0-8bf96856dc22 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:50.366273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f12de-94f9-4d88-82b0-8bf96856dc22 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:50.371521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb2fc7-32e6-4fc5-9a6d-914a36415fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:50.372224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb2fc7-32e6-4fc5-9a6d-914a36415fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:50.372512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb2fc7-32e6-4fc5-9a6d-914a36415fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:50.372794 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb2fc7-32e6-4fc5-9a6d-914a36415fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:50.373503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb2fc7-32e6-4fc5-9a6d-914a36415fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:50.375278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb2fc7-32e6-4fc5-9a6d-914a36415fb9 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:50.385901 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1008/2015] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:50.390408 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47661ca-b51a-4daf-a4a6-0e1cdbfc02ed admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:50.400880 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47661ca-b51a-4daf-a4a6-0e1cdbfc02ed admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:50.407802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8e4f0-e2c4-4270-aa13-7c18abe24a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:50.408544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8e4f0-e2c4-4270-aa13-7c18abe24a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:50.408830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8e4f0-e2c4-4270-aa13-7c18abe24a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:50.409991 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8e4f0-e2c4-4270-aa13-7c18abe24a6c admin admin] PATH_INFO: `/v3/projects/65ef7a5c1a734107b642b717acc4532e/users/8dfd8801b0ef4d0d93a626951b2ceaa1/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:50.431783 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8e4f0-e2c4-4270-aa13-7c18abe24a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ef7a5c1a734107b642b717acc4532e, user_id=8dfd8801b0ef4d0d93a626951b2ceaa1, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:50.434720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8e4f0-e2c4-4270-aa13-7c18abe24a6c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:50.532124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1008/2016] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:50 2022] PUT /identity/v3/projects/65ef7a5c1a734107b642b717acc4532e/users/8dfd8801b0ef4d0d93a626951b2ceaa1/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:50.543087 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577900f-6c48-445b-b85e-8aff3bae114c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:50.543551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577900f-6c48-445b-b85e-8aff3bae114c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:50.543658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577900f-6c48-445b-b85e-8aff3bae114c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:50.553865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:50.572569 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-1577900f-6c48-445b-b85e-8aff3bae114c None None] MFA Rules not processed for user `8dfd8801b0ef4d0d93a626951b2ceaa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:50.573873 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1577900f-6c48-445b-b85e-8aff3bae114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:50.642887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1009/2017] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:50.647361 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8e4f0-e2c4-4270-aa13-7c18abe24a6c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:50.714335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8e4f0-e2c4-4270-aa13-7c18abe24a6c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:50.722254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577900f-6c48-445b-b85e-8aff3bae114c None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:50.723761 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1577900f-6c48-445b-b85e-8aff3bae114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:50.731997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d499687-f2b5-49b1-8feb-eb6c5e22a360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:50.733044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d499687-f2b5-49b1-8feb-eb6c5e22a360 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:50.733339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d499687-f2b5-49b1-8feb-eb6c5e22a360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:50.733613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d499687-f2b5-49b1-8feb-eb6c5e22a360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:50.734457 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d499687-f2b5-49b1-8feb-eb6c5e22a360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:50.741503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d499687-f2b5-49b1-8feb-eb6c5e22a360 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:50.742022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577900f-6c48-445b-b85e-8aff3bae114c None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:50.746341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:50.748206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:50.748764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:50.749233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] PATH_INFO: `/v3/projects/856570d4392d40f2bb29694ea0dfc3de` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:50.750624 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856570d4392d40f2bb29694ea0dfc3de)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:50.752962 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:50.834519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1009/2018] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:50 2022] POST /identity/v3/projects => generated 355 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:50.838693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d499687-f2b5-49b1-8feb-eb6c5e22a360 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:50.897452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856570d4392d40f2bb29694ea0dfc3de', 'request_id': 'req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:50.905145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856570d4392d40f2bb29694ea0dfc3de', 'request_id': 'req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:50.913576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d499687-f2b5-49b1-8feb-eb6c5e22a360 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:50.988387 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856570d4392d40f2bb29694ea0dfc3de', 'request_id': 'req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:50.990351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3c042-f076-44a7-a176-c7f5df47bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:50.991432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3c042-f076-44a7-a176-c7f5df47bd98 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:50.991432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3c042-f076-44a7-a176-c7f5df47bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:50.991605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3c042-f076-44a7-a176-c7f5df47bd98 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:50.992217 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3c042-f076-44a7-a176-c7f5df47bd98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:50.994519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3c042-f076-44a7-a176-c7f5df47bd98 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:51.001898 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] The token cache is being invalidate because project 856570d4392d40f2bb29694ea0dfc3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:51.002201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:51.002891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:51.004528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1010/2019] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:50 2022] DELETE /identity/v3/projects/856570d4392d40f2bb29694ea0dfc3de => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:51.005433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:51.006821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:51.019992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93ee78-3cde-4a1a-849c-1f48f2fe5ae3 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:51.024826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:51.025457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:51.025738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:51.026017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] PATH_INFO: `/v3/users/6ed294443b574e39bd47731c87117bf4` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:51.027482 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed294443b574e39bd47731c87117bf4)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:51.029440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:51.079995 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1010/2020] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:50 2022] POST /identity/v3/users => generated 284 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:51.080863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3c042-f076-44a7-a176-c7f5df47bd98 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:51.082446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-02b3c042-f076-44a7-a176-c7f5df47bd98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:51.095664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3c042-f076-44a7-a176-c7f5df47bd98 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:51.100283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc900ce-c0c5-4712-a308-ac9022c23454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:51.100945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc900ce-c0c5-4712-a308-ac9022c23454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:51.101260 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc900ce-c0c5-4712-a308-ac9022c23454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:51.101541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc900ce-c0c5-4712-a308-ac9022c23454 admin admin] PATH_INFO: `/v3/users/ef802f277b4d4c889710a4158c604315` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:51.107006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc900ce-c0c5-4712-a308-ac9022c23454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef802f277b4d4c889710a4158c604315)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:51.107006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc900ce-c0c5-4712-a308-ac9022c23454 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:51.167278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:51.282284 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed294443b574e39bd47731c87117bf4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:51.294965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed294443b574e39bd47731c87117bf4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:51.295642 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed294443b574e39bd47731c87117bf4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:51.302637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed294443b574e39bd47731c87117bf4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:51.338231 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0bc900ce-c0c5-4712-a308-ac9022c23454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef802f277b4d4c889710a4158c604315'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:51.352778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:51.398192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed294443b574e39bd47731c87117bf4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:51.405878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1011/2021] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:51 2022] DELETE /identity/v3/users/6ed294443b574e39bd47731c87117bf4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:51.406823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:51.408625 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:51.461164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0bc900ce-c0c5-4712-a308-ac9022c23454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef802f277b4d4c889710a4158c604315'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:51.469744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0bc900ce-c0c5-4712-a308-ac9022c23454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef802f277b4d4c889710a4158c604315'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:51.470504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0bc900ce-c0c5-4712-a308-ac9022c23454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef802f277b4d4c889710a4158c604315'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:51.471514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0bc900ce-c0c5-4712-a308-ac9022c23454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef802f277b4d4c889710a4158c604315'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:51.474788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875db890-8295-43f5-a364-958357531fc6 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:51.480145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52e0ad-b708-4c98-8a25-5bb80ddb80a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:51.480788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52e0ad-b708-4c98-8a25-5bb80ddb80a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:51.481072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52e0ad-b708-4c98-8a25-5bb80ddb80a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:51.481835 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52e0ad-b708-4c98-8a25-5bb80ddb80a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:51.482667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52e0ad-b708-4c98-8a25-5bb80ddb80a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:51.484293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52e0ad-b708-4c98-8a25-5bb80ddb80a4 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:51.491966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1011/2022] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:51 2022] DELETE /identity/v3/users/ef802f277b4d4c889710a4158c604315 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:51.493453 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cd3ed-5228-4d5e-af0a-4df04d08dede None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:51.493688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cd3ed-5228-4d5e-af0a-4df04d08dede None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:51.493967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cd3ed-5228-4d5e-af0a-4df04d08dede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:51.503167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1012/2023] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:51.504361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52e0ad-b708-4c98-8a25-5bb80ddb80a4 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:51.507538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-ae52e0ad-b708-4c98-8a25-5bb80ddb80a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:51.521379 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-582cd3ed-5228-4d5e-af0a-4df04d08dede None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:51.522826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-582cd3ed-5228-4d5e-af0a-4df04d08dede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:51.528148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52e0ad-b708-4c98-8a25-5bb80ddb80a4 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:51.586049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df56284-60ec-4fdf-a083-bd1333fca798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:51.587129 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df56284-60ec-4fdf-a083-bd1333fca798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:51.587513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df56284-60ec-4fdf-a083-bd1333fca798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:51.587973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df56284-60ec-4fdf-a083-bd1333fca798 admin admin] PATH_INFO: `/v3/projects/a7a326487b2645df825407eb2bf39f76/users/4da2c1aac28f4d2597d775a90fdd4235/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:51.598061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1012/2024] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:51.609607 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cd3ed-5228-4d5e-af0a-4df04d08dede None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:51.611098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-582cd3ed-5228-4d5e-af0a-4df04d08dede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:51.622471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df56284-60ec-4fdf-a083-bd1333fca798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a326487b2645df825407eb2bf39f76, user_id=4da2c1aac28f4d2597d775a90fdd4235, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:51.634539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df56284-60ec-4fdf-a083-bd1333fca798 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:51.680289 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cd3ed-5228-4d5e-af0a-4df04d08dede None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:51.687562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb49647-9945-4a77-ad71-247f5ac92724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:51.688212 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49647-9945-4a77-ad71-247f5ac92724 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:51.688497 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49647-9945-4a77-ad71-247f5ac92724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:51.689088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49647-9945-4a77-ad71-247f5ac92724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:51.697508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1013/2025] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:51 2022] PUT /identity/v3/projects/a7a326487b2645df825407eb2bf39f76/users/4da2c1aac28f4d2597d775a90fdd4235/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:51.702117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df56284-60ec-4fdf-a083-bd1333fca798 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:51.706716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb49647-9945-4a77-ad71-247f5ac92724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:51.708215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb49647-9945-4a77-ad71-247f5ac92724 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:51.722841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1013/2026] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:51.743647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:51.767058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df56284-60ec-4fdf-a083-bd1333fca798 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:51.772023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:51.772606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e3448-6074-41a3-ace3-2645829a470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:51.773092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e3448-6074-41a3-ace3-2645829a470f admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:51.773383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e3448-6074-41a3-ace3-2645829a470f admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:51.773664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e3448-6074-41a3-ace3-2645829a470f admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:51.774428 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e3448-6074-41a3-ace3-2645829a470f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:51.776277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e3448-6074-41a3-ace3-2645829a470f admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:51.789242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1014/2027] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:51.793478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb49647-9945-4a77-ad71-247f5ac92724 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:51.812316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb49647-9945-4a77-ad71-247f5ac92724 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:51.822954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c742fdd-a5b0-40df-b9a4-2f8bace48746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:51.826652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c742fdd-a5b0-40df-b9a4-2f8bace48746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:51.826973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c742fdd-a5b0-40df-b9a4-2f8bace48746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:51.827263 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c742fdd-a5b0-40df-b9a4-2f8bace48746 admin admin] PATH_INFO: `/v3/projects/a7a326487b2645df825407eb2bf39f76/users/4da2c1aac28f4d2597d775a90fdd4235/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:51.833032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c742fdd-a5b0-40df-b9a4-2f8bace48746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a326487b2645df825407eb2bf39f76, user_id=4da2c1aac28f4d2597d775a90fdd4235, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:51.840478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c742fdd-a5b0-40df-b9a4-2f8bace48746 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:51.855658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1014/2028] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:51 2022] PUT /identity/v3/projects/a7a326487b2645df825407eb2bf39f76/users/4da2c1aac28f4d2597d775a90fdd4235/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:51.867374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fb8a0-28f8-41c8-bea4-901f7247a0e2 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:51.867592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fb8a0-28f8-41c8-bea4-901f7247a0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:51.868306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fb8a0-28f8-41c8-bea4-901f7247a0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:51.907063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f46fb8a0-28f8-41c8-bea4-901f7247a0e2 None None] MFA Rules not processed for user `4da2c1aac28f4d2597d775a90fdd4235`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:51.908308 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f46fb8a0-28f8-41c8-bea4-901f7247a0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:51.986640 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1015/2029] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:51.999658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c742fdd-a5b0-40df-b9a4-2f8bace48746 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:52.008994 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1c742fdd-a5b0-40df-b9a4-2f8bace48746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:52.012112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fb8a0-28f8-41c8-bea4-901f7247a0e2 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:52.015214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f46fb8a0-28f8-41c8-bea4-901f7247a0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:52.086131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:52.124400 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fb8a0-28f8-41c8-bea4-901f7247a0e2 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:52.126976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c742fdd-a5b0-40df-b9a4-2f8bace48746 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:52.132213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bd426-45dc-459b-bf86-be062c8f0ed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:52.132542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:52.133051 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bd426-45dc-459b-bf86-be062c8f0ed3 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:52.133327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bd426-45dc-459b-bf86-be062c8f0ed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:52.133604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bd426-45dc-459b-bf86-be062c8f0ed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:52.133718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:52.134182 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:52.134849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] PATH_INFO: `/v3/projects/92834f3f95a94f0eb19359b08d2f1504` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:52.138358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=92834f3f95a94f0eb19359b08d2f1504)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:52.140857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:52.148835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bd426-45dc-459b-bf86-be062c8f0ed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:52.150747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bd426-45dc-459b-bf86-be062c8f0ed3 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:52.172484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1015/2030] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:52.217955 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:52.269043 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92834f3f95a94f0eb19359b08d2f1504', 'request_id': 'req-4c02146e-0c8b-428c-a434-2c8ae95bee0b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.277529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92834f3f95a94f0eb19359b08d2f1504', 'request_id': 'req-4c02146e-0c8b-428c-a434-2c8ae95bee0b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.337042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92834f3f95a94f0eb19359b08d2f1504', 'request_id': 'req-4c02146e-0c8b-428c-a434-2c8ae95bee0b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.360382 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] The token cache is being invalidate because project 92834f3f95a94f0eb19359b08d2f1504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:52.362762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.364142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.370981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1016/2031] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:52 2022] DELETE /identity/v3/projects/92834f3f95a94f0eb19359b08d2f1504 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:52.371587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bd426-45dc-459b-bf86-be062c8f0ed3 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:52.380552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:52.383792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:52.384175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bd426-45dc-459b-bf86-be062c8f0ed3 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:52.448407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:52.449557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:52.449760 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02146e-0c8b-428c-a434-2c8ae95bee0b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:52.449866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:52.450215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] PATH_INFO: `/v3/users/5c2e05ba52664f26a5d43045733b5d6b` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:52.451570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2e05ba52664f26a5d43045733b5d6b)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:52.453763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5babb-1e3a-4033-ad3c-7be7fec5375f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:52.454386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5babb-1e3a-4033-ad3c-7be7fec5375f service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:52.454508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:52.454856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5babb-1e3a-4033-ad3c-7be7fec5375f service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:52.455142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5babb-1e3a-4033-ad3c-7be7fec5375f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:52.458357 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-adb5babb-1e3a-4033-ad3c-7be7fec5375f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:52.532722 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5babb-1e3a-4033-ad3c-7be7fec5375f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:52.534169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5babb-1e3a-4033-ad3c-7be7fec5375f service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:52.543573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1017/2032] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:52.665841 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5babb-1e3a-4033-ad3c-7be7fec5375f service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:52.667334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-adb5babb-1e3a-4033-ad3c-7be7fec5375f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:52.687039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5babb-1e3a-4033-ad3c-7be7fec5375f service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:52.697148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:52.701998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:52.706731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:52.709325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] PATH_INFO: `/v3/projects/3bf8286df66e46729dc2686295e44789` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:52.709564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf8286df66e46729dc2686295e44789)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:52.713621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:52.729502 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2e05ba52664f26a5d43045733b5d6b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.804582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2e05ba52664f26a5d43045733b5d6b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.812434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2e05ba52664f26a5d43045733b5d6b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.813214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2e05ba52664f26a5d43045733b5d6b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.813842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2e05ba52664f26a5d43045733b5d6b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.842396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1016/2033] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:52 2022] DELETE /identity/v3/users/5c2e05ba52664f26a5d43045733b5d6b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:52.848878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf8286df66e46729dc2686295e44789', 'request_id': 'req-bb287458-dd68-4ef5-8fd2-4ced51dfa752'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.855485 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf8286df66e46729dc2686295e44789', 'request_id': 'req-bb287458-dd68-4ef5-8fd2-4ced51dfa752'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.965600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf8286df66e46729dc2686295e44789', 'request_id': 'req-bb287458-dd68-4ef5-8fd2-4ced51dfa752'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.979008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] The token cache is being invalidate because project 3bf8286df66e46729dc2686295e44789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:52.979387 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.980162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:52.981849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1018/2034] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:52 2022] DELETE /identity/v3/projects/3bf8286df66e46729dc2686295e44789 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:52.986014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:52.987514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:53.024494 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:53.106610 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e051e3-38f5-44dc-aa5b-31584ac6bfc6 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:53.114775 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbce8c5-129a-4726-b5e5-b9be82965476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:53.115795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce8c5-129a-4726-b5e5-b9be82965476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:53.116293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce8c5-129a-4726-b5e5-b9be82965476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:53.116802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce8c5-129a-4726-b5e5-b9be82965476 admin admin] PATH_INFO: `/v3/users/89b0efcefdfc48b6bf502f0e66e24111` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:53.135547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbce8c5-129a-4726-b5e5-b9be82965476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b0efcefdfc48b6bf502f0e66e24111)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:53.142111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbce8c5-129a-4726-b5e5-b9be82965476 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:53.326465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:53.358254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:53.359921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:53.366678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7dbce8c5-129a-4726-b5e5-b9be82965476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b0efcefdfc48b6bf502f0e66e24111'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:53.427865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7dbce8c5-129a-4726-b5e5-b9be82965476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b0efcefdfc48b6bf502f0e66e24111'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:53.435638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7dbce8c5-129a-4726-b5e5-b9be82965476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b0efcefdfc48b6bf502f0e66e24111'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:53.436312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7dbce8c5-129a-4726-b5e5-b9be82965476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b0efcefdfc48b6bf502f0e66e24111'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:53.436925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7dbce8c5-129a-4726-b5e5-b9be82965476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b0efcefdfc48b6bf502f0e66e24111'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:53.442166 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb287458-dd68-4ef5-8fd2-4ced51dfa752 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:53.446968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a16d9-da79-4819-ac2e-6173ebbbfab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:53.447684 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a16d9-da79-4819-ac2e-6173ebbbfab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:53.447974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a16d9-da79-4819-ac2e-6173ebbbfab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:53.448250 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a16d9-da79-4819-ac2e-6173ebbbfab6 admin admin] PATH_INFO: `/v3/projects/fbfda8667b8542e8886a5b36ee41de83` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:53.449423 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a16d9-da79-4819-ac2e-6173ebbbfab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbfda8667b8542e8886a5b36ee41de83)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:53.452036 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a16d9-da79-4819-ac2e-6173ebbbfab6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:53.456708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1017/2035] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:52 2022] DELETE /identity/v3/users/89b0efcefdfc48b6bf502f0e66e24111 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:53.543204 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-842a16d9-da79-4819-ac2e-6173ebbbfab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbfda8667b8542e8886a5b36ee41de83', 'request_id': 'req-842a16d9-da79-4819-ac2e-6173ebbbfab6'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:53.550149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-842a16d9-da79-4819-ac2e-6173ebbbfab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbfda8667b8542e8886a5b36ee41de83', 'request_id': 'req-842a16d9-da79-4819-ac2e-6173ebbbfab6'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:53.610596 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-842a16d9-da79-4819-ac2e-6173ebbbfab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbfda8667b8542e8886a5b36ee41de83', 'request_id': 'req-842a16d9-da79-4819-ac2e-6173ebbbfab6'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:53.622358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-842a16d9-da79-4819-ac2e-6173ebbbfab6 admin admin] The token cache is being invalidate because project fbfda8667b8542e8886a5b36ee41de83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:53.622588 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-842a16d9-da79-4819-ac2e-6173ebbbfab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:53.623225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-842a16d9-da79-4819-ac2e-6173ebbbfab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:53.624792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1019/2036] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:53 2022] DELETE /identity/v3/projects/fbfda8667b8542e8886a5b36ee41de83 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:53.630685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038a561-3284-4b57-841d-d5e44e6189b1 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:53.630985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038a561-3284-4b57-841d-d5e44e6189b1 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:53.631402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038a561-3284-4b57-841d-d5e44e6189b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:53.651579 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-4038a561-3284-4b57-841d-d5e44e6189b1 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:53.653570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4038a561-3284-4b57-841d-d5e44e6189b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:53.674085 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:53.719559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1018/2037] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:53.728938 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a38bfd-d971-4379-bacd-383498cea5ae None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:53.729344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a38bfd-d971-4379-bacd-383498cea5ae None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:53.729831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a38bfd-d971-4379-bacd-383498cea5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:53.749622 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b4a38bfd-d971-4379-bacd-383498cea5ae None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:53.750990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b4a38bfd-d971-4379-bacd-383498cea5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:53.759303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1020/2038] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:53.764451 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038a561-3284-4b57-841d-d5e44e6189b1 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:53.774637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038a561-3284-4b57-841d-d5e44e6189b1 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:53.780311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b667178-4225-4647-8b83-0019ae190149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:53.781033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b667178-4225-4647-8b83-0019ae190149 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:53.781287 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b667178-4225-4647-8b83-0019ae190149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:53.781567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b667178-4225-4647-8b83-0019ae190149 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:53.782335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b667178-4225-4647-8b83-0019ae190149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:53.782601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b667178-4225-4647-8b83-0019ae190149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:53.785323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b667178-4225-4647-8b83-0019ae190149 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:53.802036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1019/2039] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:53.803452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a38bfd-d971-4379-bacd-383498cea5ae None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:53.812966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a38bfd-d971-4379-bacd-383498cea5ae None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:53.817844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63b43e-4656-40ff-9380-73eabfd6d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:53.823130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63b43e-4656-40ff-9380-73eabfd6d6ed admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:53.823130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63b43e-4656-40ff-9380-73eabfd6d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:53.823130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63b43e-4656-40ff-9380-73eabfd6d6ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:53.823130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63b43e-4656-40ff-9380-73eabfd6d6ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:53.823130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63b43e-4656-40ff-9380-73eabfd6d6ed admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:53.899048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b667178-4225-4647-8b83-0019ae190149 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:53.901044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-3b667178-4225-4647-8b83-0019ae190149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:53.915531 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b667178-4225-4647-8b83-0019ae190149 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:53.921439 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9e5a9-b01d-490e-ac95-6c1a2627686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:53.922098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e5a9-b01d-490e-ac95-6c1a2627686a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:53.922383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e5a9-b01d-490e-ac95-6c1a2627686a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:53.922728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e5a9-b01d-490e-ac95-6c1a2627686a admin admin] PATH_INFO: `/v3/projects/56565ed0c9854c4cb196dfb313c23035` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:53.923911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9e5a9-b01d-490e-ac95-6c1a2627686a admin admin] RBAC: Authorizing `identity:delete_project(project_id=56565ed0c9854c4cb196dfb313c23035)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:53.926032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9e5a9-b01d-490e-ac95-6c1a2627686a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:53.960422 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1021/2040] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:53 2022] POST /identity/v3/projects => generated 401 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:53.964058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63b43e-4656-40ff-9380-73eabfd6d6ed admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.006101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:54.052973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-41d9e5a9-b01d-490e-ac95-6c1a2627686a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56565ed0c9854c4cb196dfb313c23035', 'request_id': 'req-41d9e5a9-b01d-490e-ac95-6c1a2627686a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:54.061887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63b43e-4656-40ff-9380-73eabfd6d6ed admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.123402 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368eddf-36a8-44d0-9461-05f1e8029f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.124106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368eddf-36a8-44d0-9461-05f1e8029f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.124398 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368eddf-36a8-44d0-9461-05f1e8029f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.124678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368eddf-36a8-44d0-9461-05f1e8029f5f admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.125505 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368eddf-36a8-44d0-9461-05f1e8029f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.127515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368eddf-36a8-44d0-9461-05f1e8029f5f admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.148232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-41d9e5a9-b01d-490e-ac95-6c1a2627686a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56565ed0c9854c4cb196dfb313c23035', 'request_id': 'req-41d9e5a9-b01d-490e-ac95-6c1a2627686a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:54.164930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-41d9e5a9-b01d-490e-ac95-6c1a2627686a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56565ed0c9854c4cb196dfb313c23035', 'request_id': 'req-41d9e5a9-b01d-490e-ac95-6c1a2627686a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:54.188913 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-41d9e5a9-b01d-490e-ac95-6c1a2627686a admin admin] The token cache is being invalidate because project 56565ed0c9854c4cb196dfb313c23035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:54.189110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-41d9e5a9-b01d-490e-ac95-6c1a2627686a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:54.189960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-41d9e5a9-b01d-490e-ac95-6c1a2627686a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:54.191799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1020/2041] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:53 2022] DELETE /identity/v3/projects/56565ed0c9854c4cb196dfb313c23035 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:54.196605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1022/2042] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:53 2022] POST /identity/v3/users => generated 301 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:54.196738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215282b-30a7-486c-9ca4-aed40b8cef15 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.196843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215282b-30a7-486c-9ca4-aed40b8cef15 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.197055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215282b-30a7-486c-9ca4-aed40b8cef15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.202083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368eddf-36a8-44d0-9461-05f1e8029f5f admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.204361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2368eddf-36a8-44d0-9461-05f1e8029f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:54.221517 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368eddf-36a8-44d0-9461-05f1e8029f5f admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.221805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b215282b-30a7-486c-9ca4-aed40b8cef15 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:54.223205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b215282b-30a7-486c-9ca4-aed40b8cef15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:54.226786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3f9c-6ab3-4429-8ecb-a0548b165d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.228804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3f9c-6ab3-4429-8ecb-a0548b165d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.228804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3f9c-6ab3-4429-8ecb-a0548b165d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.228804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3f9c-6ab3-4429-8ecb-a0548b165d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.228804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee3f9c-6ab3-4429-8ecb-a0548b165d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.230476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee3f9c-6ab3-4429-8ecb-a0548b165d6c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.232616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1021/2043] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:54.241221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c6e7a-e48b-4aec-ae4f-fffc710542dd None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.241504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c6e7a-e48b-4aec-ae4f-fffc710542dd None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.242547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c6e7a-e48b-4aec-ae4f-fffc710542dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.244461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1023/2044] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:54.248495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3f9c-6ab3-4429-8ecb-a0548b165d6c admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.251022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:54.261030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3f9c-6ab3-4429-8ecb-a0548b165d6c admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.263973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-218c6e7a-e48b-4aec-ae4f-fffc710542dd None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:54.265179 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-218c6e7a-e48b-4aec-ae4f-fffc710542dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:54.267327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3ba47-3e3d-4926-a570-c1e0813dc495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.269020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3ba47-3e3d-4926-a570-c1e0813dc495 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.269020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3ba47-3e3d-4926-a570-c1e0813dc495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.269020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3ba47-3e3d-4926-a570-c1e0813dc495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.269391 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3ba47-3e3d-4926-a570-c1e0813dc495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.270853 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3ba47-3e3d-4926-a570-c1e0813dc495 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.274090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1022/2045] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:54.279562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c6e7a-e48b-4aec-ae4f-fffc710542dd None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.284269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1024/2046] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:54.288034 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3ba47-3e3d-4926-a570-c1e0813dc495 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.289663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c6e7a-e48b-4aec-ae4f-fffc710542dd None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.295225 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193a890-3d81-4a0a-801f-0fedc7494a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.295837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193a890-3d81-4a0a-801f-0fedc7494a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.296120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193a890-3d81-4a0a-801f-0fedc7494a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.296396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193a890-3d81-4a0a-801f-0fedc7494a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.297094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193a890-3d81-4a0a-801f-0fedc7494a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:54.297402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193a890-3d81-4a0a-801f-0fedc7494a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.298300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3ba47-3e3d-4926-a570-c1e0813dc495 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.299035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193a890-3d81-4a0a-801f-0fedc7494a65 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.302978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861422f-8e24-4c90-8e8c-187b3ced217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.303624 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861422f-8e24-4c90-8e8c-187b3ced217d admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.303910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861422f-8e24-4c90-8e8c-187b3ced217d admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.304185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861422f-8e24-4c90-8e8c-187b3ced217d admin admin] PATH_INFO: `/v3/projects/b3b88b9e473444fba3df5728254c50a2/users/5540b4c73ebd470dbb37a478ce26025d/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.311186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1023/2047] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:54.315976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193a890-3d81-4a0a-801f-0fedc7494a65 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.319800 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861422f-8e24-4c90-8e8c-187b3ced217d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b88b9e473444fba3df5728254c50a2, user_id=5540b4c73ebd470dbb37a478ce26025d, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.322637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861422f-8e24-4c90-8e8c-187b3ced217d admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.326722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193a890-3d81-4a0a-801f-0fedc7494a65 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.331559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76c2c1-6765-413c-848e-9dfec296e63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.332172 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76c2c1-6765-413c-848e-9dfec296e63d admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.332460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76c2c1-6765-413c-848e-9dfec296e63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.332760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76c2c1-6765-413c-848e-9dfec296e63d admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.333477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76c2c1-6765-413c-848e-9dfec296e63d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.335424 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76c2c1-6765-413c-848e-9dfec296e63d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.395843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1025/2048] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:54 2022] PUT /identity/v3/projects/b3b88b9e473444fba3df5728254c50a2/users/5540b4c73ebd470dbb37a478ce26025d/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:54.408025 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29346d7e-3404-47d2-b3fe-90888e4676a4 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.408313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29346d7e-3404-47d2-b3fe-90888e4676a4 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.408595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29346d7e-3404-47d2-b3fe-90888e4676a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.437848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-29346d7e-3404-47d2-b3fe-90888e4676a4 None None] MFA Rules not processed for user `5540b4c73ebd470dbb37a478ce26025d`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:54.439247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-29346d7e-3404-47d2-b3fe-90888e4676a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:54.453330 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1024/2049] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:54 2022] POST /identity/v3/projects => generated 361 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:54.457541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76c2c1-6765-413c-848e-9dfec296e63d admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.520477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1026/2050] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:54.521659 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29346d7e-3404-47d2-b3fe-90888e4676a4 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.537383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76c2c1-6765-413c-848e-9dfec296e63d admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.543241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195ffab-9918-4ae8-8095-6ed0d26a26f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.544770 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195ffab-9918-4ae8-8095-6ed0d26a26f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.545271 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195ffab-9918-4ae8-8095-6ed0d26a26f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.545615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195ffab-9918-4ae8-8095-6ed0d26a26f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.546388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195ffab-9918-4ae8-8095-6ed0d26a26f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.548457 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195ffab-9918-4ae8-8095-6ed0d26a26f6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.589548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29346d7e-3404-47d2-b3fe-90888e4676a4 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.596747 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331be28-d90d-45df-9ebc-8145b60fbc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.597373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331be28-d90d-45df-9ebc-8145b60fbc65 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.597697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331be28-d90d-45df-9ebc-8145b60fbc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.597973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331be28-d90d-45df-9ebc-8145b60fbc65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.598693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331be28-d90d-45df-9ebc-8145b60fbc65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.600778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331be28-d90d-45df-9ebc-8145b60fbc65 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.649920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1025/2051] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:54 2022] POST /identity/v3/users => generated 281 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:54.650247 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195ffab-9918-4ae8-8095-6ed0d26a26f6 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.663875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195ffab-9918-4ae8-8095-6ed0d26a26f6 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.665736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:54.670701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dc105-28e5-48ae-a1e4-ea52838e4161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.671293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc105-28e5-48ae-a1e4-ea52838e4161 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.671577 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc105-28e5-48ae-a1e4-ea52838e4161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.676061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc105-28e5-48ae-a1e4-ea52838e4161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.676061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dc105-28e5-48ae-a1e4-ea52838e4161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.676061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dc105-28e5-48ae-a1e4-ea52838e4161 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.685103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1026/2052] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:54.689028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dc105-28e5-48ae-a1e4-ea52838e4161 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.699385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1027/2053] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:54 2022] POST /identity/v3/projects => generated 401 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:54.700036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dc105-28e5-48ae-a1e4-ea52838e4161 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.707511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331be28-d90d-45df-9ebc-8145b60fbc65 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.757223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126a544-6ed3-4cce-a56a-708dfa84ee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.757841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a544-6ed3-4cce-a56a-708dfa84ee96 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.758685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a544-6ed3-4cce-a56a-708dfa84ee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.758971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126a544-6ed3-4cce-a56a-708dfa84ee96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.759690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126a544-6ed3-4cce-a56a-708dfa84ee96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.761390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126a544-6ed3-4cce-a56a-708dfa84ee96 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.770123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331be28-d90d-45df-9ebc-8145b60fbc65 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.771872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1027/2054] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:54.775480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc8c17-4061-4003-b569-31e11431fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.776070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126a544-6ed3-4cce-a56a-708dfa84ee96 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.776174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc8c17-4061-4003-b569-31e11431fb59 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.776401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc8c17-4061-4003-b569-31e11431fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.776676 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc8c17-4061-4003-b569-31e11431fb59 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.777628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc8c17-4061-4003-b569-31e11431fb59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.779716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc8c17-4061-4003-b569-31e11431fb59 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.786637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126a544-6ed3-4cce-a56a-708dfa84ee96 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.791560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23079a-86d4-4096-a72e-aec5ed87443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.792247 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23079a-86d4-4096-a72e-aec5ed87443b admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.792564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23079a-86d4-4096-a72e-aec5ed87443b admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.792870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23079a-86d4-4096-a72e-aec5ed87443b admin admin] PATH_INFO: `/v3/projects/ecb803bfffda407da016e08f053c74d7/users/c0d80a9d58034f5f9bb1f80ca3e2331b/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.807963 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23079a-86d4-4096-a72e-aec5ed87443b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb803bfffda407da016e08f053c74d7, user_id=c0d80a9d58034f5f9bb1f80ca3e2331b, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.811703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23079a-86d4-4096-a72e-aec5ed87443b admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.851048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1028/2055] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:54 2022] POST /identity/v3/users => generated 307 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:54.855178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc8c17-4061-4003-b569-31e11431fb59 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.866167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc8c17-4061-4003-b569-31e11431fb59 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.871133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24839a97-e590-44d3-b811-2024430fb019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.872361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839a97-e590-44d3-b811-2024430fb019 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.872754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839a97-e590-44d3-b811-2024430fb019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.873041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839a97-e590-44d3-b811-2024430fb019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.873825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24839a97-e590-44d3-b811-2024430fb019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.875689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24839a97-e590-44d3-b811-2024430fb019 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:54.886324 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1029/2056] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:54.891022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24839a97-e590-44d3-b811-2024430fb019 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:54.893779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1028/2057] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:54 2022] PUT /identity/v3/projects/ecb803bfffda407da016e08f053c74d7/users/c0d80a9d58034f5f9bb1f80ca3e2331b/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:54.904764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963c39-e873-4315-926e-786640862ee6 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.904919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24839a97-e590-44d3-b811-2024430fb019 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:54.905047 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963c39-e873-4315-926e-786640862ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.905321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963c39-e873-4315-926e-786640862ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.933393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-39963c39-e873-4315-926e-786640862ee6 None None] MFA Rules not processed for user `c0d80a9d58034f5f9bb1f80ca3e2331b`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:54.934468 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-39963c39-e873-4315-926e-786640862ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:54.943605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:54.968189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f3b52-51c1-467d-b1ff-5407b8a1c6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:54.968859 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f3b52-51c1-467d-b1ff-5407b8a1c6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:54.969141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f3b52-51c1-467d-b1ff-5407b8a1c6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:54.969421 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f3b52-51c1-467d-b1ff-5407b8a1c6c3 admin admin] PATH_INFO: `/v3/projects/d3f852b3f58d4f1a96a46a0b933d79a0/users/c6761c522d1e4a6da6ef061829c93400/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:54.985161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f3b52-51c1-467d-b1ff-5407b8a1c6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f852b3f58d4f1a96a46a0b933d79a0, user_id=c6761c522d1e4a6da6ef061829c93400, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:54.988199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f3b52-51c1-467d-b1ff-5407b8a1c6c3 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:55.000541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1029/2058] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:55.010276 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963c39-e873-4315-926e-786640862ee6 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:55.021080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963c39-e873-4315-926e-786640862ee6 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:55.025824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58e2e0-5d84-47a2-9b52-f6118b139b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:55.026457 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58e2e0-5d84-47a2-9b52-f6118b139b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.026788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58e2e0-5d84-47a2-9b52-f6118b139b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.027147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58e2e0-5d84-47a2-9b52-f6118b139b4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:55.028819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58e2e0-5d84-47a2-9b52-f6118b139b4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:55.030778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58e2e0-5d84-47a2-9b52-f6118b139b4a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:55.085675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1030/2059] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:54 2022] PUT /identity/v3/projects/d3f852b3f58d4f1a96a46a0b933d79a0/users/c6761c522d1e4a6da6ef061829c93400/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:55.093371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f3b52-51c1-467d-b1ff-5407b8a1c6c3 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:55.157318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f3b52-51c1-467d-b1ff-5407b8a1c6c3 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:55.163757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405675fa-1fbc-474b-815e-31932b844a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:55.164647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405675fa-1fbc-474b-815e-31932b844a42 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.164938 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405675fa-1fbc-474b-815e-31932b844a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.168018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405675fa-1fbc-474b-815e-31932b844a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:55.168018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405675fa-1fbc-474b-815e-31932b844a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:55.168018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405675fa-1fbc-474b-815e-31932b844a42 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:55.172384 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1030/2060] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:55 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:55.176202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58e2e0-5d84-47a2-9b52-f6118b139b4a admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:55.182933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1031/2061] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:55.185721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405675fa-1fbc-474b-815e-31932b844a42 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:55.197397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405675fa-1fbc-474b-815e-31932b844a42 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:55.211566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:55.266884 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846a70f-b351-4406-a3e3-f1654bdf7a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:55.267103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58e2e0-5d84-47a2-9b52-f6118b139b4a admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:55.267828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846a70f-b351-4406-a3e3-f1654bdf7a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.268217 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846a70f-b351-4406-a3e3-f1654bdf7a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.268502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846a70f-b351-4406-a3e3-f1654bdf7a2b admin admin] PATH_INFO: `/v3/projects/d3f852b3f58d4f1a96a46a0b933d79a0/users/c6761c522d1e4a6da6ef061829c93400/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:55.271529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846a70f-b351-4406-a3e3-f1654bdf7a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f852b3f58d4f1a96a46a0b933d79a0, user_id=c6761c522d1e4a6da6ef061829c93400, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:55.272897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3f08-eeaa-4c66-8e6d-582a30829533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:55.273524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3f08-eeaa-4c66-8e6d-582a30829533 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.273813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3f08-eeaa-4c66-8e6d-582a30829533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.274089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3f08-eeaa-4c66-8e6d-582a30829533 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:55.274617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846a70f-b351-4406-a3e3-f1654bdf7a2b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:55.274838 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e3f08-eeaa-4c66-8e6d-582a30829533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:55.276775 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e3f08-eeaa-4c66-8e6d-582a30829533 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:55.281451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:55.296938 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1032/2062] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:55 2022] PUT /identity/v3/projects/d3f852b3f58d4f1a96a46a0b933d79a0/users/c6761c522d1e4a6da6ef061829c93400/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:55.305604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b78d4-f5e5-434b-be62-eee141c1eb22 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.305893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b78d4-f5e5-434b-be62-eee141c1eb22 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.306172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b78d4-f5e5-434b-be62-eee141c1eb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:55.335216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-010b78d4-f5e5-434b-be62-eee141c1eb22 None None] MFA Rules not processed for user `c6761c522d1e4a6da6ef061829c93400`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:55.336466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-010b78d4-f5e5-434b-be62-eee141c1eb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:55.382733 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1031/2063] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:55 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:55.386952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3f08-eeaa-4c66-8e6d-582a30829533 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:55.397952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3f08-eeaa-4c66-8e6d-582a30829533 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:55.421164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1033/2064] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:55 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:55.432420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b78d4-f5e5-434b-be62-eee141c1eb22 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:55.434169 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-010b78d4-f5e5-434b-be62-eee141c1eb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:55.453214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:55.464809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2252104-dd32-4308-8c73-e51ea59e7948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:55.465440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2252104-dd32-4308-8c73-e51ea59e7948 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.466443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2252104-dd32-4308-8c73-e51ea59e7948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.467012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2252104-dd32-4308-8c73-e51ea59e7948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:55.467674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2252104-dd32-4308-8c73-e51ea59e7948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:55.469325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2252104-dd32-4308-8c73-e51ea59e7948 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:55.479511 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1032/2065] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:55.483924 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2252104-dd32-4308-8c73-e51ea59e7948 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:55.498161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b78d4-f5e5-434b-be62-eee141c1eb22 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:55.500185 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2252104-dd32-4308-8c73-e51ea59e7948 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:55.502260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fde45-2d73-4884-85be-87b7c7bc8769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:55.502954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fde45-2d73-4884-85be-87b7c7bc8769 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.503293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fde45-2d73-4884-85be-87b7c7bc8769 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.503571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fde45-2d73-4884-85be-87b7c7bc8769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:55.507366 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093b44f-1dee-4961-9fb9-372afe8673ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:55.513116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093b44f-1dee-4961-9fb9-372afe8673ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.513116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093b44f-1dee-4961-9fb9-372afe8673ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.513116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093b44f-1dee-4961-9fb9-372afe8673ca admin admin] PATH_INFO: `/v3/projects/34efbb8da1f34a19a0016be345eee504/users/6ccdcc68897d4e83bc268395cfd7a778/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:55.515240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fde45-2d73-4884-85be-87b7c7bc8769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:55.516706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fde45-2d73-4884-85be-87b7c7bc8769 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:55.525421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093b44f-1dee-4961-9fb9-372afe8673ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=34efbb8da1f34a19a0016be345eee504, user_id=6ccdcc68897d4e83bc268395cfd7a778, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:55.526771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1034/2066] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:55 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:55.528858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093b44f-1dee-4961-9fb9-372afe8673ca admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:55.605389 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1033/2067] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:55 2022] PUT /identity/v3/projects/34efbb8da1f34a19a0016be345eee504/users/6ccdcc68897d4e83bc268395cfd7a778/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:55.616479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fde45-2d73-4884-85be-87b7c7bc8769 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:55.620627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fde45-2d73-4884-85be-87b7c7bc8769 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:55.705098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23c6a1-30ac-429d-a709-9d5bafef4a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:55.714383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23c6a1-30ac-429d-a709-9d5bafef4a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.714383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23c6a1-30ac-429d-a709-9d5bafef4a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.714383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23c6a1-30ac-429d-a709-9d5bafef4a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:55.714383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23c6a1-30ac-429d-a709-9d5bafef4a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:55.714383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23c6a1-30ac-429d-a709-9d5bafef4a69 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:55.722515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1035/2068] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:55.726895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093b44f-1dee-4961-9fb9-372afe8673ca admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:55.742723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093b44f-1dee-4961-9fb9-372afe8673ca admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:55.755788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86251efa-9128-46f7-a1ba-bf66a86a895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:55.756313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23c6a1-30ac-429d-a709-9d5bafef4a69 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:55.756470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86251efa-9128-46f7-a1ba-bf66a86a895d admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.756807 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86251efa-9128-46f7-a1ba-bf66a86a895d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.757030 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86251efa-9128-46f7-a1ba-bf66a86a895d admin admin] PATH_INFO: `/v3/projects/34efbb8da1f34a19a0016be345eee504/users/6ccdcc68897d4e83bc268395cfd7a778/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:55.758203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-ef23c6a1-30ac-429d-a709-9d5bafef4a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:55.759191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86251efa-9128-46f7-a1ba-bf66a86a895d admin admin] RBAC: Authorizing `identity:create_grant(project_id=34efbb8da1f34a19a0016be345eee504, user_id=6ccdcc68897d4e83bc268395cfd7a778, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:55.761850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86251efa-9128-46f7-a1ba-bf66a86a895d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:55.773463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1034/2069] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:55 2022] PUT /identity/v3/projects/34efbb8da1f34a19a0016be345eee504/users/6ccdcc68897d4e83bc268395cfd7a778/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:55.789656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85071099-f511-43cb-ba2d-2f5cf110399a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.789940 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85071099-f511-43cb-ba2d-2f5cf110399a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.790221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85071099-f511-43cb-ba2d-2f5cf110399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:55.834926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:55.845766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-85071099-f511-43cb-ba2d-2f5cf110399a None None] MFA Rules not processed for user `6ccdcc68897d4e83bc268395cfd7a778`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:55.845766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-85071099-f511-43cb-ba2d-2f5cf110399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:55.886408 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23c6a1-30ac-429d-a709-9d5bafef4a69 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:55.901422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:55.930208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1035/2070] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:37:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:55.961372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e143b-8934-4812-a807-04530fda9507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:55.962008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e143b-8934-4812-a807-04530fda9507 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.962282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e143b-8934-4812-a807-04530fda9507 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.962903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e143b-8934-4812-a807-04530fda9507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:56.021834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e143b-8934-4812-a807-04530fda9507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:56.023375 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e143b-8934-4812-a807-04530fda9507 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:56.033796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1036/2071] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:55 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:56.438201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85071099-f511-43cb-ba2d-2f5cf110399a None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:56.447989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85071099-f511-43cb-ba2d-2f5cf110399a None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:56.452479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846f3ab-5b99-41c5-a1fa-f1990e856012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:56.453089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f3ab-5b99-41c5-a1fa-f1990e856012 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:56.453391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f3ab-5b99-41c5-a1fa-f1990e856012 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:56.453664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f3ab-5b99-41c5-a1fa-f1990e856012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:56.464176 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846f3ab-5b99-41c5-a1fa-f1990e856012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:56.465692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846f3ab-5b99-41c5-a1fa-f1990e856012 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:56.476587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1036/2072] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:57.472796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e143b-8934-4812-a807-04530fda9507 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:57.482892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e143b-8934-4812-a807-04530fda9507 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:57.487455 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a03a-afe5-4033-8806-4f5fae41a8de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:57.488137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a03a-afe5-4033-8806-4f5fae41a8de service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:57.488483 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a03a-afe5-4033-8806-4f5fae41a8de service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:57.488823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a03a-afe5-4033-8806-4f5fae41a8de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:57.568454 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0a03a-afe5-4033-8806-4f5fae41a8de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:57.570042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0a03a-afe5-4033-8806-4f5fae41a8de service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:57.580404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1037/2073] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:01.105732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846f3ab-5b99-41c5-a1fa-f1990e856012 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:01.179068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846f3ab-5b99-41c5-a1fa-f1990e856012 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:01.183786 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46789b-61f0-461d-ae59-2fe439e1f36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:01.184988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46789b-61f0-461d-ae59-2fe439e1f36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:01.185303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46789b-61f0-461d-ae59-2fe439e1f36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:01.185584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46789b-61f0-461d-ae59-2fe439e1f36b admin admin] PATH_INFO: `/v3/users/5540b4c73ebd470dbb37a478ce26025d` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:01.186784 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46789b-61f0-461d-ae59-2fe439e1f36b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5540b4c73ebd470dbb37a478ce26025d)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:01.188778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46789b-61f0-461d-ae59-2fe439e1f36b admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:01.300349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a03a-afe5-4033-8806-4f5fae41a8de service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:01.312748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a03a-afe5-4033-8806-4f5fae41a8de service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:01.317643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d76108-a698-4ad1-8b7c-44d2e5f1f694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:01.318335 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d76108-a698-4ad1-8b7c-44d2e5f1f694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:01.318654 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d76108-a698-4ad1-8b7c-44d2e5f1f694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:01.318937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d76108-a698-4ad1-8b7c-44d2e5f1f694 admin admin] PATH_INFO: `/v3/users/c0d80a9d58034f5f9bb1f80ca3e2331b` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:01.320115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d76108-a698-4ad1-8b7c-44d2e5f1f694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d80a9d58034f5f9bb1f80ca3e2331b)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:01.322127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d76108-a698-4ad1-8b7c-44d2e5f1f694 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:01.368253 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4d46789b-61f0-461d-ae59-2fe439e1f36b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5540b4c73ebd470dbb37a478ce26025d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:01.423493 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4d46789b-61f0-461d-ae59-2fe439e1f36b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5540b4c73ebd470dbb37a478ce26025d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:01.431988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4d46789b-61f0-461d-ae59-2fe439e1f36b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5540b4c73ebd470dbb37a478ce26025d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:01.432758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4d46789b-61f0-461d-ae59-2fe439e1f36b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5540b4c73ebd470dbb37a478ce26025d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:01.433386 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4d46789b-61f0-461d-ae59-2fe439e1f36b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5540b4c73ebd470dbb37a478ce26025d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:01.453814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1037/2074] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:01 2022] DELETE /identity/v3/users/5540b4c73ebd470dbb37a478ce26025d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:01.458466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee256a6-3a15-4713-90e4-0448db7e0294 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:01.458837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee256a6-3a15-4713-90e4-0448db7e0294 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:01.469647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee256a6-3a15-4713-90e4-0448db7e0294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:01.470035 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:01.473495 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-99d76108-a698-4ad1-8b7c-44d2e5f1f694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d80a9d58034f5f9bb1f80ca3e2331b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:01.480419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-4ee256a6-3a15-4713-90e4-0448db7e0294 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:01.482370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4ee256a6-3a15-4713-90e4-0448db7e0294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:01.486742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-99d76108-a698-4ad1-8b7c-44d2e5f1f694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d80a9d58034f5f9bb1f80ca3e2331b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:01.487705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-99d76108-a698-4ad1-8b7c-44d2e5f1f694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d80a9d58034f5f9bb1f80ca3e2331b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:01.494385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-99d76108-a698-4ad1-8b7c-44d2e5f1f694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d80a9d58034f5f9bb1f80ca3e2331b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:01.530588 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:01.546512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1038/2075] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:01.549044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-99d76108-a698-4ad1-8b7c-44d2e5f1f694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d80a9d58034f5f9bb1f80ca3e2331b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:01.554421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee256a6-3a15-4713-90e4-0448db7e0294 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:01.555709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1038/2076] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:01 2022] DELETE /identity/v3/users/c0d80a9d58034f5f9bb1f80ca3e2331b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:01.558756 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4ee256a6-3a15-4713-90e4-0448db7e0294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:01.561038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2201f-515b-487d-bbfe-092484297a31 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:01.561353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2201f-515b-487d-bbfe-092484297a31 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:01.561705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2201f-515b-487d-bbfe-092484297a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:01.581266 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-ebc2201f-515b-487d-bbfe-092484297a31 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:01.582510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-ebc2201f-515b-487d-bbfe-092484297a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:01.616261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee256a6-3a15-4713-90e4-0448db7e0294 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:01.651393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1039/2077] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:01.663247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2201f-515b-487d-bbfe-092484297a31 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:01.674044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2780b2-d1d9-4adc-bee8-a5234964ef65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:01.674736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2780b2-d1d9-4adc-bee8-a5234964ef65 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:01.675020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2780b2-d1d9-4adc-bee8-a5234964ef65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:01.675291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2780b2-d1d9-4adc-bee8-a5234964ef65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:01.685290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2780b2-d1d9-4adc-bee8-a5234964ef65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:01.687207 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2780b2-d1d9-4adc-bee8-a5234964ef65 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:01.698526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1039/2078] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:38:01.728284 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2201f-515b-487d-bbfe-092484297a31 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:01.733708 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e54b8-1087-47c3-9911-bc5ea819fe2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:01.734782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e54b8-1087-47c3-9911-bc5ea819fe2c service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:01.735127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e54b8-1087-47c3-9911-bc5ea819fe2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:01.735442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e54b8-1087-47c3-9911-bc5ea819fe2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:01.745809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e54b8-1087-47c3-9911-bc5ea819fe2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:01.747450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e54b8-1087-47c3-9911-bc5ea819fe2c service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:01.757746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1040/2079] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:38:02.317649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2780b2-d1d9-4adc-bee8-a5234964ef65 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:02.319161 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-cb2780b2-d1d9-4adc-bee8-a5234964ef65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:02.341351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2780b2-d1d9-4adc-bee8-a5234964ef65 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:02.361256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:02.375689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:02.375689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:02.375689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] PATH_INFO: `/v3/projects/ecb803bfffda407da016e08f053c74d7` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:02.375689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb803bfffda407da016e08f053c74d7)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:02.376262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:02.454252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e54b8-1087-47c3-9911-bc5ea819fe2c service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:02.456552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-785e54b8-1087-47c3-9911-bc5ea819fe2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:02.471877 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e54b8-1087-47c3-9911-bc5ea819fe2c service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:02.476895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:02.477809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:02.478237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:02.478693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] PATH_INFO: `/v3/projects/b3b88b9e473444fba3df5728254c50a2` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:02.480730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b88b9e473444fba3df5728254c50a2)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:02.483475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:02.511827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb803bfffda407da016e08f053c74d7', 'request_id': 'req-1788da9f-8efd-478c-9997-90ff04a0fe34'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:02.600035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb803bfffda407da016e08f053c74d7', 'request_id': 'req-1788da9f-8efd-478c-9997-90ff04a0fe34'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:02.611131 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb803bfffda407da016e08f053c74d7', 'request_id': 'req-1788da9f-8efd-478c-9997-90ff04a0fe34'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:02.624486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] The token cache is being invalidate because project ecb803bfffda407da016e08f053c74d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:02.624782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:02.625440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:02.627696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1040/2080] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:02 2022] DELETE /identity/v3/projects/ecb803bfffda407da016e08f053c74d7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:02.631525 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:02.633114 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:02.636156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:02.638253 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b88b9e473444fba3df5728254c50a2', 'request_id': 'req-a4554635-8431-4a7a-bdaa-579a04f3ca3b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:02.645261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b88b9e473444fba3df5728254c50a2', 'request_id': 'req-a4554635-8431-4a7a-bdaa-579a04f3ca3b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:02.677926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:02.702974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788da9f-8efd-478c-9997-90ff04a0fe34 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:02.713771 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b88b9e473444fba3df5728254c50a2', 'request_id': 'req-a4554635-8431-4a7a-bdaa-579a04f3ca3b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:02.726681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] The token cache is being invalidate because project b3b88b9e473444fba3df5728254c50a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:02.727046 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:02.727745 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:02.729343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1041/2081] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:02 2022] DELETE /identity/v3/projects/b3b88b9e473444fba3df5728254c50a2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:02.733447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:02.734959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:02.760724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:02.761375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:02.761664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:02.761944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] PATH_INFO: `/v3/users/6ccdcc68897d4e83bc268395cfd7a778` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:02.764203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccdcc68897d4e83bc268395cfd7a778)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:02.766158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:02.801970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4554635-8431-4a7a-bdaa-579a04f3ca3b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:02.806833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:02.807476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:02.807763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:02.808067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] PATH_INFO: `/v3/users/c6761c522d1e4a6da6ef061829c93400` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:02.809231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6761c522d1e4a6da6ef061829c93400)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:02.811436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:02.933066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccdcc68897d4e83bc268395cfd7a778'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.007542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6761c522d1e4a6da6ef061829c93400'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.019803 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6761c522d1e4a6da6ef061829c93400'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.020487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6761c522d1e4a6da6ef061829c93400'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.022803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccdcc68897d4e83bc268395cfd7a778'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.031223 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6761c522d1e4a6da6ef061829c93400'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.031485 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccdcc68897d4e83bc268395cfd7a778'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.032181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccdcc68897d4e83bc268395cfd7a778'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.032838 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccdcc68897d4e83bc268395cfd7a778'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.051061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1041/2082] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:02 2022] DELETE /identity/v3/users/6ccdcc68897d4e83bc268395cfd7a778 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:03.133889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6761c522d1e4a6da6ef061829c93400'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.139575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1042/2083] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:02 2022] DELETE /identity/v3/users/c6761c522d1e4a6da6ef061829c93400 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:03.537973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:03.539512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:03.624726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e9a6d-5847-4140-9cfc-7479cdc27f90 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:03.625950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:03.627605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:03.629819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:03.707689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562063ab-bcb4-41b9-bff6-ac483cca4d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:03.716344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562063ab-bcb4-41b9-bff6-ac483cca4d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:03.716344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562063ab-bcb4-41b9-bff6-ac483cca4d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:03.716344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562063ab-bcb4-41b9-bff6-ac483cca4d36 admin admin] PATH_INFO: `/v3/projects/34efbb8da1f34a19a0016be345eee504` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:03.716344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562063ab-bcb4-41b9-bff6-ac483cca4d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34efbb8da1f34a19a0016be345eee504)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:03.716344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562063ab-bcb4-41b9-bff6-ac483cca4d36 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:03.722137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:03.727970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c13f5-7c2c-4fb9-8f73-ff36833b6f17 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:03.735032 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214aff8-8a16-451e-a3bf-c55957a6cf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:03.735900 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214aff8-8a16-451e-a3bf-c55957a6cf40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:03.736292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214aff8-8a16-451e-a3bf-c55957a6cf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:03.736671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214aff8-8a16-451e-a3bf-c55957a6cf40 admin admin] PATH_INFO: `/v3/projects/d3f852b3f58d4f1a96a46a0b933d79a0` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:03.738172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214aff8-8a16-451e-a3bf-c55957a6cf40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f852b3f58d4f1a96a46a0b933d79a0)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:03.740368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214aff8-8a16-451e-a3bf-c55957a6cf40 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:03.852293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-562063ab-bcb4-41b9-bff6-ac483cca4d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34efbb8da1f34a19a0016be345eee504', 'request_id': 'req-562063ab-bcb4-41b9-bff6-ac483cca4d36'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.883435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4214aff8-8a16-451e-a3bf-c55957a6cf40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f852b3f58d4f1a96a46a0b933d79a0', 'request_id': 'req-4214aff8-8a16-451e-a3bf-c55957a6cf40'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.892725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4214aff8-8a16-451e-a3bf-c55957a6cf40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f852b3f58d4f1a96a46a0b933d79a0', 'request_id': 'req-4214aff8-8a16-451e-a3bf-c55957a6cf40'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.908290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-562063ab-bcb4-41b9-bff6-ac483cca4d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34efbb8da1f34a19a0016be345eee504', 'request_id': 'req-562063ab-bcb4-41b9-bff6-ac483cca4d36'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.915646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-562063ab-bcb4-41b9-bff6-ac483cca4d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34efbb8da1f34a19a0016be345eee504', 'request_id': 'req-562063ab-bcb4-41b9-bff6-ac483cca4d36'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.928916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-562063ab-bcb4-41b9-bff6-ac483cca4d36 admin admin] The token cache is being invalidate because project 34efbb8da1f34a19a0016be345eee504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:03.929296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-562063ab-bcb4-41b9-bff6-ac483cca4d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.930074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-562063ab-bcb4-41b9-bff6-ac483cca4d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:03.931644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1042/2084] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:03 2022] DELETE /identity/v3/projects/34efbb8da1f34a19a0016be345eee504 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:03.936876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed5371-b2da-42f6-8b40-73de7c77604b None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:03.937167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed5371-b2da-42f6-8b40-73de7c77604b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:03.939159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed5371-b2da-42f6-8b40-73de7c77604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:03.959546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-40ed5371-b2da-42f6-8b40-73de7c77604b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:03.960007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-40ed5371-b2da-42f6-8b40-73de7c77604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:04.011449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4214aff8-8a16-451e-a3bf-c55957a6cf40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f852b3f58d4f1a96a46a0b933d79a0', 'request_id': 'req-4214aff8-8a16-451e-a3bf-c55957a6cf40'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:04.023636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1043/2085] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:04.033093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170da63-c5cc-4d19-8a38-3d85c09ed850 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.033514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170da63-c5cc-4d19-8a38-3d85c09ed850 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.033899 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170da63-c5cc-4d19-8a38-3d85c09ed850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.037611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4214aff8-8a16-451e-a3bf-c55957a6cf40 admin admin] The token cache is being invalidate because project d3f852b3f58d4f1a96a46a0b933d79a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:04.038262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4214aff8-8a16-451e-a3bf-c55957a6cf40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:04.039451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4214aff8-8a16-451e-a3bf-c55957a6cf40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:04.041529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1043/2086] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:03 2022] DELETE /identity/v3/projects/d3f852b3f58d4f1a96a46a0b933d79a0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:04.048542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a249d-9e63-4142-9d17-59f12153ac4e None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.049042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a249d-9e63-4142-9d17-59f12153ac4e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.049501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a249d-9e63-4142-9d17-59f12153ac4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.057950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f170da63-c5cc-4d19-8a38-3d85c09ed850 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:04.059196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f170da63-c5cc-4d19-8a38-3d85c09ed850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:04.069554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1044/2087] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:04.073868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170da63-c5cc-4d19-8a38-3d85c09ed850 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.077522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-ba2a249d-9e63-4142-9d17-59f12153ac4e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:04.079104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-ba2a249d-9e63-4142-9d17-59f12153ac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:04.084579 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170da63-c5cc-4d19-8a38-3d85c09ed850 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.088827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1044/2088] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:04.097418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71511-536c-49a5-adcb-f4c616b2ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.098044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71511-536c-49a5-adcb-f4c616b2ea29 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.098823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368e2d6-c318-491c-9887-16c0d3b31db7 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.099183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368e2d6-c318-491c-9887-16c0d3b31db7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.099531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368e2d6-c318-491c-9887-16c0d3b31db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.100754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71511-536c-49a5-adcb-f4c616b2ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.101043 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71511-536c-49a5-adcb-f4c616b2ea29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.101753 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a71511-536c-49a5-adcb-f4c616b2ea29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:04.102056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a71511-536c-49a5-adcb-f4c616b2ea29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.103917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a71511-536c-49a5-adcb-f4c616b2ea29 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.117531 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1045/2089] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:38:04.126273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-0368e2d6-c318-491c-9887-16c0d3b31db7 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:04.126865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71511-536c-49a5-adcb-f4c616b2ea29 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.127715 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0368e2d6-c318-491c-9887-16c0d3b31db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:04.140120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71511-536c-49a5-adcb-f4c616b2ea29 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.143624 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1045/2090] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:04.148671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368e2d6-c318-491c-9887-16c0d3b31db7 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.154384 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdea4c-0155-4a84-aa0a-013c2c119484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.158313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdea4c-0155-4a84-aa0a-013c2c119484 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.158313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdea4c-0155-4a84-aa0a-013c2c119484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.158313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdea4c-0155-4a84-aa0a-013c2c119484 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.158313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdea4c-0155-4a84-aa0a-013c2c119484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.159064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdea4c-0155-4a84-aa0a-013c2c119484 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.164194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368e2d6-c318-491c-9887-16c0d3b31db7 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.170309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b46213-f08b-4f80-8e8d-3a3063ad5b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.171014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b46213-f08b-4f80-8e8d-3a3063ad5b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.171298 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b46213-f08b-4f80-8e8d-3a3063ad5b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.171597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b46213-f08b-4f80-8e8d-3a3063ad5b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.172303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b46213-f08b-4f80-8e8d-3a3063ad5b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:04.172629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b46213-f08b-4f80-8e8d-3a3063ad5b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.174230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b46213-f08b-4f80-8e8d-3a3063ad5b97 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.190520 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1046/2091] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:38:04.191797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b46213-f08b-4f80-8e8d-3a3063ad5b97 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.202616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b46213-f08b-4f80-8e8d-3a3063ad5b97 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.207377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b714-a6d6-45ac-8c6e-06060dea7867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.207977 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b714-a6d6-45ac-8c6e-06060dea7867 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.208264 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b714-a6d6-45ac-8c6e-06060dea7867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.208568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b714-a6d6-45ac-8c6e-06060dea7867 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.209257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7b714-a6d6-45ac-8c6e-06060dea7867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.211310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7b714-a6d6-45ac-8c6e-06060dea7867 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.241426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1046/2092] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:04.245533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdea4c-0155-4a84-aa0a-013c2c119484 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.306382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdea4c-0155-4a84-aa0a-013c2c119484 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.311853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2068cd-7c59-4ca0-b552-3e3ee357bdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.312623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2068cd-7c59-4ca0-b552-3e3ee357bdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.312910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2068cd-7c59-4ca0-b552-3e3ee357bdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.313189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2068cd-7c59-4ca0-b552-3e3ee357bdf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.313857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2068cd-7c59-4ca0-b552-3e3ee357bdf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.318325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1047/2093] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:04.318557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2068cd-7c59-4ca0-b552-3e3ee357bdf4 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.319338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b714-a6d6-45ac-8c6e-06060dea7867 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.382124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b714-a6d6-45ac-8c6e-06060dea7867 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.386788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a8bdb-29eb-49a0-94cc-99ef01b614b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.387961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a8bdb-29eb-49a0-94cc-99ef01b614b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.388416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a8bdb-29eb-49a0-94cc-99ef01b614b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.388869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a8bdb-29eb-49a0-94cc-99ef01b614b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.389550 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a8bdb-29eb-49a0-94cc-99ef01b614b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.391500 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a8bdb-29eb-49a0-94cc-99ef01b614b6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.410132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1047/2094] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:38:04.410961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2068cd-7c59-4ca0-b552-3e3ee357bdf4 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.421801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2068cd-7c59-4ca0-b552-3e3ee357bdf4 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.426846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8df81e-8374-4f0c-9bdb-be42c074e665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.427494 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8df81e-8374-4f0c-9bdb-be42c074e665 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.427785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8df81e-8374-4f0c-9bdb-be42c074e665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.428070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8df81e-8374-4f0c-9bdb-be42c074e665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.428780 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8df81e-8374-4f0c-9bdb-be42c074e665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.430437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8df81e-8374-4f0c-9bdb-be42c074e665 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.440850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1048/2095] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:04.446827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8df81e-8374-4f0c-9bdb-be42c074e665 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.457166 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8df81e-8374-4f0c-9bdb-be42c074e665 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.462398 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c092-6e79-4ec5-b052-a3cbbbd63603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.463045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c092-6e79-4ec5-b052-a3cbbbd63603 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.463335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c092-6e79-4ec5-b052-a3cbbbd63603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.463611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8c092-6e79-4ec5-b052-a3cbbbd63603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.464300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8c092-6e79-4ec5-b052-a3cbbbd63603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.466528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8c092-6e79-4ec5-b052-a3cbbbd63603 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.477274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1049/2096] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:04.481343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c092-6e79-4ec5-b052-a3cbbbd63603 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.491391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8c092-6e79-4ec5-b052-a3cbbbd63603 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.494346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:04.499493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1048/2097] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:04.500216 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ba08f-f297-4f38-8007-64345f2da312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.500930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ba08f-f297-4f38-8007-64345f2da312 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.501580 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ba08f-f297-4f38-8007-64345f2da312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.502412 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ba08f-f297-4f38-8007-64345f2da312 admin admin] PATH_INFO: `/v3/projects/53a68941f592479a88e4543651340c73/users/a4ebb6ea12234e3cab69004072861a0b/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.504475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a8bdb-29eb-49a0-94cc-99ef01b614b6 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.514884 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a8bdb-29eb-49a0-94cc-99ef01b614b6 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.519230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ba08f-f297-4f38-8007-64345f2da312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a68941f592479a88e4543651340c73, user_id=a4ebb6ea12234e3cab69004072861a0b, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.519732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9db78-473c-4793-b8b5-16af8f282903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.520284 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9db78-473c-4793-b8b5-16af8f282903 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.520564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9db78-473c-4793-b8b5-16af8f282903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.520839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9db78-473c-4793-b8b5-16af8f282903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.521529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9db78-473c-4793-b8b5-16af8f282903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.522070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ba08f-f297-4f38-8007-64345f2da312 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.523167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9db78-473c-4793-b8b5-16af8f282903 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.534589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1049/2098] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:04.538766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9db78-473c-4793-b8b5-16af8f282903 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.548734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9db78-473c-4793-b8b5-16af8f282903 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.553658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6010-e96f-4e47-bf11-0e2b40773a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.554251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6010-e96f-4e47-bf11-0e2b40773a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.554573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6010-e96f-4e47-bf11-0e2b40773a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.554852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6010-e96f-4e47-bf11-0e2b40773a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.555538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d6010-e96f-4e47-bf11-0e2b40773a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.557224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d6010-e96f-4e47-bf11-0e2b40773a40 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.567839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1050/2099] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:04.571884 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6010-e96f-4e47-bf11-0e2b40773a40 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.581811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6010-e96f-4e47-bf11-0e2b40773a40 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.584159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:04.588103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a106acf-473d-49c4-b862-f65bb6e51f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.588744 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a106acf-473d-49c4-b862-f65bb6e51f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.589027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a106acf-473d-49c4-b862-f65bb6e51f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.589310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a106acf-473d-49c4-b862-f65bb6e51f2c admin admin] PATH_INFO: `/v3/projects/d82a72ac78814327be89f984dc765b4e/users/cedf01d8ff9d46aca8a8a022c850ca79/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.605566 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a106acf-473d-49c4-b862-f65bb6e51f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82a72ac78814327be89f984dc765b4e, user_id=cedf01d8ff9d46aca8a8a022c850ca79, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.608570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a106acf-473d-49c4-b862-f65bb6e51f2c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.618093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1050/2100] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:04 2022] PUT /identity/v3/projects/53a68941f592479a88e4543651340c73/users/a4ebb6ea12234e3cab69004072861a0b/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:04.630565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be6992-fb3f-4ac3-819a-a30501f4dd60 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.630870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be6992-fb3f-4ac3-819a-a30501f4dd60 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.631152 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be6992-fb3f-4ac3-819a-a30501f4dd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.660789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-25be6992-fb3f-4ac3-819a-a30501f4dd60 None None] MFA Rules not processed for user `a4ebb6ea12234e3cab69004072861a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:04.662038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-25be6992-fb3f-4ac3-819a-a30501f4dd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:04.720901 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1051/2101] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:04 2022] PUT /identity/v3/projects/d82a72ac78814327be89f984dc765b4e/users/cedf01d8ff9d46aca8a8a022c850ca79/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:04.731593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1051/2102] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:04.736529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a106acf-473d-49c4-b862-f65bb6e51f2c admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.740379 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76574140-068c-4895-9079-dc1e9a4626eb None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.741179 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76574140-068c-4895-9079-dc1e9a4626eb None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.741476 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76574140-068c-4895-9079-dc1e9a4626eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.773591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-76574140-068c-4895-9079-dc1e9a4626eb None None] MFA Rules not processed for user `cedf01d8ff9d46aca8a8a022c850ca79`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:04.774877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-76574140-068c-4895-9079-dc1e9a4626eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:04.802294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a106acf-473d-49c4-b862-f65bb6e51f2c admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.807011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde87cc-df00-44ad-b792-f7ad9a496b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.807783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde87cc-df00-44ad-b792-f7ad9a496b2b admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.808027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde87cc-df00-44ad-b792-f7ad9a496b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.808307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde87cc-df00-44ad-b792-f7ad9a496b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.808982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde87cc-df00-44ad-b792-f7ad9a496b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.815751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde87cc-df00-44ad-b792-f7ad9a496b2b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.843967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1052/2103] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:04.847448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76574140-068c-4895-9079-dc1e9a4626eb None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.858396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76574140-068c-4895-9079-dc1e9a4626eb None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:04.863479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d1fc-f0d3-449c-ae59-08cc810f2519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:04.873990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d1fc-f0d3-449c-ae59-08cc810f2519 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:04.873990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d1fc-f0d3-449c-ae59-08cc810f2519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:04.873990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999d1fc-f0d3-449c-ae59-08cc810f2519 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:04.873990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999d1fc-f0d3-449c-ae59-08cc810f2519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:04.873990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999d1fc-f0d3-449c-ae59-08cc810f2519 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:04.921779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1052/2104] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:04.928723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde87cc-df00-44ad-b792-f7ad9a496b2b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.945788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1053/2105] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:04.953550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d1fc-f0d3-449c-ae59-08cc810f2519 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:04.999510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde87cc-df00-44ad-b792-f7ad9a496b2b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.033123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999d1fc-f0d3-449c-ae59-08cc810f2519 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.043441 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65911bd-8df0-49a3-880e-5f0b79f98937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:05.046730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65911bd-8df0-49a3-880e-5f0b79f98937 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.047255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65911bd-8df0-49a3-880e-5f0b79f98937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.047712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65911bd-8df0-49a3-880e-5f0b79f98937 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.048711 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65911bd-8df0-49a3-880e-5f0b79f98937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:05.051761 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65911bd-8df0-49a3-880e-5f0b79f98937 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:05.058193 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:05.092424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e02ab-ed43-4928-9441-723e95b8ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:05.093017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e02ab-ed43-4928-9441-723e95b8ff0a admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.093306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e02ab-ed43-4928-9441-723e95b8ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.093586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e02ab-ed43-4928-9441-723e95b8ff0a admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.094445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e02ab-ed43-4928-9441-723e95b8ff0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:05.100177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e02ab-ed43-4928-9441-723e95b8ff0a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:05.154758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1054/2106] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:05.158830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65911bd-8df0-49a3-880e-5f0b79f98937 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:05.168438 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65911bd-8df0-49a3-880e-5f0b79f98937 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.173690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c88798-de3a-48c2-9e42-6be9d4c8ad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:05.174280 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c88798-de3a-48c2-9e42-6be9d4c8ad74 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.174603 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c88798-de3a-48c2-9e42-6be9d4c8ad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.174886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c88798-de3a-48c2-9e42-6be9d4c8ad74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.175581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c88798-de3a-48c2-9e42-6be9d4c8ad74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:05.177190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c88798-de3a-48c2-9e42-6be9d4c8ad74 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:05.188608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1055/2107] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:05.200718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c88798-de3a-48c2-9e42-6be9d4c8ad74 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:05.203400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c88798-de3a-48c2-9e42-6be9d4c8ad74 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.208264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6f74c-0f0f-49a4-a882-4c7b8a9a7d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:05.208931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6f74c-0f0f-49a4-a882-4c7b8a9a7d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.209215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6f74c-0f0f-49a4-a882-4c7b8a9a7d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.209493 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6f74c-0f0f-49a4-a882-4c7b8a9a7d77 admin admin] PATH_INFO: `/v3/projects/0416aaacbc6b4714a103e80d1b0f501a/users/5408d589455c4216aad1dc395d10d32e/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.224980 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6f74c-0f0f-49a4-a882-4c7b8a9a7d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0416aaacbc6b4714a103e80d1b0f501a, user_id=5408d589455c4216aad1dc395d10d32e, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:05.227751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6f74c-0f0f-49a4-a882-4c7b8a9a7d77 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:05.255416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1053/2108] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:04 2022] POST /identity/v3/users => generated 299 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:38:05.255416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e02ab-ed43-4928-9441-723e95b8ff0a admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:05.255416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9c3e02ab-ed43-4928-9441-723e95b8ff0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:05.261688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:05.267920 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e02ab-ed43-4928-9441-723e95b8ff0a admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.272706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63ff6e-44de-4e31-81a2-31106f8ac6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:05.273371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63ff6e-44de-4e31-81a2-31106f8ac6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.273652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63ff6e-44de-4e31-81a2-31106f8ac6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.273931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63ff6e-44de-4e31-81a2-31106f8ac6d6 admin admin] PATH_INFO: `/v3/users/8abacc0ec8cc4931b02c4bf37d445a0d` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.275165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63ff6e-44de-4e31-81a2-31106f8ac6d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8abacc0ec8cc4931b02c4bf37d445a0d)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:05.277125 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63ff6e-44de-4e31-81a2-31106f8ac6d6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:05.314146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1056/2109] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:05 2022] PUT /identity/v3/projects/0416aaacbc6b4714a103e80d1b0f501a/users/5408d589455c4216aad1dc395d10d32e/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:05.317455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6f74c-0f0f-49a4-a882-4c7b8a9a7d77 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:05.390191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6f74c-0f0f-49a4-a882-4c7b8a9a7d77 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.394982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c0989-5393-4190-bb20-c7ae61538af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:05.395640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c0989-5393-4190-bb20-c7ae61538af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.395930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c0989-5393-4190-bb20-c7ae61538af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.396208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c0989-5393-4190-bb20-c7ae61538af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.396919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c0989-5393-4190-bb20-c7ae61538af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:05.398537 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c0989-5393-4190-bb20-c7ae61538af7 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:05.408973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1057/2110] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:05.409854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c0989-5393-4190-bb20-c7ae61538af7 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:05.419322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c0989-5393-4190-bb20-c7ae61538af7 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.424236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba71c7-724a-4bab-a3a7-d7792d4af9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:05.424826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba71c7-724a-4bab-a3a7-d7792d4af9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.425112 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba71c7-724a-4bab-a3a7-d7792d4af9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.425388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba71c7-724a-4bab-a3a7-d7792d4af9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.426069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba71c7-724a-4bab-a3a7-d7792d4af9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:05.427704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba71c7-724a-4bab-a3a7-d7792d4af9ef admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:05.438061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1058/2111] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:05.438912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba71c7-724a-4bab-a3a7-d7792d4af9ef admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:05.448070 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba71c7-724a-4bab-a3a7-d7792d4af9ef admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.453631 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff84a7-4c64-4b29-b4a9-f9aa7b048e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:05.454248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff84a7-4c64-4b29-b4a9-f9aa7b048e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.454665 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff84a7-4c64-4b29-b4a9-f9aa7b048e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.458538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff84a7-4c64-4b29-b4a9-f9aa7b048e55 admin admin] PATH_INFO: `/v3/projects/39b54b6c18e94d94ada702c6ad44efa6/users/af3d153be2f84e9488accb53e06dc553/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.469696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff84a7-4c64-4b29-b4a9-f9aa7b048e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b54b6c18e94d94ada702c6ad44efa6, user_id=af3d153be2f84e9488accb53e06dc553, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:05.472374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff84a7-4c64-4b29-b4a9-f9aa7b048e55 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:05.496814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:05.510025 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-ae63ff6e-44de-4e31-81a2-31106f8ac6d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8abacc0ec8cc4931b02c4bf37d445a0d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:05.522664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-ae63ff6e-44de-4e31-81a2-31106f8ac6d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8abacc0ec8cc4931b02c4bf37d445a0d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:05.523408 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-ae63ff6e-44de-4e31-81a2-31106f8ac6d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8abacc0ec8cc4931b02c4bf37d445a0d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:05.531871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-ae63ff6e-44de-4e31-81a2-31106f8ac6d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8abacc0ec8cc4931b02c4bf37d445a0d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:05.593946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1059/2112] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:05 2022] PUT /identity/v3/projects/39b54b6c18e94d94ada702c6ad44efa6/users/af3d153be2f84e9488accb53e06dc553/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:05.594784 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff84a7-4c64-4b29-b4a9-f9aa7b048e55 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:05.596378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c1ff84a7-4c64-4b29-b4a9-f9aa7b048e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:05.657963 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff84a7-4c64-4b29-b4a9-f9aa7b048e55 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.662658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c211722-0975-4989-a439-3f26260d7a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:05.663319 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c211722-0975-4989-a439-3f26260d7a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.663602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c211722-0975-4989-a439-3f26260d7a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.663881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c211722-0975-4989-a439-3f26260d7a15 admin admin] PATH_INFO: `/v3/projects/0416aaacbc6b4714a103e80d1b0f501a/users/5408d589455c4216aad1dc395d10d32e/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.665854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c211722-0975-4989-a439-3f26260d7a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0416aaacbc6b4714a103e80d1b0f501a, user_id=5408d589455c4216aad1dc395d10d32e, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:05.668551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c211722-0975-4989-a439-3f26260d7a15 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:05.679230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1060/2113] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:05 2022] PUT /identity/v3/projects/0416aaacbc6b4714a103e80d1b0f501a/users/5408d589455c4216aad1dc395d10d32e/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:05.679375 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-ae63ff6e-44de-4e31-81a2-31106f8ac6d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8abacc0ec8cc4931b02c4bf37d445a0d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:05.680017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c211722-0975-4989-a439-3f26260d7a15 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:05.681657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-3c211722-0975-4989-a439-3f26260d7a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:05.694063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1054/2114] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:05 2022] DELETE /identity/v3/users/8abacc0ec8cc4931b02c4bf37d445a0d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:05.695733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7422a4d-92e6-4f59-b613-bdf9865d625b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.696137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7422a4d-92e6-4f59-b613-bdf9865d625b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.696528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7422a4d-92e6-4f59-b613-bdf9865d625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.729607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-a7422a4d-92e6-4f59-b613-bdf9865d625b None None] MFA Rules not processed for user `5408d589455c4216aad1dc395d10d32e`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:05.731092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a7422a4d-92e6-4f59-b613-bdf9865d625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:05.756156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c211722-0975-4989-a439-3f26260d7a15 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.811784 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:05.818861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cd640-a577-432b-9775-74f49e25fb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:05.819419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cd640-a577-432b-9775-74f49e25fb91 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.819709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cd640-a577-432b-9775-74f49e25fb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.819986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cd640-a577-432b-9775-74f49e25fb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.820685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cd640-a577-432b-9775-74f49e25fb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:05.822283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cd640-a577-432b-9775-74f49e25fb91 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:05.828541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1055/2115] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:05.833019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52d43a-46a7-4879-af13-77d0a38be582 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.833019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52d43a-46a7-4879-af13-77d0a38be582 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.833019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52d43a-46a7-4879-af13-77d0a38be582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.836547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1061/2116] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:05.842877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cd640-a577-432b-9775-74f49e25fb91 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:05.853933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-cb52d43a-46a7-4879-af13-77d0a38be582 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:05.854325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cd640-a577-432b-9775-74f49e25fb91 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.855196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cb52d43a-46a7-4879-af13-77d0a38be582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:05.859629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b040d0-4785-4188-9859-0ec6309c3666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:05.874860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b040d0-4785-4188-9859-0ec6309c3666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.874860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b040d0-4785-4188-9859-0ec6309c3666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.874860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b040d0-4785-4188-9859-0ec6309c3666 admin admin] PATH_INFO: `/v3/projects/39b54b6c18e94d94ada702c6ad44efa6/users/af3d153be2f84e9488accb53e06dc553/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:05.874860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b040d0-4785-4188-9859-0ec6309c3666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b54b6c18e94d94ada702c6ad44efa6, user_id=af3d153be2f84e9488accb53e06dc553, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:05.874860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b040d0-4785-4188-9859-0ec6309c3666 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:05.875270 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1056/2117] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:05.875270 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52d43a-46a7-4879-af13-77d0a38be582 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:05.875270 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cb52d43a-46a7-4879-af13-77d0a38be582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:05.883795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1062/2118] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:05 2022] PUT /identity/v3/projects/39b54b6c18e94d94ada702c6ad44efa6/users/af3d153be2f84e9488accb53e06dc553/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:05.887264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b040d0-4785-4188-9859-0ec6309c3666 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:05.889571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-27b040d0-4785-4188-9859-0ec6309c3666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:05.951447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52d43a-46a7-4879-af13-77d0a38be582 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.956225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:05.958795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b040d0-4785-4188-9859-0ec6309c3666 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:05.962568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13531a-7653-4981-9ffa-0233db98d19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:05.963293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13531a-7653-4981-9ffa-0233db98d19f service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:05.963702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13531a-7653-4981-9ffa-0233db98d19f service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:05.964061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13531a-7653-4981-9ffa-0233db98d19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:06.001544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962a0a9-fe3f-4b4e-bd67-ea25cef673f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:06.002197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962a0a9-fe3f-4b4e-bd67-ea25cef673f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:06.002479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962a0a9-fe3f-4b4e-bd67-ea25cef673f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:06.002784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962a0a9-fe3f-4b4e-bd67-ea25cef673f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:06.004574 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0962a0a9-fe3f-4b4e-bd67-ea25cef673f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:06.027080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13531a-7653-4981-9ffa-0233db98d19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:06.029194 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13531a-7653-4981-9ffa-0233db98d19f service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:06.039581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1063/2119] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:38:06.041028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7956ac-b288-4672-becd-f95c3da73d72 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:06.041468 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7956ac-b288-4672-becd-f95c3da73d72 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:06.041893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7956ac-b288-4672-becd-f95c3da73d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:06.067846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962a0a9-fe3f-4b4e-bd67-ea25cef673f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:06.069464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962a0a9-fe3f-4b4e-bd67-ea25cef673f1 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:06.074526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-da7956ac-b288-4672-becd-f95c3da73d72 None None] MFA Rules not processed for user `af3d153be2f84e9488accb53e06dc553`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:06.075600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-da7956ac-b288-4672-becd-f95c3da73d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:06.080171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1057/2120] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:06.164525 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1064/2121] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:06.500569 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962a0a9-fe3f-4b4e-bd67-ea25cef673f1 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:06.503558 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0962a0a9-fe3f-4b4e-bd67-ea25cef673f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:06.535361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962a0a9-fe3f-4b4e-bd67-ea25cef673f1 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:06.542305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da0626-a825-47fa-a8e5-4d716d8937f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:06.543163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da0626-a825-47fa-a8e5-4d716d8937f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:06.543566 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da0626-a825-47fa-a8e5-4d716d8937f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:06.543952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da0626-a825-47fa-a8e5-4d716d8937f8 admin admin] PATH_INFO: `/v3/projects/220c954b2cff4f86abc2ba09c9e33326` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:06.545858 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da0626-a825-47fa-a8e5-4d716d8937f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=220c954b2cff4f86abc2ba09c9e33326)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:06.548507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da0626-a825-47fa-a8e5-4d716d8937f8 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:06.553641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7956ac-b288-4672-becd-f95c3da73d72 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:06.555244 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-da7956ac-b288-4672-becd-f95c3da73d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:06.569729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7956ac-b288-4672-becd-f95c3da73d72 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:06.572920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b337a4-a12f-4878-bb3f-d12414143c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:06.573618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b337a4-a12f-4878-bb3f-d12414143c90 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:06.573904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b337a4-a12f-4878-bb3f-d12414143c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:06.574183 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b337a4-a12f-4878-bb3f-d12414143c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:06.584901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b337a4-a12f-4878-bb3f-d12414143c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:06.586364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b337a4-a12f-4878-bb3f-d12414143c90 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:06.592275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:06.597572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1065/2122] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:38:06.627810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b337a4-a12f-4878-bb3f-d12414143c90 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:06.639292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b337a4-a12f-4878-bb3f-d12414143c90 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:06.645850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27d845-b50e-4b5a-8c0e-54021a47a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:06.645850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27d845-b50e-4b5a-8c0e-54021a47a78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:06.663403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27d845-b50e-4b5a-8c0e-54021a47a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:06.663403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27d845-b50e-4b5a-8c0e-54021a47a78e admin admin] PATH_INFO: `/v3/users/a4ebb6ea12234e3cab69004072861a0b` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:06.663403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27d845-b50e-4b5a-8c0e-54021a47a78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ebb6ea12234e3cab69004072861a0b)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:06.663403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27d845-b50e-4b5a-8c0e-54021a47a78e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:06.697923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f0da0626-a825-47fa-a8e5-4d716d8937f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220c954b2cff4f86abc2ba09c9e33326', 'request_id': 'req-f0da0626-a825-47fa-a8e5-4d716d8937f8'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:06.704795 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f0da0626-a825-47fa-a8e5-4d716d8937f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220c954b2cff4f86abc2ba09c9e33326', 'request_id': 'req-f0da0626-a825-47fa-a8e5-4d716d8937f8'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:06.839553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f0da0626-a825-47fa-a8e5-4d716d8937f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220c954b2cff4f86abc2ba09c9e33326', 'request_id': 'req-f0da0626-a825-47fa-a8e5-4d716d8937f8'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:06.852209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f0da0626-a825-47fa-a8e5-4d716d8937f8 admin admin] The token cache is being invalidate because project 220c954b2cff4f86abc2ba09c9e33326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:06.852499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f0da0626-a825-47fa-a8e5-4d716d8937f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:06.853180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f0da0626-a825-47fa-a8e5-4d716d8937f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:06.854749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1058/2123] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:06 2022] DELETE /identity/v3/projects/220c954b2cff4f86abc2ba09c9e33326 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:06.859441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46c837-d764-4757-ab0c-d23c6304eb73 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:06.859729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46c837-d764-4757-ab0c-d23c6304eb73 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:06.860008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46c837-d764-4757-ab0c-d23c6304eb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:06.880203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-1f46c837-d764-4757-ab0c-d23c6304eb73 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:06.884081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1f46c837-d764-4757-ab0c-d23c6304eb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:06.893852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4a27d845-b50e-4b5a-8c0e-54021a47a78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ebb6ea12234e3cab69004072861a0b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:06.931824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:06.951513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1059/2124] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:06.960697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf2161-9f12-492d-94dc-41fd8124b4d0 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:06.960989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf2161-9f12-492d-94dc-41fd8124b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:06.961273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf2161-9f12-492d-94dc-41fd8124b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:06.977818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4a27d845-b50e-4b5a-8c0e-54021a47a78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ebb6ea12234e3cab69004072861a0b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:06.981049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-9baf2161-9f12-492d-94dc-41fd8124b4d0 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:06.982340 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9baf2161-9f12-492d-94dc-41fd8124b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:06.987227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4a27d845-b50e-4b5a-8c0e-54021a47a78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ebb6ea12234e3cab69004072861a0b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:06.987227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4a27d845-b50e-4b5a-8c0e-54021a47a78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ebb6ea12234e3cab69004072861a0b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:06.987845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4a27d845-b50e-4b5a-8c0e-54021a47a78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ebb6ea12234e3cab69004072861a0b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:06.990592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1060/2125] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:06.994968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf2161-9f12-492d-94dc-41fd8124b4d0 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:07.004916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf2161-9f12-492d-94dc-41fd8124b4d0 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:07.008399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1066/2126] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:06 2022] DELETE /identity/v3/users/a4ebb6ea12234e3cab69004072861a0b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:07.010045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e010ab-58d4-4fd0-b30e-be0ad8383ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:07.011666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e010ab-58d4-4fd0-b30e-be0ad8383ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:07.011666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e010ab-58d4-4fd0-b30e-be0ad8383ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:07.011666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e010ab-58d4-4fd0-b30e-be0ad8383ad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:07.012005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e010ab-58d4-4fd0-b30e-be0ad8383ad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:07.012399 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e010ab-58d4-4fd0-b30e-be0ad8383ad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:07.014720 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e010ab-58d4-4fd0-b30e-be0ad8383ad4 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:07.015784 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7158b-7df2-4b24-952b-8b161a811326 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:07.016169 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7158b-7df2-4b24-952b-8b161a811326 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:07.016549 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7158b-7df2-4b24-952b-8b161a811326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:07.028722 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1061/2127] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:38:07.037057 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e010ab-58d4-4fd0-b30e-be0ad8383ad4 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:07.039023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-4db7158b-7df2-4b24-952b-8b161a811326 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:07.039743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-53e010ab-58d4-4fd0-b30e-be0ad8383ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:07.040435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4db7158b-7df2-4b24-952b-8b161a811326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:07.055339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e010ab-58d4-4fd0-b30e-be0ad8383ad4 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:07.112508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1067/2128] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:07.125964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3776709-ce18-47d3-bbbd-a6f4cdd2ee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:07.126635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3776709-ce18-47d3-bbbd-a6f4cdd2ee46 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:07.127115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3776709-ce18-47d3-bbbd-a6f4cdd2ee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:07.127399 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3776709-ce18-47d3-bbbd-a6f4cdd2ee46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:07.127929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7158b-7df2-4b24-952b-8b161a811326 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:07.128078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3776709-ce18-47d3-bbbd-a6f4cdd2ee46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:07.129388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4db7158b-7df2-4b24-952b-8b161a811326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:07.130058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3776709-ce18-47d3-bbbd-a6f4cdd2ee46 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:07.190590 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7158b-7df2-4b24-952b-8b161a811326 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:07.194227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c1840-ef03-47e8-bcd2-f1204b00c43d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:07.194876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c1840-ef03-47e8-bcd2-f1204b00c43d service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:07.195156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c1840-ef03-47e8-bcd2-f1204b00c43d service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:07.195456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c1840-ef03-47e8-bcd2-f1204b00c43d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:07.205408 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c1840-ef03-47e8-bcd2-f1204b00c43d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:07.206883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c1840-ef03-47e8-bcd2-f1204b00c43d service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:07.216327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1068/2129] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:38:07.247759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1062/2130] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:07 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:38:07.252184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c1840-ef03-47e8-bcd2-f1204b00c43d service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:07.262057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c1840-ef03-47e8-bcd2-f1204b00c43d service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:07.275834 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:07.335874 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d28348-3387-4145-8858-8e2526ac0e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:07.336512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d28348-3387-4145-8858-8e2526ac0e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:07.336801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d28348-3387-4145-8858-8e2526ac0e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:07.337078 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d28348-3387-4145-8858-8e2526ac0e3a admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:07.337774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d28348-3387-4145-8858-8e2526ac0e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:07.339742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d28348-3387-4145-8858-8e2526ac0e3a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:07.424426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1069/2131] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:07 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:07.428426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3776709-ce18-47d3-bbbd-a6f4cdd2ee46 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:07.442105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3776709-ce18-47d3-bbbd-a6f4cdd2ee46 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:07.449342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394411-6159-493a-9139-94b48d57d55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:07.450683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394411-6159-493a-9139-94b48d57d55b admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:07.450683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394411-6159-493a-9139-94b48d57d55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:07.463210 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394411-6159-493a-9139-94b48d57d55b admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:07.463210 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea394411-6159-493a-9139-94b48d57d55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:07.463210 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea394411-6159-493a-9139-94b48d57d55b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:07.464701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1063/2132] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:07.469252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d28348-3387-4145-8858-8e2526ac0e3a admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:07.479250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d28348-3387-4145-8858-8e2526ac0e3a admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:07.486220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7706532-3048-452c-80ef-367a973663b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:07.486875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7706532-3048-452c-80ef-367a973663b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:07.487158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7706532-3048-452c-80ef-367a973663b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:07.488065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7706532-3048-452c-80ef-367a973663b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:07.488813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7706532-3048-452c-80ef-367a973663b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:07.497741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7706532-3048-452c-80ef-367a973663b8 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:07.505125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1070/2133] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:07.506024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394411-6159-493a-9139-94b48d57d55b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:07.516605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394411-6159-493a-9139-94b48d57d55b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:07.521957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b0db-0f58-4aca-b0ac-cda2ba208427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:07.522695 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b0db-0f58-4aca-b0ac-cda2ba208427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:07.522982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b0db-0f58-4aca-b0ac-cda2ba208427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:07.523261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b0db-0f58-4aca-b0ac-cda2ba208427 admin admin] PATH_INFO: `/v3/projects/1be664f3b7f144268f3e4e4835f16cdc/users/8670ec72824549f28b6530a758cbbb01/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:07.542446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7b0db-0f58-4aca-b0ac-cda2ba208427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be664f3b7f144268f3e4e4835f16cdc, user_id=8670ec72824549f28b6530a758cbbb01, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:07.546304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7b0db-0f58-4aca-b0ac-cda2ba208427 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:07.652331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1064/2134] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:07 2022] PUT /identity/v3/projects/1be664f3b7f144268f3e4e4835f16cdc/users/8670ec72824549f28b6530a758cbbb01/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:07.657988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8006-4540-4b98-95d5-dc8c0030fd15 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:07.658284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8006-4540-4b98-95d5-dc8c0030fd15 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:07.658624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee8006-4540-4b98-95d5-dc8c0030fd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:07.677463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9cee8006-4540-4b98-95d5-dc8c0030fd15 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:07.678712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9cee8006-4540-4b98-95d5-dc8c0030fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:07.699499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b0db-0f58-4aca-b0ac-cda2ba208427 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:07.702316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-09f7b0db-0f58-4aca-b0ac-cda2ba208427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:07.774982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1071/2135] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:07.783241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee8006-4540-4b98-95d5-dc8c0030fd15 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:07.784721 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9cee8006-4540-4b98-95d5-dc8c0030fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:07.790867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b0db-0f58-4aca-b0ac-cda2ba208427 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:07.798476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:07.799349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:07.799953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:07.800421 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] PATH_INFO: `/v3/projects/53a68941f592479a88e4543651340c73` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:07.801612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a68941f592479a88e4543651340c73)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:07.803576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:07.829744 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:07.848655 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee8006-4540-4b98-95d5-dc8c0030fd15 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:07.852455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eebfd0-043e-45da-94ac-8f02c310f8c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:07.853099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eebfd0-043e-45da-94ac-8f02c310f8c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:07.853379 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eebfd0-043e-45da-94ac-8f02c310f8c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:07.853652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eebfd0-043e-45da-94ac-8f02c310f8c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:07.863090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eebfd0-043e-45da-94ac-8f02c310f8c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:07.864519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eebfd0-043e-45da-94ac-8f02c310f8c5 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:07.874705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1072/2136] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:38:07.951003 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a68941f592479a88e4543651340c73', 'request_id': 'req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:07.958834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a68941f592479a88e4543651340c73', 'request_id': 'req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:08.048130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a68941f592479a88e4543651340c73', 'request_id': 'req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:08.066124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] The token cache is being invalidate because project 53a68941f592479a88e4543651340c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:08.070553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:08.070553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:08.070553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1065/2137] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:07 2022] DELETE /identity/v3/projects/53a68941f592479a88e4543651340c73 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:08.077006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eebfd0-043e-45da-94ac-8f02c310f8c5 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:08.087283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eebfd0-043e-45da-94ac-8f02c310f8c5 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:08.127530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:08.160501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84998982-85ca-4d53-addc-33b2e1a4ebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:08.161354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84998982-85ca-4d53-addc-33b2e1a4ebe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:08.161979 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84998982-85ca-4d53-addc-33b2e1a4ebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:08.162161 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84998982-85ca-4d53-addc-33b2e1a4ebe6 admin admin] PATH_INFO: `/v3/users/af3d153be2f84e9488accb53e06dc553` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:08.163692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84998982-85ca-4d53-addc-33b2e1a4ebe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3d153be2f84e9488accb53e06dc553)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:08.166644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84998982-85ca-4d53-addc-33b2e1a4ebe6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:08.419449 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-84998982-85ca-4d53-addc-33b2e1a4ebe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3d153be2f84e9488accb53e06dc553'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:08.502976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-84998982-85ca-4d53-addc-33b2e1a4ebe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3d153be2f84e9488accb53e06dc553'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:08.514177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-84998982-85ca-4d53-addc-33b2e1a4ebe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3d153be2f84e9488accb53e06dc553'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:08.515222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-84998982-85ca-4d53-addc-33b2e1a4ebe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3d153be2f84e9488accb53e06dc553'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:08.516143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-84998982-85ca-4d53-addc-33b2e1a4ebe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3d153be2f84e9488accb53e06dc553'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:08.552888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1073/2138] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:08 2022] DELETE /identity/v3/users/af3d153be2f84e9488accb53e06dc553 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:09.202178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:09.203962 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:09.221263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83ed2b-6b03-4bd7-b549-364c3244e8c7 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:09.284839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:09.285485 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:09.285772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:09.286053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8 admin admin] PATH_INFO: `/v3/projects/39b54b6c18e94d94ada702c6ad44efa6` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:09.287260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b54b6c18e94d94ada702c6ad44efa6)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:09.289178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:09.460561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c7899-2d1b-474c-aebf-fda98247f56f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:09.461499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c7899-2d1b-474c-aebf-fda98247f56f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:09.461819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c7899-2d1b-474c-aebf-fda98247f56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:09.500228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b54b6c18e94d94ada702c6ad44efa6', 'request_id': 'req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:09.513364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b54b6c18e94d94ada702c6ad44efa6', 'request_id': 'req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:09.518635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-340c7899-2d1b-474c-aebf-fda98247f56f None None] MFA Rules not processed for user `8670ec72824549f28b6530a758cbbb01`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:09.520157 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-340c7899-2d1b-474c-aebf-fda98247f56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:09.587653 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1074/2139] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:09.598529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c7899-2d1b-474c-aebf-fda98247f56f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:09.599953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-340c7899-2d1b-474c-aebf-fda98247f56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:09.623406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b54b6c18e94d94ada702c6ad44efa6', 'request_id': 'req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:09.636888 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8 admin admin] The token cache is being invalidate because project 39b54b6c18e94d94ada702c6ad44efa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:09.637181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:09.638145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-839e4739-ee8e-4a5c-a4cc-ebf15d4ac3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:09.639797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1066/2140] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:09 2022] DELETE /identity/v3/projects/39b54b6c18e94d94ada702c6ad44efa6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:09.645635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fbbab-abdc-4a73-aeda-24264b10e2f9 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:09.645635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fbbab-abdc-4a73-aeda-24264b10e2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:09.645635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fbbab-abdc-4a73-aeda-24264b10e2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:09.654091 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:09.659196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c7899-2d1b-474c-aebf-fda98247f56f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:09.663102 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4588f8-0952-43ee-bdc4-348f905f45a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:09.663692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4588f8-0952-43ee-bdc4-348f905f45a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:09.663978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4588f8-0952-43ee-bdc4-348f905f45a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:09.664253 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4588f8-0952-43ee-bdc4-348f905f45a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:09.665702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-d90fbbab-abdc-4a73-aeda-24264b10e2f9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:09.666071 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2a4588f8-0952-43ee-bdc4-348f905f45a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:09.666926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d90fbbab-abdc-4a73-aeda-24264b10e2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:09.677566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4588f8-0952-43ee-bdc4-348f905f45a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:09.679095 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4588f8-0952-43ee-bdc4-348f905f45a7 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:09.689299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1075/2141] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:38:09.703944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:09.734529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1067/2142] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:09.739987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915b1c7-2386-4525-bd46-28de4e5074ab None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:09.740299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915b1c7-2386-4525-bd46-28de4e5074ab None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:09.740578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915b1c7-2386-4525-bd46-28de4e5074ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:09.760672 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b915b1c7-2386-4525-bd46-28de4e5074ab None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:09.761872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b915b1c7-2386-4525-bd46-28de4e5074ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:09.770580 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1076/2143] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:09.774467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fbbab-abdc-4a73-aeda-24264b10e2f9 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:09.784671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fbbab-abdc-4a73-aeda-24264b10e2f9 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:09.790036 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824cffa-5812-4982-af52-51a95f4239ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:09.790687 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824cffa-5812-4982-af52-51a95f4239ee admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:09.790974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824cffa-5812-4982-af52-51a95f4239ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:09.791257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824cffa-5812-4982-af52-51a95f4239ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:09.791955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824cffa-5812-4982-af52-51a95f4239ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:09.792261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824cffa-5812-4982-af52-51a95f4239ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:09.794424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824cffa-5812-4982-af52-51a95f4239ee admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:09.810122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1068/2144] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:38:09.811805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915b1c7-2386-4525-bd46-28de4e5074ab None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:09.821446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915b1c7-2386-4525-bd46-28de4e5074ab None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:09.826354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce04998-1726-4f6d-bc43-4e05f8b494f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:09.827035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce04998-1726-4f6d-bc43-4e05f8b494f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:09.827322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce04998-1726-4f6d-bc43-4e05f8b494f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:09.827729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce04998-1726-4f6d-bc43-4e05f8b494f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:09.828266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce04998-1726-4f6d-bc43-4e05f8b494f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:09.830210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce04998-1726-4f6d-bc43-4e05f8b494f1 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:09.924623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1077/2145] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:09 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:38:09.928105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824cffa-5812-4982-af52-51a95f4239ee admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:09.939237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824cffa-5812-4982-af52-51a95f4239ee admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:10.016865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b427ec-4094-4bbd-a416-6c62f7ba1f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:10.016865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b427ec-4094-4bbd-a416-6c62f7ba1f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:10.016865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b427ec-4094-4bbd-a416-6c62f7ba1f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:10.016865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b427ec-4094-4bbd-a416-6c62f7ba1f37 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:10.017512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b427ec-4094-4bbd-a416-6c62f7ba1f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:10.018453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b427ec-4094-4bbd-a416-6c62f7ba1f37 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:10.126034 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1069/2146] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:09 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:10.130471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce04998-1726-4f6d-bc43-4e05f8b494f1 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:10.140839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce04998-1726-4f6d-bc43-4e05f8b494f1 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:10.145349 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d17f9-9750-483c-a0ec-ba95f34f601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:10.145940 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d17f9-9750-483c-a0ec-ba95f34f601e admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:10.146220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d17f9-9750-483c-a0ec-ba95f34f601e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:10.146508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d17f9-9750-483c-a0ec-ba95f34f601e admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:10.147234 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d17f9-9750-483c-a0ec-ba95f34f601e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:10.148821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d17f9-9750-483c-a0ec-ba95f34f601e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:10.159630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1078/2147] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:10.163663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b427ec-4094-4bbd-a416-6c62f7ba1f37 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:10.174200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b427ec-4094-4bbd-a416-6c62f7ba1f37 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:10.178882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec583d-b55b-4e76-92d5-acaf4593fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:10.179491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec583d-b55b-4e76-92d5-acaf4593fbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:10.179784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec583d-b55b-4e76-92d5-acaf4593fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:10.180066 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec583d-b55b-4e76-92d5-acaf4593fbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:10.181261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec583d-b55b-4e76-92d5-acaf4593fbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:10.189932 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec583d-b55b-4e76-92d5-acaf4593fbe4 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:10.204365 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1070/2148] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:10.208835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d17f9-9750-483c-a0ec-ba95f34f601e admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:10.219859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d17f9-9750-483c-a0ec-ba95f34f601e admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:10.224811 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64476a45-a4c5-4852-8e90-21ebbe0fd56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:10.225478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64476a45-a4c5-4852-8e90-21ebbe0fd56c admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:10.225764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64476a45-a4c5-4852-8e90-21ebbe0fd56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:10.226043 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64476a45-a4c5-4852-8e90-21ebbe0fd56c admin admin] PATH_INFO: `/v3/projects/a114f5ca48924737a143c2ed97982492/users/84cc4af632e7413ea617fc16a7de3a81/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:10.241101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64476a45-a4c5-4852-8e90-21ebbe0fd56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a114f5ca48924737a143c2ed97982492, user_id=84cc4af632e7413ea617fc16a7de3a81, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:10.243891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64476a45-a4c5-4852-8e90-21ebbe0fd56c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:10.324727 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1079/2149] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:10 2022] PUT /identity/v3/projects/a114f5ca48924737a143c2ed97982492/users/84cc4af632e7413ea617fc16a7de3a81/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:10.341757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb3eaa-f44a-4bf4-b68c-c6ddc9988832 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:10.342043 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb3eaa-f44a-4bf4-b68c-c6ddc9988832 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:10.342392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb3eaa-f44a-4bf4-b68c-c6ddc9988832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:10.372485 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-84cb3eaa-f44a-4bf4-b68c-c6ddc9988832 None None] MFA Rules not processed for user `84cc4af632e7413ea617fc16a7de3a81`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:10.373742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-84cb3eaa-f44a-4bf4-b68c-c6ddc9988832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:10.453294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1071/2150] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:10.453931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64476a45-a4c5-4852-8e90-21ebbe0fd56c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:10.517297 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64476a45-a4c5-4852-8e90-21ebbe0fd56c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:10.522673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21712697-2ab4-468a-8527-0f365e434b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:10.523303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21712697-2ab4-468a-8527-0f365e434b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:10.523593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21712697-2ab4-468a-8527-0f365e434b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:10.523868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21712697-2ab4-468a-8527-0f365e434b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:10.524541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21712697-2ab4-468a-8527-0f365e434b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:10.526514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21712697-2ab4-468a-8527-0f365e434b93 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:10.641739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1080/2151] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:10 2022] POST /identity/v3/projects => generated 361 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:10.645948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb3eaa-f44a-4bf4-b68c-c6ddc9988832 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:10.657017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb3eaa-f44a-4bf4-b68c-c6ddc9988832 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:10.733943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7454bc-7ce9-4649-8acf-2a39ada88325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:10.738165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7454bc-7ce9-4649-8acf-2a39ada88325 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:10.738165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7454bc-7ce9-4649-8acf-2a39ada88325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:10.738165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7454bc-7ce9-4649-8acf-2a39ada88325 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:10.738165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7454bc-7ce9-4649-8acf-2a39ada88325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:10.738165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7454bc-7ce9-4649-8acf-2a39ada88325 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:10.832069 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1072/2152] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:10 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:10.836110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21712697-2ab4-468a-8527-0f365e434b93 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:10.855548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21712697-2ab4-468a-8527-0f365e434b93 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:10.864018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6482b-4a75-40f6-a726-f67aece1e8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:10.864884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6482b-4a75-40f6-a726-f67aece1e8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:10.865237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6482b-4a75-40f6-a726-f67aece1e8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:10.866194 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6482b-4a75-40f6-a726-f67aece1e8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:10.867089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6482b-4a75-40f6-a726-f67aece1e8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:10.868872 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6482b-4a75-40f6-a726-f67aece1e8a5 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:10.892274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7454bc-7ce9-4649-8acf-2a39ada88325 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:10.906083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1081/2153] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:10.906299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7454bc-7ce9-4649-8acf-2a39ada88325 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:10.911664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352ab13-155a-4d9d-8920-8626701c30ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:10.912371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ab13-155a-4d9d-8920-8626701c30ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:10.912697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ab13-155a-4d9d-8920-8626701c30ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:10.913013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ab13-155a-4d9d-8920-8626701c30ce admin admin] PATH_INFO: `/v3/projects/6579ad886e19434db60ce8d5b86fc06d/users/4371b5eae6ec477d87314a4949fa4457/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:10.932823 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352ab13-155a-4d9d-8920-8626701c30ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ad886e19434db60ce8d5b86fc06d, user_id=4371b5eae6ec477d87314a4949fa4457, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:10.936483 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352ab13-155a-4d9d-8920-8626701c30ce admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:11.026809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1073/2154] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:10 2022] PUT /identity/v3/projects/6579ad886e19434db60ce8d5b86fc06d/users/4371b5eae6ec477d87314a4949fa4457/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:11.028294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6482b-4a75-40f6-a726-f67aece1e8a5 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:11.040540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6482b-4a75-40f6-a726-f67aece1e8a5 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:11.110392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f7506-2fa0-4098-90e6-9e3f2f65be6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:11.111053 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7506-2fa0-4098-90e6-9e3f2f65be6c admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:11.111941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7506-2fa0-4098-90e6-9e3f2f65be6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:11.112211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7506-2fa0-4098-90e6-9e3f2f65be6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:11.112972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f7506-2fa0-4098-90e6-9e3f2f65be6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:11.115208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f7506-2fa0-4098-90e6-9e3f2f65be6c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:11.126641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1082/2155] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:11.131315 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352ab13-155a-4d9d-8920-8626701c30ce admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:11.143929 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352ab13-155a-4d9d-8920-8626701c30ce admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:11.148898 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0ab8-41d5-4348-a962-81fec9fd36f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:11.149561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0ab8-41d5-4348-a962-81fec9fd36f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:11.149869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0ab8-41d5-4348-a962-81fec9fd36f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:11.152883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0ab8-41d5-4348-a962-81fec9fd36f6 admin admin] PATH_INFO: `/v3/projects/6579ad886e19434db60ce8d5b86fc06d/users/4371b5eae6ec477d87314a4949fa4457/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:11.152883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c0ab8-41d5-4348-a962-81fec9fd36f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6579ad886e19434db60ce8d5b86fc06d, user_id=4371b5eae6ec477d87314a4949fa4457, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:11.155167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c0ab8-41d5-4348-a962-81fec9fd36f6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:11.166447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1074/2156] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:11 2022] PUT /identity/v3/projects/6579ad886e19434db60ce8d5b86fc06d/users/4371b5eae6ec477d87314a4949fa4457/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:11.184106 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6137aeb-7c38-4b99-924b-ca0f5ee07f04 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:11.185268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6137aeb-7c38-4b99-924b-ca0f5ee07f04 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:11.185661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6137aeb-7c38-4b99-924b-ca0f5ee07f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:11.216080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e6137aeb-7c38-4b99-924b-ca0f5ee07f04 None None] MFA Rules not processed for user `4371b5eae6ec477d87314a4949fa4457`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:11.217223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e6137aeb-7c38-4b99-924b-ca0f5ee07f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:11.289081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1083/2157] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:11.301516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0ab8-41d5-4348-a962-81fec9fd36f6 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:11.303366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1e6c0ab8-41d5-4348-a962-81fec9fd36f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:11.343393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:11.362430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0ab8-41d5-4348-a962-81fec9fd36f6 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:11.366116 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c169-c6f0-4612-933e-c36b4da7500b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:11.366753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c169-c6f0-4612-933e-c36b4da7500b service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:11.367034 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c169-c6f0-4612-933e-c36b4da7500b service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:11.367305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c169-c6f0-4612-933e-c36b4da7500b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:11.376834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c169-c6f0-4612-933e-c36b4da7500b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:11.378306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c169-c6f0-4612-933e-c36b4da7500b service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:11.388295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1075/2158] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:11.428027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:11.671456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6137aeb-7c38-4b99-924b-ca0f5ee07f04 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:11.680940 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6137aeb-7c38-4b99-924b-ca0f5ee07f04 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:11.685183 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f2648-b969-4098-83a3-40e6e30e8684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:11.685891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f2648-b969-4098-83a3-40e6e30e8684 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:11.686175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f2648-b969-4098-83a3-40e6e30e8684 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:11.687411 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f2648-b969-4098-83a3-40e6e30e8684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:11.743957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f2648-b969-4098-83a3-40e6e30e8684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:11.745408 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f2648-b969-4098-83a3-40e6e30e8684 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:11.755282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1084/2159] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:11.814278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11111-59b3-4753-bcb6-ac27a06b56e3 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:11.814933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11111-59b3-4753-bcb6-ac27a06b56e3 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:11.815224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11111-59b3-4753-bcb6-ac27a06b56e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:11.836175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-7bf11111-59b3-4753-bcb6-ac27a06b56e3 None None] MFA Rules not processed for user `8670ec72824549f28b6530a758cbbb01`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:11.837544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7bf11111-59b3-4753-bcb6-ac27a06b56e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:11.910131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1076/2160] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:11.990423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f2648-b969-4098-83a3-40e6e30e8684 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:11.991915 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-617f2648-b969-4098-83a3-40e6e30e8684 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:12.005383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f2648-b969-4098-83a3-40e6e30e8684 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:12.009264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb4eb7-d22b-4f2d-8213-482f0e31df88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:12.009884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb4eb7-d22b-4f2d-8213-482f0e31df88 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:12.010198 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb4eb7-d22b-4f2d-8213-482f0e31df88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:12.011173 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb4eb7-d22b-4f2d-8213-482f0e31df88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:12.013809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e3fb4eb7-d22b-4f2d-8213-482f0e31df88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:12.084623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb4eb7-d22b-4f2d-8213-482f0e31df88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:12.086158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb4eb7-d22b-4f2d-8213-482f0e31df88 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:12.097196 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1085/2161] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:14.786515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11111-59b3-4753-bcb6-ac27a06b56e3 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:14.787949 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7bf11111-59b3-4753-bcb6-ac27a06b56e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:14.825990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:14.861046 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11111-59b3-4753-bcb6-ac27a06b56e3 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:14.867608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:14.868267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:14.868558 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:14.868838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] PATH_INFO: `/v3/users/8dfd8801b0ef4d0d93a626951b2ceaa1` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:14.870032 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dfd8801b0ef4d0d93a626951b2ceaa1)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:14.872812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:15.077574 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dfd8801b0ef4d0d93a626951b2ceaa1'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:15.103105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dfd8801b0ef4d0d93a626951b2ceaa1'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:15.103105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dfd8801b0ef4d0d93a626951b2ceaa1'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:15.103105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dfd8801b0ef4d0d93a626951b2ceaa1'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:15.205515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dfd8801b0ef4d0d93a626951b2ceaa1'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:15.214076 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1077/2162] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:14 2022] DELETE /identity/v3/users/8dfd8801b0ef4d0d93a626951b2ceaa1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:15.219214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2d577-14a1-4e9c-a384-7e6869efa77d None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:15.220114 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2d577-14a1-4e9c-a384-7e6869efa77d None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:15.220556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2d577-14a1-4e9c-a384-7e6869efa77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:15.242365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-94d2d577-14a1-4e9c-a384-7e6869efa77d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:15.243615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-94d2d577-14a1-4e9c-a384-7e6869efa77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:15.252496 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:15.311153 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1086/2163] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:15.326305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:15.327891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:15.390322 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023c2bf-fb66-4271-a4d0-cd79ea8d9bd9 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:15.393879 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be8d5e-9941-4b1b-8480-9438a0d680cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:15.394730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be8d5e-9941-4b1b-8480-9438a0d680cf service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:15.395015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be8d5e-9941-4b1b-8480-9438a0d680cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:15.395291 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be8d5e-9941-4b1b-8480-9438a0d680cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:15.406089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be8d5e-9941-4b1b-8480-9438a0d680cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:15.407574 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be8d5e-9941-4b1b-8480-9438a0d680cf service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:15.418110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1078/2164] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:15.848131 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2d577-14a1-4e9c-a384-7e6869efa77d None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:15.850058 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-94d2d577-14a1-4e9c-a384-7e6869efa77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:15.863072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2d577-14a1-4e9c-a384-7e6869efa77d None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:15.868102 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:15.868751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:15.869038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:15.869324 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] PATH_INFO: `/v3/projects/65ef7a5c1a734107b642b717acc4532e` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:15.870515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ef7a5c1a734107b642b717acc4532e)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:15.873009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:15.972837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ef7a5c1a734107b642b717acc4532e', 'request_id': 'req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:16.045844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ef7a5c1a734107b642b717acc4532e', 'request_id': 'req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:16.054632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ef7a5c1a734107b642b717acc4532e', 'request_id': 'req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:16.071134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] The token cache is being invalidate because project 65ef7a5c1a734107b642b717acc4532e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:16.071294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:16.072150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:16.083247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be8d5e-9941-4b1b-8480-9438a0d680cf service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:16.084106 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1087/2165] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:15 2022] DELETE /identity/v3/projects/65ef7a5c1a734107b642b717acc4532e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:16.095025 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be8d5e-9941-4b1b-8480-9438a0d680cf service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:16.153083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:16.162044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c21dcf-2ec4-44f5-b2a6-2951f06c8f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:16.162733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21dcf-2ec4-44f5-b2a6-2951f06c8f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:16.163038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21dcf-2ec4-44f5-b2a6-2951f06c8f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:16.163300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21dcf-2ec4-44f5-b2a6-2951f06c8f4c admin admin] PATH_INFO: `/v3/users/4da2c1aac28f4d2597d775a90fdd4235` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:16.164594 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c21dcf-2ec4-44f5-b2a6-2951f06c8f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da2c1aac28f4d2597d775a90fdd4235)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:16.166704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c21dcf-2ec4-44f5-b2a6-2951f06c8f4c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:16.451079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f7c21dcf-2ec4-44f5-b2a6-2951f06c8f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da2c1aac28f4d2597d775a90fdd4235'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:16.464345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f7c21dcf-2ec4-44f5-b2a6-2951f06c8f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da2c1aac28f4d2597d775a90fdd4235'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:16.465184 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f7c21dcf-2ec4-44f5-b2a6-2951f06c8f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da2c1aac28f4d2597d775a90fdd4235'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:16.473135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f7c21dcf-2ec4-44f5-b2a6-2951f06c8f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da2c1aac28f4d2597d775a90fdd4235'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:16.548787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f7c21dcf-2ec4-44f5-b2a6-2951f06c8f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da2c1aac28f4d2597d775a90fdd4235'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:16.557072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1079/2166] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:16 2022] DELETE /identity/v3/users/4da2c1aac28f4d2597d775a90fdd4235 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:17.482879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:17.485010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:17.501175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3c9c-67d5-440d-b72b-b4201cd2b2b7 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:17.602906 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c5399-ecb6-4ced-aae5-614054933b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:17.603555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c5399-ecb6-4ced-aae5-614054933b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:17.603837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c5399-ecb6-4ced-aae5-614054933b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:17.604108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c5399-ecb6-4ced-aae5-614054933b96 admin admin] PATH_INFO: `/v3/projects/a7a326487b2645df825407eb2bf39f76` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:17.605298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c5399-ecb6-4ced-aae5-614054933b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a326487b2645df825407eb2bf39f76)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:17.608250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c5399-ecb6-4ced-aae5-614054933b96 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:17.733939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:17.742606 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-675c5399-ecb6-4ced-aae5-614054933b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a326487b2645df825407eb2bf39f76', 'request_id': 'req-675c5399-ecb6-4ced-aae5-614054933b96'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:17.822645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-675c5399-ecb6-4ced-aae5-614054933b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a326487b2645df825407eb2bf39f76', 'request_id': 'req-675c5399-ecb6-4ced-aae5-614054933b96'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:17.829232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-675c5399-ecb6-4ced-aae5-614054933b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a326487b2645df825407eb2bf39f76', 'request_id': 'req-675c5399-ecb6-4ced-aae5-614054933b96'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:17.841161 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-675c5399-ecb6-4ced-aae5-614054933b96 admin admin] The token cache is being invalidate because project a7a326487b2645df825407eb2bf39f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:17.841558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-675c5399-ecb6-4ced-aae5-614054933b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:17.842232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-675c5399-ecb6-4ced-aae5-614054933b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:17.844424 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1088/2167] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:17 2022] DELETE /identity/v3/projects/a7a326487b2645df825407eb2bf39f76 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:17.849561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7644f7-2f9c-4044-968c-812c5fa096f5 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:17.850399 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7644f7-2f9c-4044-968c-812c5fa096f5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:17.850857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7644f7-2f9c-4044-968c-812c5fa096f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:17.872421 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-0f7644f7-2f9c-4044-968c-812c5fa096f5 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:17.873930 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0f7644f7-2f9c-4044-968c-812c5fa096f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:17.941410 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1080/2168] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:17.949542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da452d-1708-4036-ada7-1ec15affc6d2 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:17.949839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da452d-1708-4036-ada7-1ec15affc6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:17.950125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da452d-1708-4036-ada7-1ec15affc6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:17.971587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-b4da452d-1708-4036-ada7-1ec15affc6d2 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:17.976112 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b4da452d-1708-4036-ada7-1ec15affc6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:17.983654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1089/2169] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:17.988723 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7644f7-2f9c-4044-968c-812c5fa096f5 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:18.002335 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7644f7-2f9c-4044-968c-812c5fa096f5 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:18.007195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98634938-548f-4df9-8d20-93c1ae4baa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:18.007965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98634938-548f-4df9-8d20-93c1ae4baa46 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:18.008257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98634938-548f-4df9-8d20-93c1ae4baa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:18.008541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98634938-548f-4df9-8d20-93c1ae4baa46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:18.009298 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98634938-548f-4df9-8d20-93c1ae4baa46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:18.009609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98634938-548f-4df9-8d20-93c1ae4baa46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:18.011949 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98634938-548f-4df9-8d20-93c1ae4baa46 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:18.026940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1081/2170] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:38:18.034513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da452d-1708-4036-ada7-1ec15affc6d2 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:18.045971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da452d-1708-4036-ada7-1ec15affc6d2 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:18.052264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757e490-2721-4d84-b2e9-e33f5b91f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:18.053374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e490-2721-4d84-b2e9-e33f5b91f27e admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:18.053876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e490-2721-4d84-b2e9-e33f5b91f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:18.054334 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e490-2721-4d84-b2e9-e33f5b91f27e admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:18.055308 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757e490-2721-4d84-b2e9-e33f5b91f27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:18.059005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757e490-2721-4d84-b2e9-e33f5b91f27e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:18.175821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1090/2171] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:18 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:18.180187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98634938-548f-4df9-8d20-93c1ae4baa46 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:18.192730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98634938-548f-4df9-8d20-93c1ae4baa46 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:18.238972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757e490-2721-4d84-b2e9-e33f5b91f27e admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:18.243288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6757e490-2721-4d84-b2e9-e33f5b91f27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:18.290876 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0edf8-3039-44cf-a457-8b52a922303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:18.291622 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0edf8-3039-44cf-a457-8b52a922303e admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:18.291902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0edf8-3039-44cf-a457-8b52a922303e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:18.292174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0edf8-3039-44cf-a457-8b52a922303e admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:18.292875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0edf8-3039-44cf-a457-8b52a922303e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:18.295681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0edf8-3039-44cf-a457-8b52a922303e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:18.307384 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:18.327371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757e490-2721-4d84-b2e9-e33f5b91f27e admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:18.332387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:18.333072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:18.333360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:18.333638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] PATH_INFO: `/v3/users/98cd27889e354fc3b35f880927e6147f` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:18.335127 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98cd27889e354fc3b35f880927e6147f)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:18.337347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:18.400564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1082/2172] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:18 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:18.405845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0edf8-3039-44cf-a457-8b52a922303e admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:18.415889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0edf8-3039-44cf-a457-8b52a922303e admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:18.422292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34627753-b529-42b7-8632-d1d4f7cb5e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:18.423100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34627753-b529-42b7-8632-d1d4f7cb5e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:18.423390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34627753-b529-42b7-8632-d1d4f7cb5e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:18.423664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34627753-b529-42b7-8632-d1d4f7cb5e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:18.424357 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34627753-b529-42b7-8632-d1d4f7cb5e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:18.425959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34627753-b529-42b7-8632-d1d4f7cb5e33 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:18.438454 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1083/2173] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:18.441138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34627753-b529-42b7-8632-d1d4f7cb5e33 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:18.456913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34627753-b529-42b7-8632-d1d4f7cb5e33 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:18.464318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41761a-c233-46c6-9401-00d73256f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:18.464318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41761a-c233-46c6-9401-00d73256f8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:18.464318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41761a-c233-46c6-9401-00d73256f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:18.464318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41761a-c233-46c6-9401-00d73256f8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:18.464998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41761a-c233-46c6-9401-00d73256f8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:18.467415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41761a-c233-46c6-9401-00d73256f8d8 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:18.478342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1084/2174] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:18.482719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41761a-c233-46c6-9401-00d73256f8d8 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:18.484684 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-df41761a-c233-46c6-9401-00d73256f8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:18.498740 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41761a-c233-46c6-9401-00d73256f8d8 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:18.503581 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bba16-e999-4bbc-b4d3-a0e9efb0595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:18.504237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bba16-e999-4bbc-b4d3-a0e9efb0595e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:18.504521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bba16-e999-4bbc-b4d3-a0e9efb0595e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:18.504792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bba16-e999-4bbc-b4d3-a0e9efb0595e admin admin] PATH_INFO: `/v3/users/cedf01d8ff9d46aca8a8a022c850ca79` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:18.505964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bba16-e999-4bbc-b4d3-a0e9efb0595e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cedf01d8ff9d46aca8a8a022c850ca79)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:18.508037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bba16-e999-4bbc-b4d3-a0e9efb0595e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:18.580552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98cd27889e354fc3b35f880927e6147f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:18.665722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98cd27889e354fc3b35f880927e6147f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:18.675835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98cd27889e354fc3b35f880927e6147f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:18.676562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98cd27889e354fc3b35f880927e6147f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:18.677969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98cd27889e354fc3b35f880927e6147f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:18.700754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1091/2175] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:18 2022] DELETE /identity/v3/users/98cd27889e354fc3b35f880927e6147f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:18.701694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:18.703075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:18.712815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d03bba16-e999-4bbc-b4d3-a0e9efb0595e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cedf01d8ff9d46aca8a8a022c850ca79'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:18.738426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d03bba16-e999-4bbc-b4d3-a0e9efb0595e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cedf01d8ff9d46aca8a8a022c850ca79'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:18.739880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d03bba16-e999-4bbc-b4d3-a0e9efb0595e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cedf01d8ff9d46aca8a8a022c850ca79'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:18.756501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d03bba16-e999-4bbc-b4d3-a0e9efb0595e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cedf01d8ff9d46aca8a8a022c850ca79'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:18.802822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b6e37-7edd-4355-9a09-2ea8e0f453b6 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:18.808411 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93f9a0-b141-4ca1-ac59-e19a82185934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:18.809275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93f9a0-b141-4ca1-ac59-e19a82185934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:18.810246 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93f9a0-b141-4ca1-ac59-e19a82185934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:18.810559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93f9a0-b141-4ca1-ac59-e19a82185934 admin admin] PATH_INFO: `/v3/projects/591f88b94f2248fc8f3242c869dd46bc/users/518757c5055941d49c0f3e70ceab2c9c/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:18.831138 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93f9a0-b141-4ca1-ac59-e19a82185934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591f88b94f2248fc8f3242c869dd46bc, user_id=518757c5055941d49c0f3e70ceab2c9c, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:18.834249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93f9a0-b141-4ca1-ac59-e19a82185934 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:18.845518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d03bba16-e999-4bbc-b4d3-a0e9efb0595e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cedf01d8ff9d46aca8a8a022c850ca79'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:18.854363 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1085/2176] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:18 2022] DELETE /identity/v3/users/cedf01d8ff9d46aca8a8a022c850ca79 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:18.859831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769cc7-a32c-4626-bdfd-efd66be0ae06 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:18.860177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769cc7-a32c-4626-bdfd-efd66be0ae06 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:18.860617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769cc7-a32c-4626-bdfd-efd66be0ae06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:18.894926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-fc769cc7-a32c-4626-bdfd-efd66be0ae06 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:18.897087 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-fc769cc7-a32c-4626-bdfd-efd66be0ae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:18.926699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1092/2177] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:18 2022] PUT /identity/v3/projects/591f88b94f2248fc8f3242c869dd46bc/users/518757c5055941d49c0f3e70ceab2c9c/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:18.928397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d486-2260-436f-86e8-ed0aa48100c6 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:18.928696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d486-2260-436f-86e8-ed0aa48100c6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:18.928969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d486-2260-436f-86e8-ed0aa48100c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:18.961389 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-a9b1d486-2260-436f-86e8-ed0aa48100c6 None None] MFA Rules not processed for user `518757c5055941d49c0f3e70ceab2c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:18.962679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a9b1d486-2260-436f-86e8-ed0aa48100c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:18.983242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1086/2178] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:18.990225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc769cc7-a32c-4626-bdfd-efd66be0ae06 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:18.991841 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-fc769cc7-a32c-4626-bdfd-efd66be0ae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:19.062682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1093/2179] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:19.062682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d486-2260-436f-86e8-ed0aa48100c6 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:19.064077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a9b1d486-2260-436f-86e8-ed0aa48100c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:19.088916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc769cc7-a32c-4626-bdfd-efd66be0ae06 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:19.163283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d486-2260-436f-86e8-ed0aa48100c6 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:19.164302 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edda34-220d-4445-86ab-e544beef4a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:19.165315 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edda34-220d-4445-86ab-e544beef4a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:19.165785 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edda34-220d-4445-86ab-e544beef4a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:19.166246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edda34-220d-4445-86ab-e544beef4a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:19.169878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:19.170635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:19.170928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:19.171218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] PATH_INFO: `/v3/projects/9483a04c7fe24657a940a7d2c7fd6672` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:19.173136 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9483a04c7fe24657a940a7d2c7fd6672)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:19.176432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:19.179343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edda34-220d-4445-86ab-e544beef4a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:19.181351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edda34-220d-4445-86ab-e544beef4a6d service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:19.193701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1087/2180] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:38:19.194574 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edda34-220d-4445-86ab-e544beef4a6d service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:19.196053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e7edda34-220d-4445-86ab-e544beef4a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:19.211127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edda34-220d-4445-86ab-e544beef4a6d service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:19.216681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8252964-8061-44c8-9efa-25f4a3e2e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:19.217472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8252964-8061-44c8-9efa-25f4a3e2e0cf admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:19.217757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8252964-8061-44c8-9efa-25f4a3e2e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:19.218037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8252964-8061-44c8-9efa-25f4a3e2e0cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:19.218776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8252964-8061-44c8-9efa-25f4a3e2e0cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:19.220814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8252964-8061-44c8-9efa-25f4a3e2e0cf admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:19.235354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:19.340383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1088/2181] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:19 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:19.342150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8252964-8061-44c8-9efa-25f4a3e2e0cf admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:19.343268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9483a04c7fe24657a940a7d2c7fd6672', 'request_id': 'req-1698b071-e26e-4d7e-ae9e-a1342cb17156'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:19.410849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8252964-8061-44c8-9efa-25f4a3e2e0cf admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:19.418518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb2688-2485-45f8-b201-e2cec9631510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:19.420178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2688-2485-45f8-b201-e2cec9631510 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:19.420660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2688-2485-45f8-b201-e2cec9631510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:19.420990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2688-2485-45f8-b201-e2cec9631510 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:19.421732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb2688-2485-45f8-b201-e2cec9631510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:19.425494 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb2688-2485-45f8-b201-e2cec9631510 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:19.451657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9483a04c7fe24657a940a7d2c7fd6672', 'request_id': 'req-1698b071-e26e-4d7e-ae9e-a1342cb17156'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:19.458267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9483a04c7fe24657a940a7d2c7fd6672', 'request_id': 'req-1698b071-e26e-4d7e-ae9e-a1342cb17156'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:19.488291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] The token cache is being invalidate because project 9483a04c7fe24657a940a7d2c7fd6672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:19.488593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:19.489389 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:19.491344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1094/2182] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:19 2022] DELETE /identity/v3/projects/9483a04c7fe24657a940a7d2c7fd6672 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:19.495340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:19.496717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:19.550299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1089/2183] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:19 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:19.553209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb2688-2485-45f8-b201-e2cec9631510 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:19.558012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f0eb2688-2485-45f8-b201-e2cec9631510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:19.597372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb2688-2485-45f8-b201-e2cec9631510 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:19.612218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:19.614117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:19.615244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:19.615925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] PATH_INFO: `/v3/users/84cc4af632e7413ea617fc16a7de3a81` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:19.635713 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84cc4af632e7413ea617fc16a7de3a81)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:19.636907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:19.657577 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b071-e26e-4d7e-ae9e-a1342cb17156 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:19.667478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ade250-086a-497e-99f0-6359902a9f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:19.668690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ade250-086a-497e-99f0-6359902a9f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:19.668831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ade250-086a-497e-99f0-6359902a9f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:19.669177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ade250-086a-497e-99f0-6359902a9f6a admin admin] PATH_INFO: `/v3/users/d7466f6a0b164dbfba03f33b8467f926` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:19.671263 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ade250-086a-497e-99f0-6359902a9f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7466f6a0b164dbfba03f33b8467f926)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:19.673904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ade250-086a-497e-99f0-6359902a9f6a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:19.740818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:19.819991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84cc4af632e7413ea617fc16a7de3a81'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:19.832971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84cc4af632e7413ea617fc16a7de3a81'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:19.833999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84cc4af632e7413ea617fc16a7de3a81'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:19.841889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84cc4af632e7413ea617fc16a7de3a81'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:19.883770 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f1ade250-086a-497e-99f0-6359902a9f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7466f6a0b164dbfba03f33b8467f926'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:19.948424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84cc4af632e7413ea617fc16a7de3a81'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:19.957465 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1090/2184] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:19 2022] DELETE /identity/v3/users/84cc4af632e7413ea617fc16a7de3a81 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:19.961984 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:19.961984 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:20.035462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f1ade250-086a-497e-99f0-6359902a9f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7466f6a0b164dbfba03f33b8467f926'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.037340 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3414b-a322-4ba6-8e65-b3205f382487 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:20.050892 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde124c-dd08-4c5c-8514-41aba18470b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:20.051838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde124c-dd08-4c5c-8514-41aba18470b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:20.052274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde124c-dd08-4c5c-8514-41aba18470b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:20.052863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde124c-dd08-4c5c-8514-41aba18470b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:20.054281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde124c-dd08-4c5c-8514-41aba18470b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:20.056652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde124c-dd08-4c5c-8514-41aba18470b2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:20.064717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f1ade250-086a-497e-99f0-6359902a9f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7466f6a0b164dbfba03f33b8467f926'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.065666 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f1ade250-086a-497e-99f0-6359902a9f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7466f6a0b164dbfba03f33b8467f926'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.066215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f1ade250-086a-497e-99f0-6359902a9f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7466f6a0b164dbfba03f33b8467f926'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.072524 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1091/2185] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:20.074279 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde124c-dd08-4c5c-8514-41aba18470b2 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:20.076746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0cde124c-dd08-4c5c-8514-41aba18470b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:20.089501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1095/2186] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:19 2022] DELETE /identity/v3/users/d7466f6a0b164dbfba03f33b8467f926 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:20.089794 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8ef1-88bb-4b4a-b183-4df58e670e77 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:20.090199 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8ef1-88bb-4b4a-b183-4df58e670e77 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:20.090361 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8ef1-88bb-4b4a-b183-4df58e670e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:20.099845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde124c-dd08-4c5c-8514-41aba18470b2 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:20.128251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9c7c8ef1-88bb-4b4a-b183-4df58e670e77 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:20.131939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9c7c8ef1-88bb-4b4a-b183-4df58e670e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:20.185393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:20.185393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:20.185393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:20.185393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] PATH_INFO: `/v3/projects/d82a72ac78814327be89f984dc765b4e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:20.186205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82a72ac78814327be89f984dc765b4e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:20.201488 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:20.220177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1096/2187] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:20.224636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c8ef1-88bb-4b4a-b183-4df58e670e77 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:20.226123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9c7c8ef1-88bb-4b4a-b183-4df58e670e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:20.245131 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c8ef1-88bb-4b4a-b183-4df58e670e77 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:20.260220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463f899-a7e6-4895-8fc4-21a42789c3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:20.261494 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463f899-a7e6-4895-8fc4-21a42789c3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:20.261985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463f899-a7e6-4895-8fc4-21a42789c3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:20.262324 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463f899-a7e6-4895-8fc4-21a42789c3a5 admin admin] PATH_INFO: `/v3/projects/c72782ddf9f24c0f86bf00eee6b5c1b0/users/5ae30f9d207b477e90fb619304e3d348/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:20.281737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463f899-a7e6-4895-8fc4-21a42789c3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72782ddf9f24c0f86bf00eee6b5c1b0, user_id=5ae30f9d207b477e90fb619304e3d348, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:20.284767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463f899-a7e6-4895-8fc4-21a42789c3a5 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:20.399418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1097/2188] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:20 2022] PUT /identity/v3/projects/c72782ddf9f24c0f86bf00eee6b5c1b0/users/5ae30f9d207b477e90fb619304e3d348/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:20.401726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463f899-a7e6-4895-8fc4-21a42789c3a5 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:20.406016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4463f899-a7e6-4895-8fc4-21a42789c3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:20.426527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82a72ac78814327be89f984dc765b4e', 'request_id': 'req-531e457a-c625-4e67-9588-b9dc3609d63b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.433336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82a72ac78814327be89f984dc765b4e', 'request_id': 'req-531e457a-c625-4e67-9588-b9dc3609d63b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.488709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463f899-a7e6-4895-8fc4-21a42789c3a5 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:20.502591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82a72ac78814327be89f984dc765b4e', 'request_id': 'req-531e457a-c625-4e67-9588-b9dc3609d63b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.519540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] The token cache is being invalidate because project d82a72ac78814327be89f984dc765b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:20.519861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.520569 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.522605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1092/2189] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:20 2022] DELETE /identity/v3/projects/d82a72ac78814327be89f984dc765b4e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:20.523404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:20.525161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:20.546264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efc082-1433-4395-97f6-7767f2a4df1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:20.547009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efc082-1433-4395-97f6-7767f2a4df1c service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:20.547337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efc082-1433-4395-97f6-7767f2a4df1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:20.547621 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efc082-1433-4395-97f6-7767f2a4df1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:20.549498 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-59efc082-1433-4395-97f6-7767f2a4df1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:20.604534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e457a-c625-4e67-9588-b9dc3609d63b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:20.610327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:20.611217 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:20.611502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:20.611784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] PATH_INFO: `/v3/projects/f04197f8a0704a71a5f4506a2e64f7ce` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:20.612963 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04197f8a0704a71a5f4506a2e64f7ce)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:20.614981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:20.616215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efc082-1433-4395-97f6-7767f2a4df1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:20.617666 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efc082-1433-4395-97f6-7767f2a4df1c service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:20.628323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1098/2190] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:20.637407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efc082-1433-4395-97f6-7767f2a4df1c service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:20.652141 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-59efc082-1433-4395-97f6-7767f2a4df1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:20.680114 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efc082-1433-4395-97f6-7767f2a4df1c service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:20.702105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879c949-e3ad-4515-9a9d-d94e07a84b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:20.704049 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879c949-e3ad-4515-9a9d-d94e07a84b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:20.704049 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879c949-e3ad-4515-9a9d-d94e07a84b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:20.705061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879c949-e3ad-4515-9a9d-d94e07a84b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:20.708169 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879c949-e3ad-4515-9a9d-d94e07a84b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:20.711790 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879c949-e3ad-4515-9a9d-d94e07a84b53 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:20.740249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1099/2191] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:20.741371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879c949-e3ad-4515-9a9d-d94e07a84b53 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:20.743480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5879c949-e3ad-4515-9a9d-d94e07a84b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:20.759282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04197f8a0704a71a5f4506a2e64f7ce', 'request_id': 'req-aa4997bc-669a-41c7-9619-99d9cac00444'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.759960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879c949-e3ad-4515-9a9d-d94e07a84b53 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:20.767299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04197f8a0704a71a5f4506a2e64f7ce', 'request_id': 'req-aa4997bc-669a-41c7-9619-99d9cac00444'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.848331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef2ea0-405b-4c7d-ba08-93a2fd3fb1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:20.848986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef2ea0-405b-4c7d-ba08-93a2fd3fb1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:20.849268 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef2ea0-405b-4c7d-ba08-93a2fd3fb1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:20.849546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef2ea0-405b-4c7d-ba08-93a2fd3fb1fa admin admin] PATH_INFO: `/v3/users/5408d589455c4216aad1dc395d10d32e` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:20.850767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef2ea0-405b-4c7d-ba08-93a2fd3fb1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5408d589455c4216aad1dc395d10d32e)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:20.852740 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef2ea0-405b-4c7d-ba08-93a2fd3fb1fa admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:20.886096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04197f8a0704a71a5f4506a2e64f7ce', 'request_id': 'req-aa4997bc-669a-41c7-9619-99d9cac00444'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.899454 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] The token cache is being invalidate because project f04197f8a0704a71a5f4506a2e64f7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:20.899988 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.901142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:20.902573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1093/2192] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:20 2022] DELETE /identity/v3/projects/f04197f8a0704a71a5f4506a2e64f7ce => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:20.906117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:20.907702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:20.936575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4997bc-669a-41c7-9619-99d9cac00444 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:20.944464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce45cc-9f70-479a-a6d5-6cd677da60c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:20.945293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce45cc-9f70-479a-a6d5-6cd677da60c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:20.945675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce45cc-9f70-479a-a6d5-6cd677da60c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:20.946171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce45cc-9f70-479a-a6d5-6cd677da60c7 admin admin] PATH_INFO: `/v3/projects/c72782ddf9f24c0f86bf00eee6b5c1b0/users/5ae30f9d207b477e90fb619304e3d348/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:20.949212 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce45cc-9f70-479a-a6d5-6cd677da60c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72782ddf9f24c0f86bf00eee6b5c1b0, user_id=5ae30f9d207b477e90fb619304e3d348, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:20.952477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce45cc-9f70-479a-a6d5-6cd677da60c7 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:20.969585 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1094/2193] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:20 2022] PUT /identity/v3/projects/c72782ddf9f24c0f86bf00eee6b5c1b0/users/5ae30f9d207b477e90fb619304e3d348/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:20.969585 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44728b4f-ce06-4c51-a2cf-f7590ce1df31 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:20.969585 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44728b4f-ce06-4c51-a2cf-f7590ce1df31 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:20.969585 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44728b4f-ce06-4c51-a2cf-f7590ce1df31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:21.002432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-44728b4f-ce06-4c51-a2cf-f7590ce1df31 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:21.003845 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-44728b4f-ce06-4c51-a2cf-f7590ce1df31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:21.085880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1095/2194] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:21.091521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84f3e-d93a-490d-925c-29e9b86cd7fc None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:21.091889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84f3e-d93a-490d-925c-29e9b86cd7fc None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:21.092185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84f3e-d93a-490d-925c-29e9b86cd7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:21.113298 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-55c84f3e-d93a-490d-925c-29e9b86cd7fc None None] MFA Rules not processed for user `2e47969dca184aec92e620fcd53d6a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:21.114935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-55c84f3e-d93a-490d-925c-29e9b86cd7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:21.125440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-10ef2ea0-405b-4c7d-ba08-93a2fd3fb1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5408d589455c4216aad1dc395d10d32e'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:21.171820 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1096/2195] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:21.173081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288c782-e5ea-43a6-a4e8-7160e6ce9693 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:21.173370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288c782-e5ea-43a6-a4e8-7160e6ce9693 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:21.173651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288c782-e5ea-43a6-a4e8-7160e6ce9693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:21.201015 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:21.204689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-6288c782-e5ea-43a6-a4e8-7160e6ce9693 None None] MFA Rules not processed for user `5ae30f9d207b477e90fb619304e3d348`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:21.206066 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-6288c782-e5ea-43a6-a4e8-7160e6ce9693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:21.234375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-10ef2ea0-405b-4c7d-ba08-93a2fd3fb1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5408d589455c4216aad1dc395d10d32e'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:21.250255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-10ef2ea0-405b-4c7d-ba08-93a2fd3fb1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5408d589455c4216aad1dc395d10d32e'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:21.252422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-10ef2ea0-405b-4c7d-ba08-93a2fd3fb1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5408d589455c4216aad1dc395d10d32e'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:21.253593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-10ef2ea0-405b-4c7d-ba08-93a2fd3fb1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5408d589455c4216aad1dc395d10d32e'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:21.285251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1100/2196] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:20 2022] DELETE /identity/v3/users/5408d589455c4216aad1dc395d10d32e => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:21.289541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04ce2e-e93d-4a31-ad6f-d3edd24ba317 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:21.289843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04ce2e-e93d-4a31-ad6f-d3edd24ba317 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:21.290117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04ce2e-e93d-4a31-ad6f-d3edd24ba317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:21.291632 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1097/2197] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:21.296296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288c782-e5ea-43a6-a4e8-7160e6ce9693 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:21.296296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-6288c782-e5ea-43a6-a4e8-7160e6ce9693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:21.317896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288c782-e5ea-43a6-a4e8-7160e6ce9693 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:21.326247 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-db04ce2e-e93d-4a31-ad6f-d3edd24ba317 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:21.327641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-db04ce2e-e93d-4a31-ad6f-d3edd24ba317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:21.381379 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:21.382025 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:21.382307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:21.382651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] PATH_INFO: `/v3/projects/a114f5ca48924737a143c2ed97982492` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:21.383822 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a114f5ca48924737a143c2ed97982492)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:21.385750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:21.399656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1101/2198] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:21.400507 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04ce2e-e93d-4a31-ad6f-d3edd24ba317 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:21.401907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-db04ce2e-e93d-4a31-ad6f-d3edd24ba317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:21.464835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04ce2e-e93d-4a31-ad6f-d3edd24ba317 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:21.469967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8716-1e52-48ba-82fc-cc256efcde8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:21.470558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8716-1e52-48ba-82fc-cc256efcde8e service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:21.470845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8716-1e52-48ba-82fc-cc256efcde8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:21.471124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8716-1e52-48ba-82fc-cc256efcde8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:21.533810 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a114f5ca48924737a143c2ed97982492', 'request_id': 'req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:21.538019 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea8716-1e52-48ba-82fc-cc256efcde8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:21.542143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea8716-1e52-48ba-82fc-cc256efcde8e service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:21.546969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a114f5ca48924737a143c2ed97982492', 'request_id': 'req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:21.551053 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1102/2199] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:21.552038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8716-1e52-48ba-82fc-cc256efcde8e service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:21.567963 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8716-1e52-48ba-82fc-cc256efcde8e service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:21.675871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a114f5ca48924737a143c2ed97982492', 'request_id': 'req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:21.677370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1192e9-d593-46fc-b9ef-beb8f043afc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:21.678084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1192e9-d593-46fc-b9ef-beb8f043afc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:21.678373 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1192e9-d593-46fc-b9ef-beb8f043afc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:21.678885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1192e9-d593-46fc-b9ef-beb8f043afc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:21.679613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1192e9-d593-46fc-b9ef-beb8f043afc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:21.679918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1192e9-d593-46fc-b9ef-beb8f043afc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:21.681704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1192e9-d593-46fc-b9ef-beb8f043afc4 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:21.702534 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1103/2200] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:38:21.707295 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1192e9-d593-46fc-b9ef-beb8f043afc4 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:21.713904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] The token cache is being invalidate because project a114f5ca48924737a143c2ed97982492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:21.714637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:21.717276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:21.718550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1192e9-d593-46fc-b9ef-beb8f043afc4 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:21.720706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1098/2201] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:21 2022] DELETE /identity/v3/projects/a114f5ca48924737a143c2ed97982492 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:21.725014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:21.728274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d0468-5037-4672-8ded-25e7b501ad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:21.729616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d0468-5037-4672-8ded-25e7b501ad04 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:21.730108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d0468-5037-4672-8ded-25e7b501ad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:21.730650 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d0468-5037-4672-8ded-25e7b501ad04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:21.731630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d0468-5037-4672-8ded-25e7b501ad04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:21.733917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d0468-5037-4672-8ded-25e7b501ad04 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:21.737018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:21.752839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea34c95-9d5a-4f3f-8ae8-86608f3a5fa4 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:21.758602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:21.759548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:21.760006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:21.760285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] PATH_INFO: `/v3/users/4371b5eae6ec477d87314a4949fa4457` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:21.761521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4371b5eae6ec477d87314a4949fa4457)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:21.764128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:21.824527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1104/2202] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:21 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:38:21.826111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d0468-5037-4672-8ded-25e7b501ad04 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:21.828035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-951d0468-5037-4672-8ded-25e7b501ad04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:21.896189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d0468-5037-4672-8ded-25e7b501ad04 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:21.913061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc33f6a-7a0d-4422-b292-3b37771716d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:21.913890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc33f6a-7a0d-4422-b292-3b37771716d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:21.914362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc33f6a-7a0d-4422-b292-3b37771716d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:21.914786 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc33f6a-7a0d-4422-b292-3b37771716d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:21.917065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2cc33f6a-7a0d-4422-b292-3b37771716d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:21.990077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc33f6a-7a0d-4422-b292-3b37771716d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:21.991744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc33f6a-7a0d-4422-b292-3b37771716d6 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:22.001692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1105/2203] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:22.002556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc33f6a-7a0d-4422-b292-3b37771716d6 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:22.003954 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2cc33f6a-7a0d-4422-b292-3b37771716d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:22.031961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4371b5eae6ec477d87314a4949fa4457'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:22.055215 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4371b5eae6ec477d87314a4949fa4457'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:22.056220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4371b5eae6ec477d87314a4949fa4457'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:22.066377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4371b5eae6ec477d87314a4949fa4457'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:22.114786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:22.137411 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc33f6a-7a0d-4422-b292-3b37771716d6 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:22.143356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4371b5eae6ec477d87314a4949fa4457'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:22.151174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1099/2204] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:21 2022] DELETE /identity/v3/users/4371b5eae6ec477d87314a4949fa4457 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:22.169750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:22.169750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:22.170449 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9013f37-e58e-4ca2-a284-ce1a942e3464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:22.170449 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9013f37-e58e-4ca2-a284-ce1a942e3464 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:22.170449 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9013f37-e58e-4ca2-a284-ce1a942e3464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:22.170449 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9013f37-e58e-4ca2-a284-ce1a942e3464 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:22.170969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9013f37-e58e-4ca2-a284-ce1a942e3464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:22.170969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9013f37-e58e-4ca2-a284-ce1a942e3464 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:22.327839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92605ddb-9805-4adb-91f7-7dfcde27ef4e admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:22.332651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:22.333295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:22.333579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:22.333855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] PATH_INFO: `/v3/projects/0416aaacbc6b4714a103e80d1b0f501a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:22.335042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0416aaacbc6b4714a103e80d1b0f501a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:22.336987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:22.338528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1106/2205] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:22 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:22.345241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9013f37-e58e-4ca2-a284-ce1a942e3464 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:22.347774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a9013f37-e58e-4ca2-a284-ce1a942e3464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:22.363930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9013f37-e58e-4ca2-a284-ce1a942e3464 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:22.370749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad711868-aeae-4bbd-9ee8-b3231170e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:22.371510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad711868-aeae-4bbd-9ee8-b3231170e72f admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:22.371841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad711868-aeae-4bbd-9ee8-b3231170e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:22.372472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad711868-aeae-4bbd-9ee8-b3231170e72f admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:22.373192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad711868-aeae-4bbd-9ee8-b3231170e72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:22.374851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad711868-aeae-4bbd-9ee8-b3231170e72f admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:22.385681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1107/2206] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:22.390301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad711868-aeae-4bbd-9ee8-b3231170e72f admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:22.400062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad711868-aeae-4bbd-9ee8-b3231170e72f admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:22.405604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236297-2c5b-480e-8efa-9df57dc76b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:22.406184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236297-2c5b-480e-8efa-9df57dc76b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:22.406471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236297-2c5b-480e-8efa-9df57dc76b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:22.406781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e236297-2c5b-480e-8efa-9df57dc76b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:22.407458 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e236297-2c5b-480e-8efa-9df57dc76b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:22.409042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e236297-2c5b-480e-8efa-9df57dc76b93 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:22.420000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1108/2207] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:22.424305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236297-2c5b-480e-8efa-9df57dc76b93 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:22.435867 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e236297-2c5b-480e-8efa-9df57dc76b93 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:22.445470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7971cdd-96ef-4b82-9169-8e5a0ceba800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:22.447717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7971cdd-96ef-4b82-9169-8e5a0ceba800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:22.449696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7971cdd-96ef-4b82-9169-8e5a0ceba800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:22.450723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7971cdd-96ef-4b82-9169-8e5a0ceba800 admin admin] PATH_INFO: `/v3/projects/cccdd570ebb94744b20f7d57d9969e2e/users/aed9e72ba0ed41ccb2f5623f50cd7431/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:22.474778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7971cdd-96ef-4b82-9169-8e5a0ceba800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccdd570ebb94744b20f7d57d9969e2e, user_id=aed9e72ba0ed41ccb2f5623f50cd7431, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:22.476927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7971cdd-96ef-4b82-9169-8e5a0ceba800 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:22.479935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0416aaacbc6b4714a103e80d1b0f501a', 'request_id': 'req-07895ff5-ccda-4895-b4b3-d48ebe3bb803'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:22.488502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0416aaacbc6b4714a103e80d1b0f501a', 'request_id': 'req-07895ff5-ccda-4895-b4b3-d48ebe3bb803'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:22.567641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1109/2208] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:22 2022] PUT /identity/v3/projects/cccdd570ebb94744b20f7d57d9969e2e/users/aed9e72ba0ed41ccb2f5623f50cd7431/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:22.581629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788591b7-5174-42ce-af2b-e0a09da48345 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:22.582314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788591b7-5174-42ce-af2b-e0a09da48345 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:22.582779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788591b7-5174-42ce-af2b-e0a09da48345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:22.624989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0416aaacbc6b4714a103e80d1b0f501a', 'request_id': 'req-07895ff5-ccda-4895-b4b3-d48ebe3bb803'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:22.625720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-788591b7-5174-42ce-af2b-e0a09da48345 None None] MFA Rules not processed for user `aed9e72ba0ed41ccb2f5623f50cd7431`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:22.626999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-788591b7-5174-42ce-af2b-e0a09da48345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:22.638119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] The token cache is being invalidate because project 0416aaacbc6b4714a103e80d1b0f501a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:22.638611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:22.639286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:22.640965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1100/2209] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:22 2022] DELETE /identity/v3/projects/0416aaacbc6b4714a103e80d1b0f501a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:22.712431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1110/2210] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:22.754066 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:22.756816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:22.817823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788591b7-5174-42ce-af2b-e0a09da48345 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:22.823834 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-788591b7-5174-42ce-af2b-e0a09da48345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:22.925603 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788591b7-5174-42ce-af2b-e0a09da48345 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:22.932077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7dde8-a56d-45d6-8532-ad2bea92cacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:22.932882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7dde8-a56d-45d6-8532-ad2bea92cacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:22.933378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7dde8-a56d-45d6-8532-ad2bea92cacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:22.933664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7dde8-a56d-45d6-8532-ad2bea92cacf admin admin] PATH_INFO: `/v3/projects/6579ad886e19434db60ce8d5b86fc06d` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:22.938535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7dde8-a56d-45d6-8532-ad2bea92cacf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6579ad886e19434db60ce8d5b86fc06d)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:22.938701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07895ff5-ccda-4895-b4b3-d48ebe3bb803 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:22.938825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7dde8-a56d-45d6-8532-ad2bea92cacf admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:23.005327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3e66e-7b70-4235-ae93-3c29286e5edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:23.005995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3e66e-7b70-4235-ae93-3c29286e5edd service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:23.006383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3e66e-7b70-4235-ae93-3c29286e5edd service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:23.006698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3e66e-7b70-4235-ae93-3c29286e5edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:23.015725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3e66e-7b70-4235-ae93-3c29286e5edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:23.017231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3e66e-7b70-4235-ae93-3c29286e5edd service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:23.026191 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1101/2211] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:23.097469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-01d7dde8-a56d-45d6-8532-ad2bea92cacf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6579ad886e19434db60ce8d5b86fc06d', 'request_id': 'req-01d7dde8-a56d-45d6-8532-ad2bea92cacf'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:23.180786 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-01d7dde8-a56d-45d6-8532-ad2bea92cacf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6579ad886e19434db60ce8d5b86fc06d', 'request_id': 'req-01d7dde8-a56d-45d6-8532-ad2bea92cacf'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:23.196178 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-01d7dde8-a56d-45d6-8532-ad2bea92cacf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6579ad886e19434db60ce8d5b86fc06d', 'request_id': 'req-01d7dde8-a56d-45d6-8532-ad2bea92cacf'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:23.201555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-01d7dde8-a56d-45d6-8532-ad2bea92cacf admin admin] The token cache is being invalidate because project 6579ad886e19434db60ce8d5b86fc06d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:23.201977 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-01d7dde8-a56d-45d6-8532-ad2bea92cacf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:23.202811 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-01d7dde8-a56d-45d6-8532-ad2bea92cacf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:23.204710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1111/2212] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:22 2022] DELETE /identity/v3/projects/6579ad886e19434db60ce8d5b86fc06d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:23.210037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df944c-4f42-4bfa-84eb-47ee2be4c7ff None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:23.210534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df944c-4f42-4bfa-84eb-47ee2be4c7ff None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:23.210618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df944c-4f42-4bfa-84eb-47ee2be4c7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:23.233072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-15df944c-4f42-4bfa-84eb-47ee2be4c7ff None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:23.235163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-15df944c-4f42-4bfa-84eb-47ee2be4c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:23.319002 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1102/2213] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:23.327334 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7875-03cc-429e-bc38-167fbb23cc57 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:23.327671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7875-03cc-429e-bc38-167fbb23cc57 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:23.327956 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7875-03cc-429e-bc38-167fbb23cc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:23.363500 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-648f7875-03cc-429e-bc38-167fbb23cc57 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:23.364893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-648f7875-03cc-429e-bc38-167fbb23cc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:23.374519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1112/2214] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:23.379146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df944c-4f42-4bfa-84eb-47ee2be4c7ff None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:23.389415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df944c-4f42-4bfa-84eb-47ee2be4c7ff None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:23.395736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788b898-d60e-49ea-bb66-99089be473cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:23.396513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788b898-d60e-49ea-bb66-99089be473cd admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:23.396799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788b898-d60e-49ea-bb66-99089be473cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:23.397075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788b898-d60e-49ea-bb66-99089be473cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:23.397779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788b898-d60e-49ea-bb66-99089be473cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:23.398248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788b898-d60e-49ea-bb66-99089be473cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:23.400063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788b898-d60e-49ea-bb66-99089be473cd admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:23.416822 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1103/2215] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:38:23.420381 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f7875-03cc-429e-bc38-167fbb23cc57 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:23.430942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f7875-03cc-429e-bc38-167fbb23cc57 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:23.437509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f202b20-9b51-4ac4-9aaa-1bb1dc87c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:23.438564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f202b20-9b51-4ac4-9aaa-1bb1dc87c830 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:23.439191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f202b20-9b51-4ac4-9aaa-1bb1dc87c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:23.439691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f202b20-9b51-4ac4-9aaa-1bb1dc87c830 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:23.441833 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:23.442778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f202b20-9b51-4ac4-9aaa-1bb1dc87c830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:23.445386 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f202b20-9b51-4ac4-9aaa-1bb1dc87c830 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:23.554322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1113/2216] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:23 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:23.558825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788b898-d60e-49ea-bb66-99089be473cd admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:23.573237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788b898-d60e-49ea-bb66-99089be473cd admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:23.661834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b110d3-9b6a-4e08-add9-1b7c5d897ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:23.661943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b110d3-9b6a-4e08-add9-1b7c5d897ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:23.662228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b110d3-9b6a-4e08-add9-1b7c5d897ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:23.662502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b110d3-9b6a-4e08-add9-1b7c5d897ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:23.663176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b110d3-9b6a-4e08-add9-1b7c5d897ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:23.665142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b110d3-9b6a-4e08-add9-1b7c5d897ed5 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:23.754751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1104/2217] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:23 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:23.758898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f202b20-9b51-4ac4-9aaa-1bb1dc87c830 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:23.770124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f202b20-9b51-4ac4-9aaa-1bb1dc87c830 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:23.774651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845299ef-b3e6-4c7b-87ab-6197afa84752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:23.776543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845299ef-b3e6-4c7b-87ab-6197afa84752 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:23.776953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845299ef-b3e6-4c7b-87ab-6197afa84752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:23.777240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845299ef-b3e6-4c7b-87ab-6197afa84752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:23.778923 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845299ef-b3e6-4c7b-87ab-6197afa84752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:23.780675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845299ef-b3e6-4c7b-87ab-6197afa84752 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:23.792482 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1114/2218] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:23.796660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b110d3-9b6a-4e08-add9-1b7c5d897ed5 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:23.816314 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b110d3-9b6a-4e08-add9-1b7c5d897ed5 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:23.823123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d7cc3-7414-4df4-8386-f283c3826c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:23.824323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d7cc3-7414-4df4-8386-f283c3826c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:23.824614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d7cc3-7414-4df4-8386-f283c3826c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:23.825380 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d7cc3-7414-4df4-8386-f283c3826c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:23.826139 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d7cc3-7414-4df4-8386-f283c3826c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:23.827853 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d7cc3-7414-4df4-8386-f283c3826c0d admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:23.842079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1105/2219] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:23.846382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845299ef-b3e6-4c7b-87ab-6197afa84752 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:23.857800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845299ef-b3e6-4c7b-87ab-6197afa84752 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:23.863356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb2cfe-2361-4541-8f12-c454951b1d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:23.864027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb2cfe-2361-4541-8f12-c454951b1d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:23.864315 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb2cfe-2361-4541-8f12-c454951b1d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:23.864593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb2cfe-2361-4541-8f12-c454951b1d66 admin admin] PATH_INFO: `/v3/projects/1f4b7053fcda43a69dbfca4dca12c112/users/5930e4f2cf4040dbad19faafe86b8a9a/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:23.880210 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb2cfe-2361-4541-8f12-c454951b1d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4b7053fcda43a69dbfca4dca12c112, user_id=5930e4f2cf4040dbad19faafe86b8a9a, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:23.882914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb2cfe-2361-4541-8f12-c454951b1d66 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:23.967894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1115/2220] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:23 2022] PUT /identity/v3/projects/1f4b7053fcda43a69dbfca4dca12c112/users/5930e4f2cf4040dbad19faafe86b8a9a/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:23.979132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca75afb-5456-4e8e-96df-c976e23d2119 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:23.979422 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca75afb-5456-4e8e-96df-c976e23d2119 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:23.979698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca75afb-5456-4e8e-96df-c976e23d2119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:24.010938 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-fca75afb-5456-4e8e-96df-c976e23d2119 None None] MFA Rules not processed for user `5930e4f2cf4040dbad19faafe86b8a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:24.012170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-fca75afb-5456-4e8e-96df-c976e23d2119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:24.083534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1106/2221] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:24.086624 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:24.088265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb2cfe-2361-4541-8f12-c454951b1d66 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:24.150285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb2cfe-2361-4541-8f12-c454951b1d66 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:24.156514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cb5b0-c53a-47f0-ac64-f5f3c15e4c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:24.157132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cb5b0-c53a-47f0-ac64-f5f3c15e4c5c admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:24.157412 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cb5b0-c53a-47f0-ac64-f5f3c15e4c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:24.157686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cb5b0-c53a-47f0-ac64-f5f3c15e4c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:24.158362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cb5b0-c53a-47f0-ac64-f5f3c15e4c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:24.160405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cb5b0-c53a-47f0-ac64-f5f3c15e4c5c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:24.271017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1116/2222] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:24 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:24.274867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca75afb-5456-4e8e-96df-c976e23d2119 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:24.287397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca75afb-5456-4e8e-96df-c976e23d2119 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:24.346250 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64575294-cec9-4be5-ba90-34331fd2b6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:24.346903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64575294-cec9-4be5-ba90-34331fd2b6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:24.347241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64575294-cec9-4be5-ba90-34331fd2b6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:24.347471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64575294-cec9-4be5-ba90-34331fd2b6d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:24.348135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64575294-cec9-4be5-ba90-34331fd2b6d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:24.350078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64575294-cec9-4be5-ba90-34331fd2b6d9 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:24.448706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1107/2223] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:24 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:24.454548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cb5b0-c53a-47f0-ac64-f5f3c15e4c5c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:24.488537 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cb5b0-c53a-47f0-ac64-f5f3c15e4c5c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:24.503218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c4c3e-efaa-4703-bd16-37d1c98f3748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:24.503859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c4c3e-efaa-4703-bd16-37d1c98f3748 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:24.504149 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c4c3e-efaa-4703-bd16-37d1c98f3748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:24.504430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c4c3e-efaa-4703-bd16-37d1c98f3748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:24.508339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c4c3e-efaa-4703-bd16-37d1c98f3748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:24.511108 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c4c3e-efaa-4703-bd16-37d1c98f3748 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:24.537021 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1117/2224] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:24.546120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64575294-cec9-4be5-ba90-34331fd2b6d9 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:24.557761 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64575294-cec9-4be5-ba90-34331fd2b6d9 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:24.566263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f5d82-c9bd-4467-85be-fe179fd144ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:24.569101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f5d82-c9bd-4467-85be-fe179fd144ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:24.569101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f5d82-c9bd-4467-85be-fe179fd144ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:24.569101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f5d82-c9bd-4467-85be-fe179fd144ee admin admin] PATH_INFO: `/v3/projects/a8c769c25c9047d19966fd363d8933b4/users/674a42a7935d4cf39b7da5002b00112a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:24.584643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f5d82-c9bd-4467-85be-fe179fd144ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c769c25c9047d19966fd363d8933b4, user_id=674a42a7935d4cf39b7da5002b00112a, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:24.587373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f5d82-c9bd-4467-85be-fe179fd144ee admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:24.671490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1108/2225] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:24 2022] PUT /identity/v3/projects/a8c769c25c9047d19966fd363d8933b4/users/674a42a7935d4cf39b7da5002b00112a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:24.675812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c4c3e-efaa-4703-bd16-37d1c98f3748 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:24.690465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c4c3e-efaa-4703-bd16-37d1c98f3748 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:24.771989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5b506-64f0-4daf-bee8-c4bfeb67482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:24.778167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b506-64f0-4daf-bee8-c4bfeb67482d admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:24.778167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b506-64f0-4daf-bee8-c4bfeb67482d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:24.778167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b506-64f0-4daf-bee8-c4bfeb67482d admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:24.778167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5b506-64f0-4daf-bee8-c4bfeb67482d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:24.778167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5b506-64f0-4daf-bee8-c4bfeb67482d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:24.792198 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f5d82-c9bd-4467-85be-fe179fd144ee admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:24.793051 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1118/2226] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:24.803842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f5d82-c9bd-4467-85be-fe179fd144ee admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:24.839795 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5de75-ceb4-4f7c-a3aa-fc2c418a2b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:24.841128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5de75-ceb4-4f7c-a3aa-fc2c418a2b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:24.841694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5de75-ceb4-4f7c-a3aa-fc2c418a2b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:24.842087 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5de75-ceb4-4f7c-a3aa-fc2c418a2b78 admin admin] PATH_INFO: `/v3/projects/a8c769c25c9047d19966fd363d8933b4/users/674a42a7935d4cf39b7da5002b00112a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:24.844510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5de75-ceb4-4f7c-a3aa-fc2c418a2b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c769c25c9047d19966fd363d8933b4, user_id=674a42a7935d4cf39b7da5002b00112a, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:24.847354 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5de75-ceb4-4f7c-a3aa-fc2c418a2b78 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:24.874405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1109/2227] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:24 2022] PUT /identity/v3/projects/a8c769c25c9047d19966fd363d8933b4/users/674a42a7935d4cf39b7da5002b00112a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:24.877805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775703b9-2fb4-4d35-8dfd-b89adb1923ca None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:24.878280 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775703b9-2fb4-4d35-8dfd-b89adb1923ca None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:24.879831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775703b9-2fb4-4d35-8dfd-b89adb1923ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:24.931953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-775703b9-2fb4-4d35-8dfd-b89adb1923ca None None] MFA Rules not processed for user `674a42a7935d4cf39b7da5002b00112a`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:24.933388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-775703b9-2fb4-4d35-8dfd-b89adb1923ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:25.034098 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1119/2228] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:25.044818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5de75-ceb4-4f7c-a3aa-fc2c418a2b78 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:25.046727 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4aa5de75-ceb4-4f7c-a3aa-fc2c418a2b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:25.116737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5de75-ceb4-4f7c-a3aa-fc2c418a2b78 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:25.120619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b16275-7d6b-4e93-8e37-f7016eb0c537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:25.121260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b16275-7d6b-4e93-8e37-f7016eb0c537 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:25.121548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b16275-7d6b-4e93-8e37-f7016eb0c537 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:25.122342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b16275-7d6b-4e93-8e37-f7016eb0c537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:25.132481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b16275-7d6b-4e93-8e37-f7016eb0c537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:25.133927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b16275-7d6b-4e93-8e37-f7016eb0c537 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:25.145718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1110/2229] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:38:25.697548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:25.935286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775703b9-2fb4-4d35-8dfd-b89adb1923ca None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:25.937794 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-775703b9-2fb4-4d35-8dfd-b89adb1923ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:26.037905 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775703b9-2fb4-4d35-8dfd-b89adb1923ca None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:26.055671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:26.056591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:26.057161 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:26.057604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] PATH_INFO: `/v3/users/518757c5055941d49c0f3e70ceab2c9c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:26.058971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=518757c5055941d49c0f3e70ceab2c9c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:26.062430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:26.399644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518757c5055941d49c0f3e70ceab2c9c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:26.457521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:26.510856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518757c5055941d49c0f3e70ceab2c9c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:26.526075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518757c5055941d49c0f3e70ceab2c9c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:26.528778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518757c5055941d49c0f3e70ceab2c9c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:26.530747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518757c5055941d49c0f3e70ceab2c9c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:26.604950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1120/2230] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:25 2022] DELETE /identity/v3/users/518757c5055941d49c0f3e70ceab2c9c => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:26.610177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3f60-9198-4aec-9f9e-5c72eeb67990 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:26.610754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3f60-9198-4aec-9f9e-5c72eeb67990 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:26.611376 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e3f60-9198-4aec-9f9e-5c72eeb67990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:26.670163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-bb3e3f60-9198-4aec-9f9e-5c72eeb67990 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:26.687940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-bb3e3f60-9198-4aec-9f9e-5c72eeb67990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:26.763761 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:26.765773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:26.802153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1111/2231] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:26.816178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e3f60-9198-4aec-9f9e-5c72eeb67990 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:26.818155 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-bb3e3f60-9198-4aec-9f9e-5c72eeb67990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:26.893287 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d4821-29db-4ad3-9495-82db9146afd9 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:26.905725 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:26.906289 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:26.906596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:26.906876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] PATH_INFO: `/v3/users/5930e4f2cf4040dbad19faafe86b8a9a` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:26.912255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5930e4f2cf4040dbad19faafe86b8a9a)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:26.912255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:26.926878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e3f60-9198-4aec-9f9e-5c72eeb67990 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:26.931597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66407d03-3608-4ca2-8870-771c3bda185e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:26.933152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66407d03-3608-4ca2-8870-771c3bda185e service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:26.933768 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66407d03-3608-4ca2-8870-771c3bda185e service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:26.935165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66407d03-3608-4ca2-8870-771c3bda185e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:26.947248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66407d03-3608-4ca2-8870-771c3bda185e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:26.949285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66407d03-3608-4ca2-8870-771c3bda185e service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:26.977789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1112/2232] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:27.080572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:27.158011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5930e4f2cf4040dbad19faafe86b8a9a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:27.280327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5930e4f2cf4040dbad19faafe86b8a9a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:27.322910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5930e4f2cf4040dbad19faafe86b8a9a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:27.322910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5930e4f2cf4040dbad19faafe86b8a9a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:27.322910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5930e4f2cf4040dbad19faafe86b8a9a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:27.346467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1121/2233] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:26 2022] DELETE /identity/v3/users/5930e4f2cf4040dbad19faafe86b8a9a => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:27.351128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04ce2-0eab-4618-acab-cd200e418cc8 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:27.353766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04ce2-0eab-4618-acab-cd200e418cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:27.353766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04ce2-0eab-4618-acab-cd200e418cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:27.382193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f9d04ce2-0eab-4618-acab-cd200e418cc8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:27.383471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f9d04ce2-0eab-4618-acab-cd200e418cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:27.458761 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1113/2234] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:27.468762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:27.470226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:27.519762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d04ce2-0eab-4618-acab-cd200e418cc8 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:27.521586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f9d04ce2-0eab-4618-acab-cd200e418cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:27.542476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d04ce2-0eab-4618-acab-cd200e418cc8 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:27.553702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:27.553863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e150f7-6c06-474b-ab82-2530897a4d2a admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:27.554344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:27.554668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:27.554942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] PATH_INFO: `/v3/projects/591f88b94f2248fc8f3242c869dd46bc` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:27.556105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591f88b94f2248fc8f3242c869dd46bc)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:27.558017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:27.558927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86d74d-0026-4a6a-b7e6-7d8822069c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:27.561536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86d74d-0026-4a6a-b7e6-7d8822069c32 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:27.561927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86d74d-0026-4a6a-b7e6-7d8822069c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:27.562312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86d74d-0026-4a6a-b7e6-7d8822069c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:27.573698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86d74d-0026-4a6a-b7e6-7d8822069c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:27.575648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86d74d-0026-4a6a-b7e6-7d8822069c32 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:27.586341 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1122/2235] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:27.685983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591f88b94f2248fc8f3242c869dd46bc', 'request_id': 'req-0bb0c8c6-a43b-477a-991a-c070cb229475'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:27.694699 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591f88b94f2248fc8f3242c869dd46bc', 'request_id': 'req-0bb0c8c6-a43b-477a-991a-c070cb229475'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:27.755684 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591f88b94f2248fc8f3242c869dd46bc', 'request_id': 'req-0bb0c8c6-a43b-477a-991a-c070cb229475'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:27.771176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] The token cache is being invalidate because project 591f88b94f2248fc8f3242c869dd46bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:27.771608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:27.772361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:27.777054 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1114/2236] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:27 2022] DELETE /identity/v3/projects/591f88b94f2248fc8f3242c869dd46bc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:27.779952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86d74d-0026-4a6a-b7e6-7d8822069c32 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:27.796798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86d74d-0026-4a6a-b7e6-7d8822069c32 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:27.869629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:27.878418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:27.878418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:27.878418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] PATH_INFO: `/v3/users/5ae30f9d207b477e90fb619304e3d348` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:27.878418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae30f9d207b477e90fb619304e3d348)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:27.878418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:28.039471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:28.041229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:28.059754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0c8c6-a43b-477a-991a-c070cb229475 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:28.066434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:28.068143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:28.068428 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:28.068888 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] PATH_INFO: `/v3/projects/1f4b7053fcda43a69dbfca4dca12c112` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:28.070975 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4b7053fcda43a69dbfca4dca12c112)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:28.075144 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:28.133810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae30f9d207b477e90fb619304e3d348'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.232365 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4b7053fcda43a69dbfca4dca12c112', 'request_id': 'req-96f405ea-c303-4b57-8eee-cd25522ec443'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.237809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4b7053fcda43a69dbfca4dca12c112', 'request_id': 'req-96f405ea-c303-4b57-8eee-cd25522ec443'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.258480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae30f9d207b477e90fb619304e3d348'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.268067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae30f9d207b477e90fb619304e3d348'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.268831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae30f9d207b477e90fb619304e3d348'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.269500 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae30f9d207b477e90fb619304e3d348'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.291044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1123/2237] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:27 2022] DELETE /identity/v3/users/5ae30f9d207b477e90fb619304e3d348 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:28.331406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:28.353609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4b7053fcda43a69dbfca4dca12c112', 'request_id': 'req-96f405ea-c303-4b57-8eee-cd25522ec443'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.377166 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] The token cache is being invalidate because project 1f4b7053fcda43a69dbfca4dca12c112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:28.377457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.378303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.379881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1115/2238] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:28 2022] DELETE /identity/v3/projects/1f4b7053fcda43a69dbfca4dca12c112 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:28.384139 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:28.385932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:28.467609 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496d258-6f88-4531-ba2f-c5b8c6e0359c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:28.473733 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:28.475489 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:28.475489 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:28.475489 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] PATH_INFO: `/v3/users/674a42a7935d4cf39b7da5002b00112a` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:28.476747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] RBAC: Authorizing `identity:delete_user(user_id=674a42a7935d4cf39b7da5002b00112a)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:28.478762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:28.657285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674a42a7935d4cf39b7da5002b00112a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.737579 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674a42a7935d4cf39b7da5002b00112a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.745894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674a42a7935d4cf39b7da5002b00112a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.746920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674a42a7935d4cf39b7da5002b00112a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.747505 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674a42a7935d4cf39b7da5002b00112a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:28.765789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1124/2239] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:28 2022] DELETE /identity/v3/users/674a42a7935d4cf39b7da5002b00112a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:28.937919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:29.174397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:29.175960 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:29.259976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:29.262170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:29.268010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f405ea-c303-4b57-8eee-cd25522ec443 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:29.340020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:29.341409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:29.341697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:29.341975 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58 admin admin] PATH_INFO: `/v3/projects/c72782ddf9f24c0f86bf00eee6b5c1b0` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:29.343214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72782ddf9f24c0f86bf00eee6b5c1b0)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:29.345154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:29.373123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c2a50-a0b8-4044-aafd-1136aacac90d admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:29.378989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe3062-572e-4598-aea6-06cea4d426e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:29.380165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe3062-572e-4598-aea6-06cea4d426e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:29.380607 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe3062-572e-4598-aea6-06cea4d426e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:29.381143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe3062-572e-4598-aea6-06cea4d426e2 admin admin] PATH_INFO: `/v3/projects/a8c769c25c9047d19966fd363d8933b4` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:29.385865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe3062-572e-4598-aea6-06cea4d426e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c769c25c9047d19966fd363d8933b4)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:29.385865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe3062-572e-4598-aea6-06cea4d426e2 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:29.473649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72782ddf9f24c0f86bf00eee6b5c1b0', 'request_id': 'req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:29.479015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72782ddf9f24c0f86bf00eee6b5c1b0', 'request_id': 'req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:29.526619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-bcbe3062-572e-4598-aea6-06cea4d426e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c769c25c9047d19966fd363d8933b4', 'request_id': 'req-bcbe3062-572e-4598-aea6-06cea4d426e2'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:29.531819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:29.588816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72782ddf9f24c0f86bf00eee6b5c1b0', 'request_id': 'req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:29.600583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58 admin admin] The token cache is being invalidate because project c72782ddf9f24c0f86bf00eee6b5c1b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:29.600874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:29.601509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0c4b2062-f0c2-4bd2-b2d2-8661920eca58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:29.603058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1116/2240] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:29 2022] DELETE /identity/v3/projects/c72782ddf9f24c0f86bf00eee6b5c1b0 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:29.607916 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bb59c-927d-4b8b-a5e4-184b1a7b6a1d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:29.608209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bb59c-927d-4b8b-a5e4-184b1a7b6a1d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:29.608493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bb59c-927d-4b8b-a5e4-184b1a7b6a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:29.627824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-9b6bb59c-927d-4b8b-a5e4-184b1a7b6a1d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:29.629026 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9b6bb59c-927d-4b8b-a5e4-184b1a7b6a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:29.667961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-bcbe3062-572e-4598-aea6-06cea4d426e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c769c25c9047d19966fd363d8933b4', 'request_id': 'req-bcbe3062-572e-4598-aea6-06cea4d426e2'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:29.675086 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-bcbe3062-572e-4598-aea6-06cea4d426e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c769c25c9047d19966fd363d8933b4', 'request_id': 'req-bcbe3062-572e-4598-aea6-06cea4d426e2'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:29.690596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-bcbe3062-572e-4598-aea6-06cea4d426e2 admin admin] The token cache is being invalidate because project a8c769c25c9047d19966fd363d8933b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:29.690892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-bcbe3062-572e-4598-aea6-06cea4d426e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:29.691528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-bcbe3062-572e-4598-aea6-06cea4d426e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:29.693249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1125/2241] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:29 2022] DELETE /identity/v3/projects/a8c769c25c9047d19966fd363d8933b4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:29.701856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1117/2242] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:29.708525 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976139e-bf52-44ac-a0b7-ebd0cf92162c None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:29.708938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976139e-bf52-44ac-a0b7-ebd0cf92162c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:29.709293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976139e-bf52-44ac-a0b7-ebd0cf92162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:29.735537 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-4976139e-bf52-44ac-a0b7-ebd0cf92162c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:29.736884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4976139e-bf52-44ac-a0b7-ebd0cf92162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:29.750575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1126/2243] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:29.751606 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bb59c-927d-4b8b-a5e4-184b1a7b6a1d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:29.753127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9b6bb59c-927d-4b8b-a5e4-184b1a7b6a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:29.766131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bb59c-927d-4b8b-a5e4-184b1a7b6a1d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:29.771995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d0af-4f7d-4dc6-a9cb-d29a217cba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:29.772732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d0af-4f7d-4dc6-a9cb-d29a217cba56 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:29.773077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d0af-4f7d-4dc6-a9cb-d29a217cba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:29.777114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d0af-4f7d-4dc6-a9cb-d29a217cba56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:29.777114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38d0af-4f7d-4dc6-a9cb-d29a217cba56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:29.777114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38d0af-4f7d-4dc6-a9cb-d29a217cba56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:29.777114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38d0af-4f7d-4dc6-a9cb-d29a217cba56 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:29.794960 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1118/2244] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:38:29.796391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976139e-bf52-44ac-a0b7-ebd0cf92162c None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:29.806743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976139e-bf52-44ac-a0b7-ebd0cf92162c None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:29.812538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdb25a-a32f-478d-b6e1-68d7cf000616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:29.813296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdb25a-a32f-478d-b6e1-68d7cf000616 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:29.813582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdb25a-a32f-478d-b6e1-68d7cf000616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:29.813859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdb25a-a32f-478d-b6e1-68d7cf000616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:29.814646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdb25a-a32f-478d-b6e1-68d7cf000616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:29.816709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdb25a-a32f-478d-b6e1-68d7cf000616 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:29.928191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1127/2245] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:29 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:29.932468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d0af-4f7d-4dc6-a9cb-d29a217cba56 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:29.943239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d0af-4f7d-4dc6-a9cb-d29a217cba56 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:30.006321 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a936a53-095c-4885-a664-9bc60e54ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:30.007146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a936a53-095c-4885-a664-9bc60e54ba2f admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:30.007430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a936a53-095c-4885-a664-9bc60e54ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:30.007772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a936a53-095c-4885-a664-9bc60e54ba2f admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:30.008447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a936a53-095c-4885-a664-9bc60e54ba2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:30.010431 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a936a53-095c-4885-a664-9bc60e54ba2f admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:30.017605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:30.177588 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1119/2246] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:29 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:30.181690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdb25a-a32f-478d-b6e1-68d7cf000616 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:30.192651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdb25a-a32f-478d-b6e1-68d7cf000616 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:30.197741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1e602-b8d0-454a-81f4-c6ab7825aa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:30.198409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1e602-b8d0-454a-81f4-c6ab7825aa51 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:30.199719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1e602-b8d0-454a-81f4-c6ab7825aa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:30.199719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1e602-b8d0-454a-81f4-c6ab7825aa51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:30.199984 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1e602-b8d0-454a-81f4-c6ab7825aa51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:30.201453 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1e602-b8d0-454a-81f4-c6ab7825aa51 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:30.211757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1128/2247] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:30.216309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a936a53-095c-4885-a664-9bc60e54ba2f admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:30.227816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a936a53-095c-4885-a664-9bc60e54ba2f admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:30.233272 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b06fb4-6762-45a9-be8c-57fff37b8ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:30.233885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b06fb4-6762-45a9-be8c-57fff37b8ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:30.234167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b06fb4-6762-45a9-be8c-57fff37b8ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:30.234441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b06fb4-6762-45a9-be8c-57fff37b8ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:30.235242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b06fb4-6762-45a9-be8c-57fff37b8ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:30.236969 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b06fb4-6762-45a9-be8c-57fff37b8ffa admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:30.247803 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1120/2248] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:30.252150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1e602-b8d0-454a-81f4-c6ab7825aa51 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:30.261974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1e602-b8d0-454a-81f4-c6ab7825aa51 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:30.266644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eb473-19d5-4df4-97e3-d9b1f2a10c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:30.278850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb473-19d5-4df4-97e3-d9b1f2a10c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:30.278850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb473-19d5-4df4-97e3-d9b1f2a10c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:30.278850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb473-19d5-4df4-97e3-d9b1f2a10c4b admin admin] PATH_INFO: `/v3/projects/b6d39781e5b8443eaec27544c00c76b6/users/38ae8cf0cee247299f56bd0520c0f6b5/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:30.282803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733eb473-19d5-4df4-97e3-d9b1f2a10c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d39781e5b8443eaec27544c00c76b6, user_id=38ae8cf0cee247299f56bd0520c0f6b5, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:30.285566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733eb473-19d5-4df4-97e3-d9b1f2a10c4b admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:30.366570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1129/2249] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:30 2022] PUT /identity/v3/projects/b6d39781e5b8443eaec27544c00c76b6/users/38ae8cf0cee247299f56bd0520c0f6b5/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:30.378408 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9ad09-12f4-494e-81c0-001a5042a2c6 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:30.378990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9ad09-12f4-494e-81c0-001a5042a2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:30.379273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9ad09-12f4-494e-81c0-001a5042a2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:30.407743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-cbd9ad09-12f4-494e-81c0-001a5042a2c6 None None] MFA Rules not processed for user `38ae8cf0cee247299f56bd0520c0f6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:30.408962 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cbd9ad09-12f4-494e-81c0-001a5042a2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:30.481733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1121/2250] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:30.486351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eb473-19d5-4df4-97e3-d9b1f2a10c4b admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:30.558800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eb473-19d5-4df4-97e3-d9b1f2a10c4b admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:30.566850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b754-49c6-4834-a694-d5d24f3137d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:30.567949 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b754-49c6-4834-a694-d5d24f3137d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:30.568202 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b754-49c6-4834-a694-d5d24f3137d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:30.568541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535b754-49c6-4834-a694-d5d24f3137d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:30.569158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535b754-49c6-4834-a694-d5d24f3137d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:30.571542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535b754-49c6-4834-a694-d5d24f3137d0 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:30.619300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9ad09-12f4-494e-81c0-001a5042a2c6 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:30.620755 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cbd9ad09-12f4-494e-81c0-001a5042a2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:30.637314 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9ad09-12f4-494e-81c0-001a5042a2c6 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:30.642610 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5877a-2efa-442a-b553-8e7e60a54cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:30.643432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5877a-2efa-442a-b553-8e7e60a54cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:30.643834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5877a-2efa-442a-b553-8e7e60a54cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:30.644113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5877a-2efa-442a-b553-8e7e60a54cdf admin admin] PATH_INFO: `/v3/users/aed9e72ba0ed41ccb2f5623f50cd7431` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:30.645287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5877a-2efa-442a-b553-8e7e60a54cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed9e72ba0ed41ccb2f5623f50cd7431)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:30.647302 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5877a-2efa-442a-b553-8e7e60a54cdf admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:30.677144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1130/2251] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:30 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:30.681468 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b754-49c6-4834-a694-d5d24f3137d0 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:30.726801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:30.746314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535b754-49c6-4834-a694-d5d24f3137d0 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:30.751677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3d242-8c5c-4af9-bd6c-64dc38d45f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:30.752292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3d242-8c5c-4af9-bd6c-64dc38d45f13 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:30.752588 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3d242-8c5c-4af9-bd6c-64dc38d45f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:30.752910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3d242-8c5c-4af9-bd6c-64dc38d45f13 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:30.753574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3d242-8c5c-4af9-bd6c-64dc38d45f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:30.755654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3d242-8c5c-4af9-bd6c-64dc38d45f13 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:30.791062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1b5877a-2efa-442a-b553-8e7e60a54cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed9e72ba0ed41ccb2f5623f50cd7431'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:30.794536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:30.804981 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1b5877a-2efa-442a-b553-8e7e60a54cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed9e72ba0ed41ccb2f5623f50cd7431'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:30.805675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1b5877a-2efa-442a-b553-8e7e60a54cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed9e72ba0ed41ccb2f5623f50cd7431'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:30.812719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1b5877a-2efa-442a-b553-8e7e60a54cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed9e72ba0ed41ccb2f5623f50cd7431'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:30.839311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1131/2252] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:30 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:30.844050 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3d242-8c5c-4af9-bd6c-64dc38d45f13 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:30.845616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a3a3d242-8c5c-4af9-bd6c-64dc38d45f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:30.857406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3d242-8c5c-4af9-bd6c-64dc38d45f13 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:30.862695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d39c8-2898-4667-b149-fbf5e8e33240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:30.863395 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d39c8-2898-4667-b149-fbf5e8e33240 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:30.863683 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d39c8-2898-4667-b149-fbf5e8e33240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:30.864001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d39c8-2898-4667-b149-fbf5e8e33240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:30.864788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d39c8-2898-4667-b149-fbf5e8e33240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:30.866354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d39c8-2898-4667-b149-fbf5e8e33240 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:30.885000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1132/2253] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:30.890069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d39c8-2898-4667-b149-fbf5e8e33240 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:30.901477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d39c8-2898-4667-b149-fbf5e8e33240 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:30.908245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38592e18-f67e-4846-bbe2-5c83d7ac7aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:30.908920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38592e18-f67e-4846-bbe2-5c83d7ac7aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:30.909312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1b5877a-2efa-442a-b553-8e7e60a54cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed9e72ba0ed41ccb2f5623f50cd7431'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:30.909424 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38592e18-f67e-4846-bbe2-5c83d7ac7aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:30.909630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38592e18-f67e-4846-bbe2-5c83d7ac7aa4 admin admin] PATH_INFO: `/v3/projects/f04dbdc89aa64cb9a2066cdf06a23ef2/users/f83d6d838a05473e92d9eca90a881532/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:30.930952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1122/2254] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:30 2022] DELETE /identity/v3/users/aed9e72ba0ed41ccb2f5623f50cd7431 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:30.932568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353e419-c97f-4221-b040-8d241d6113e4 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:30.933164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353e419-c97f-4221-b040-8d241d6113e4 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:30.933463 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353e419-c97f-4221-b040-8d241d6113e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:30.941943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38592e18-f67e-4846-bbe2-5c83d7ac7aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04dbdc89aa64cb9a2066cdf06a23ef2, user_id=f83d6d838a05473e92d9eca90a881532, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:30.944986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38592e18-f67e-4846-bbe2-5c83d7ac7aa4 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:30.956979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2353e419-c97f-4221-b040-8d241d6113e4 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:30.958229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2353e419-c97f-4221-b040-8d241d6113e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:31.026256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1123/2255] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:31.026503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1133/2256] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:30 2022] PUT /identity/v3/projects/f04dbdc89aa64cb9a2066cdf06a23ef2/users/f83d6d838a05473e92d9eca90a881532/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:31.030051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353e419-c97f-4221-b040-8d241d6113e4 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:31.041154 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38592e18-f67e-4846-bbe2-5c83d7ac7aa4 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:31.041584 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353e419-c97f-4221-b040-8d241d6113e4 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:31.044000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-38592e18-f67e-4846-bbe2-5c83d7ac7aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:31.102739 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f794868-5a56-42a4-8e58-ecf31570dafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:31.103409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f794868-5a56-42a4-8e58-ecf31570dafe admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:31.103681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f794868-5a56-42a4-8e58-ecf31570dafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:31.103957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f794868-5a56-42a4-8e58-ecf31570dafe admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:31.104655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f794868-5a56-42a4-8e58-ecf31570dafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:31.106426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f794868-5a56-42a4-8e58-ecf31570dafe admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:31.114069 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38592e18-f67e-4846-bbe2-5c83d7ac7aa4 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:31.120045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1124/2257] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:31.120184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2f3d0-aadd-46e7-966d-a87dc309d854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:31.120184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2f3d0-aadd-46e7-966d-a87dc309d854 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:31.120184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2f3d0-aadd-46e7-966d-a87dc309d854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:31.120184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2f3d0-aadd-46e7-966d-a87dc309d854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:31.120850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f794868-5a56-42a4-8e58-ecf31570dafe admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:31.129516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2f3d0-aadd-46e7-966d-a87dc309d854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:31.131067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f794868-5a56-42a4-8e58-ecf31570dafe admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:31.131195 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2f3d0-aadd-46e7-966d-a87dc309d854 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:31.135867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347f938-265a-4eee-ac04-d0d593235185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:31.136602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347f938-265a-4eee-ac04-d0d593235185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:31.140199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347f938-265a-4eee-ac04-d0d593235185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:31.140199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347f938-265a-4eee-ac04-d0d593235185 admin admin] PATH_INFO: `/v3/projects/f04dbdc89aa64cb9a2066cdf06a23ef2/users/f83d6d838a05473e92d9eca90a881532/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:31.140199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347f938-265a-4eee-ac04-d0d593235185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04dbdc89aa64cb9a2066cdf06a23ef2, user_id=f83d6d838a05473e92d9eca90a881532, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:31.142282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1134/2258] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:38:31.143968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347f938-265a-4eee-ac04-d0d593235185 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:31.156156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1125/2259] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:31 2022] PUT /identity/v3/projects/f04dbdc89aa64cb9a2066cdf06a23ef2/users/f83d6d838a05473e92d9eca90a881532/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:31.171601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4ce1a-1ea4-417d-8d9d-c5fdade55667 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:31.171979 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4ce1a-1ea4-417d-8d9d-c5fdade55667 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:31.172330 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4ce1a-1ea4-417d-8d9d-c5fdade55667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:31.207040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8de4ce1a-1ea4-417d-8d9d-c5fdade55667 None None] MFA Rules not processed for user `f83d6d838a05473e92d9eca90a881532`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:31.208397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8de4ce1a-1ea4-417d-8d9d-c5fdade55667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:31.285197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1135/2260] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:31.301090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347f938-265a-4eee-ac04-d0d593235185 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:31.304013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9347f938-265a-4eee-ac04-d0d593235185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:31.380724 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347f938-265a-4eee-ac04-d0d593235185 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:31.385932 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5051369-0a2d-4e7c-85be-f42895c9d85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:31.387149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5051369-0a2d-4e7c-85be-f42895c9d85c service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:31.388373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5051369-0a2d-4e7c-85be-f42895c9d85c service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:31.388862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5051369-0a2d-4e7c-85be-f42895c9d85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:31.410325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5051369-0a2d-4e7c-85be-f42895c9d85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:31.410325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5051369-0a2d-4e7c-85be-f42895c9d85c service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:31.423741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1126/2261] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:31.670188 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4ce1a-1ea4-417d-8d9d-c5fdade55667 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:31.671814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8de4ce1a-1ea4-417d-8d9d-c5fdade55667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:31.764972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:31.789959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:31.791674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4ce1a-1ea4-417d-8d9d-c5fdade55667 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:31.797717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d3a14-8117-46f2-837a-cd9810b56912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:31.798722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3a14-8117-46f2-837a-cd9810b56912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:31.799151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3a14-8117-46f2-837a-cd9810b56912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:31.799565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3a14-8117-46f2-837a-cd9810b56912 admin admin] PATH_INFO: `/v3/projects/cccdd570ebb94744b20f7d57d9969e2e` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:31.801381 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d3a14-8117-46f2-837a-cd9810b56912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cccdd570ebb94744b20f7d57d9969e2e)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:31.803651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d3a14-8117-46f2-837a-cd9810b56912 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:31.922558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d95d3a14-8117-46f2-837a-cd9810b56912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cccdd570ebb94744b20f7d57d9969e2e', 'request_id': 'req-d95d3a14-8117-46f2-837a-cd9810b56912'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:32.017455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d95d3a14-8117-46f2-837a-cd9810b56912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cccdd570ebb94744b20f7d57d9969e2e', 'request_id': 'req-d95d3a14-8117-46f2-837a-cd9810b56912'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:32.024739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d95d3a14-8117-46f2-837a-cd9810b56912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cccdd570ebb94744b20f7d57d9969e2e', 'request_id': 'req-d95d3a14-8117-46f2-837a-cd9810b56912'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:32.039338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5051369-0a2d-4e7c-85be-f42895c9d85c service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:32.039866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d95d3a14-8117-46f2-837a-cd9810b56912 admin admin] The token cache is being invalidate because project cccdd570ebb94744b20f7d57d9969e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:32.050735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d95d3a14-8117-46f2-837a-cd9810b56912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:32.050735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d95d3a14-8117-46f2-837a-cd9810b56912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:32.051542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:32.052870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1136/2262] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:31 2022] DELETE /identity/v3/projects/cccdd570ebb94744b20f7d57d9969e2e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:32.054221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1de4-ea8c-4020-aa4a-78c3b686203f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:32.054543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1de4-ea8c-4020-aa4a-78c3b686203f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:32.054836 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da1de4-ea8c-4020-aa4a-78c3b686203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:32.055351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5051369-0a2d-4e7c-85be-f42895c9d85c service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:32.078154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:32.103006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-a6da1de4-ea8c-4020-aa4a-78c3b686203f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:32.104478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a6da1de4-ea8c-4020-aa4a-78c3b686203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:32.131336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b80d1d-0392-4b38-8ba5-c2bb3e66d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:32.132073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b80d1d-0392-4b38-8ba5-c2bb3e66d931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:32.132365 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b80d1d-0392-4b38-8ba5-c2bb3e66d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:32.132685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b80d1d-0392-4b38-8ba5-c2bb3e66d931 admin admin] PATH_INFO: `/v3/users/38ae8cf0cee247299f56bd0520c0f6b5` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:32.134011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b80d1d-0392-4b38-8ba5-c2bb3e66d931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ae8cf0cee247299f56bd0520c0f6b5)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:32.136089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b80d1d-0392-4b38-8ba5-c2bb3e66d931 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:32.178156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1137/2263] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:32.187240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095952b3-d9b6-46ff-a4e7-4b8f15ea3e0f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:32.187433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095952b3-d9b6-46ff-a4e7-4b8f15ea3e0f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:32.187668 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095952b3-d9b6-46ff-a4e7-4b8f15ea3e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:32.335260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-56b80d1d-0392-4b38-8ba5-c2bb3e66d931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ae8cf0cee247299f56bd0520c0f6b5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:32.339825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-095952b3-d9b6-46ff-a4e7-4b8f15ea3e0f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:32.342071 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-095952b3-d9b6-46ff-a4e7-4b8f15ea3e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:32.344658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:32.353231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-56b80d1d-0392-4b38-8ba5-c2bb3e66d931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ae8cf0cee247299f56bd0520c0f6b5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:32.353231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-56b80d1d-0392-4b38-8ba5-c2bb3e66d931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ae8cf0cee247299f56bd0520c0f6b5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:32.353434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1138/2264] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:32.354855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095952b3-d9b6-46ff-a4e7-4b8f15ea3e0f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:32.358046 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-56b80d1d-0392-4b38-8ba5-c2bb3e66d931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ae8cf0cee247299f56bd0520c0f6b5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:32.364847 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095952b3-d9b6-46ff-a4e7-4b8f15ea3e0f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:32.369924 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfe88a-9b5f-421b-8840-8425c0f5e1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:32.370660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfe88a-9b5f-421b-8840-8425c0f5e1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:32.370943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfe88a-9b5f-421b-8840-8425c0f5e1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:32.371213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfe88a-9b5f-421b-8840-8425c0f5e1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:32.372536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfe88a-9b5f-421b-8840-8425c0f5e1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:32.372907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfe88a-9b5f-421b-8840-8425c0f5e1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:32.374451 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfe88a-9b5f-421b-8840-8425c0f5e1e8 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:32.386719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1139/2265] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:38:32.391677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfe88a-9b5f-421b-8840-8425c0f5e1e8 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:32.393399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-addfe88a-9b5f-421b-8840-8425c0f5e1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:32.405514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-56b80d1d-0392-4b38-8ba5-c2bb3e66d931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ae8cf0cee247299f56bd0520c0f6b5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:32.405906 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfe88a-9b5f-421b-8840-8425c0f5e1e8 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:32.410562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8b852-7b12-4066-8b7e-525ff65e11c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:32.411299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8b852-7b12-4066-8b7e-525ff65e11c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:32.411582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8b852-7b12-4066-8b7e-525ff65e11c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:32.411857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8b852-7b12-4066-8b7e-525ff65e11c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:32.412537 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8b852-7b12-4066-8b7e-525ff65e11c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:32.412717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1127/2266] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:32 2022] DELETE /identity/v3/users/38ae8cf0cee247299f56bd0520c0f6b5 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:32.414593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8b852-7b12-4066-8b7e-525ff65e11c5 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:32.417212 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165efb60-3c42-4c34-8c05-8530b5cbb1c0 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:32.417514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165efb60-3c42-4c34-8c05-8530b5cbb1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:32.417807 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165efb60-3c42-4c34-8c05-8530b5cbb1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:32.426370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:32.437549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-165efb60-3c42-4c34-8c05-8530b5cbb1c0 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:32.438795 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-165efb60-3c42-4c34-8c05-8530b5cbb1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:32.482231 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1140/2267] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:32 2022] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:38:32.486910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8b852-7b12-4066-8b7e-525ff65e11c5 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:32.507736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1128/2268] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:32.531879 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165efb60-3c42-4c34-8c05-8530b5cbb1c0 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:32.533314 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-165efb60-3c42-4c34-8c05-8530b5cbb1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:32.587010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8b852-7b12-4066-8b7e-525ff65e11c5 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:32.593365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e964f8-3baf-484f-ad70-e25811157f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:32.594025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e964f8-3baf-484f-ad70-e25811157f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:32.594313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e964f8-3baf-484f-ad70-e25811157f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:32.594616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e964f8-3baf-484f-ad70-e25811157f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:32.595293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e964f8-3baf-484f-ad70-e25811157f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:32.597376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e964f8-3baf-484f-ad70-e25811157f65 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:32.627262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165efb60-3c42-4c34-8c05-8530b5cbb1c0 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:32.678220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1141/2269] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:32 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:32.685174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c9015-a807-4274-a3d7-d27ef897a6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:32.685815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c9015-a807-4274-a3d7-d27ef897a6fc service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:32.686100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c9015-a807-4274-a3d7-d27ef897a6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:32.686373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c9015-a807-4274-a3d7-d27ef897a6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:32.688518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e964f8-3baf-484f-ad70-e25811157f65 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:32.695972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c9015-a807-4274-a3d7-d27ef897a6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:32.697475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c9015-a807-4274-a3d7-d27ef897a6fc service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:32.698565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e964f8-3baf-484f-ad70-e25811157f65 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:32.704372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdd97-bff8-4b31-a074-30cfd1226392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:32.705008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdd97-bff8-4b31-a074-30cfd1226392 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:32.705495 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdd97-bff8-4b31-a074-30cfd1226392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:32.705769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdd97-bff8-4b31-a074-30cfd1226392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:32.706468 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffdd97-bff8-4b31-a074-30cfd1226392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:32.708004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1129/2270] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:32.708137 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffdd97-bff8-4b31-a074-30cfd1226392 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:32.719068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1142/2271] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:32.723322 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c9015-a807-4274-a3d7-d27ef897a6fc service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:32.731027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:32.735382 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c9015-a807-4274-a3d7-d27ef897a6fc service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:32.740016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538a6f-60e4-46d7-acf5-6e6cadd55c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:32.740787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538a6f-60e4-46d7-acf5-6e6cadd55c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:32.741070 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538a6f-60e4-46d7-acf5-6e6cadd55c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:32.741396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538a6f-60e4-46d7-acf5-6e6cadd55c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:32.742037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da538a6f-60e4-46d7-acf5-6e6cadd55c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:32.743681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da538a6f-60e4-46d7-acf5-6e6cadd55c43 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:32.754429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:32.757580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1130/2272] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:32.759847 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdd97-bff8-4b31-a074-30cfd1226392 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:32.768904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdd97-bff8-4b31-a074-30cfd1226392 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:32.773897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133c6f3-ec78-43e0-bb9f-237b14051a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:32.774601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133c6f3-ec78-43e0-bb9f-237b14051a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:32.774887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133c6f3-ec78-43e0-bb9f-237b14051a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:32.775203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133c6f3-ec78-43e0-bb9f-237b14051a0a admin admin] PATH_INFO: `/v3/projects/07a784be88cd401192378f67a725e5bf/users/4c21d06d1e06426c94e261a7d4128e49/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:32.790936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133c6f3-ec78-43e0-bb9f-237b14051a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a784be88cd401192378f67a725e5bf, user_id=4c21d06d1e06426c94e261a7d4128e49, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:32.794142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133c6f3-ec78-43e0-bb9f-237b14051a0a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:32.875645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1143/2273] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:32 2022] PUT /identity/v3/projects/07a784be88cd401192378f67a725e5bf/users/4c21d06d1e06426c94e261a7d4128e49/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:32.887217 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659913d-e81a-4c74-a924-5d4d4ce4f924 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:32.887568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659913d-e81a-4c74-a924-5d4d4ce4f924 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:32.887853 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659913d-e81a-4c74-a924-5d4d4ce4f924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:32.923282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-1659913d-e81a-4c74-a924-5d4d4ce4f924 None None] MFA Rules not processed for user `4c21d06d1e06426c94e261a7d4128e49`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:32.924515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1659913d-e81a-4c74-a924-5d4d4ce4f924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:32.998080 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1131/2274] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:33.016614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133c6f3-ec78-43e0-bb9f-237b14051a0a admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:33.016614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6133c6f3-ec78-43e0-bb9f-237b14051a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:33.131048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133c6f3-ec78-43e0-bb9f-237b14051a0a admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:33.139812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb5636-ec01-495e-94bd-79328fe567be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:33.140696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb5636-ec01-495e-94bd-79328fe567be service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:33.140982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb5636-ec01-495e-94bd-79328fe567be service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:33.141255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb5636-ec01-495e-94bd-79328fe567be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:33.155221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb5636-ec01-495e-94bd-79328fe567be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:33.156746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb5636-ec01-495e-94bd-79328fe567be service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:33.170652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1144/2275] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:33.483731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659913d-e81a-4c74-a924-5d4d4ce4f924 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:33.489259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1659913d-e81a-4c74-a924-5d4d4ce4f924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:33.537857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:33.561405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659913d-e81a-4c74-a924-5d4d4ce4f924 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:33.566639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:33.567294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:33.567582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:33.567862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] PATH_INFO: `/v3/projects/b6d39781e5b8443eaec27544c00c76b6` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:33.569072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d39781e5b8443eaec27544c00c76b6)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:33.571035 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:33.727033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d39781e5b8443eaec27544c00c76b6', 'request_id': 'req-dc9942e0-9428-4d25-86a9-366ec11a6708'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:33.732677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d39781e5b8443eaec27544c00c76b6', 'request_id': 'req-dc9942e0-9428-4d25-86a9-366ec11a6708'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:33.828566 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d39781e5b8443eaec27544c00c76b6', 'request_id': 'req-dc9942e0-9428-4d25-86a9-366ec11a6708'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:33.842575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] The token cache is being invalidate because project b6d39781e5b8443eaec27544c00c76b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:33.842878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:33.843519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:33.845067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1132/2276] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:33 2022] DELETE /identity/v3/projects/b6d39781e5b8443eaec27544c00c76b6 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:33.849128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb5636-ec01-495e-94bd-79328fe567be service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:33.862315 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb5636-ec01-495e-94bd-79328fe567be service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:33.926982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56200408-56e1-4c00-9ec1-995d82fabffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:33.926982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56200408-56e1-4c00-9ec1-995d82fabffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:33.926982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56200408-56e1-4c00-9ec1-995d82fabffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:33.926982 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56200408-56e1-4c00-9ec1-995d82fabffd admin admin] PATH_INFO: `/v3/users/f83d6d838a05473e92d9eca90a881532` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:33.927284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56200408-56e1-4c00-9ec1-995d82fabffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83d6d838a05473e92d9eca90a881532)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:33.927646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56200408-56e1-4c00-9ec1-995d82fabffd admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:34.034958 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:34.072998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-56200408-56e1-4c00-9ec1-995d82fabffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83d6d838a05473e92d9eca90a881532'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:34.172153 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-56200408-56e1-4c00-9ec1-995d82fabffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83d6d838a05473e92d9eca90a881532'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:34.181162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-56200408-56e1-4c00-9ec1-995d82fabffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83d6d838a05473e92d9eca90a881532'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:34.182321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-56200408-56e1-4c00-9ec1-995d82fabffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83d6d838a05473e92d9eca90a881532'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:34.183380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-56200408-56e1-4c00-9ec1-995d82fabffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83d6d838a05473e92d9eca90a881532'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:34.204539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1145/2277] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:33 2022] DELETE /identity/v3/users/f83d6d838a05473e92d9eca90a881532 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:34.932302 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:34.933766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:34.956938 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9942e0-9428-4d25-86a9-366ec11a6708 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:35.030739 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a554ccf-def5-4ba4-a81c-bd239e14869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:35.031090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a554ccf-def5-4ba4-a81c-bd239e14869d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.031373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a554ccf-def5-4ba4-a81c-bd239e14869d admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.031649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a554ccf-def5-4ba4-a81c-bd239e14869d admin admin] PATH_INFO: `/v3/projects/f04dbdc89aa64cb9a2066cdf06a23ef2` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.033686 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a554ccf-def5-4ba4-a81c-bd239e14869d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04dbdc89aa64cb9a2066cdf06a23ef2)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:35.035681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a554ccf-def5-4ba4-a81c-bd239e14869d admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:35.154505 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0a554ccf-def5-4ba4-a81c-bd239e14869d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04dbdc89aa64cb9a2066cdf06a23ef2', 'request_id': 'req-0a554ccf-def5-4ba4-a81c-bd239e14869d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.160327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0a554ccf-def5-4ba4-a81c-bd239e14869d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04dbdc89aa64cb9a2066cdf06a23ef2', 'request_id': 'req-0a554ccf-def5-4ba4-a81c-bd239e14869d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.258124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0a554ccf-def5-4ba4-a81c-bd239e14869d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04dbdc89aa64cb9a2066cdf06a23ef2', 'request_id': 'req-0a554ccf-def5-4ba4-a81c-bd239e14869d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.270963 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0a554ccf-def5-4ba4-a81c-bd239e14869d admin admin] The token cache is being invalidate because project f04dbdc89aa64cb9a2066cdf06a23ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:35.271255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0a554ccf-def5-4ba4-a81c-bd239e14869d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.271899 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-0a554ccf-def5-4ba4-a81c-bd239e14869d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.273471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1133/2278] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:34 2022] DELETE /identity/v3/projects/f04dbdc89aa64cb9a2066cdf06a23ef2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:35.278951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76af4f3-d350-430d-b0de-cfd82fd39471 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.279435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76af4f3-d350-430d-b0de-cfd82fd39471 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.279546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76af4f3-d350-430d-b0de-cfd82fd39471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.299519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-d76af4f3-d350-430d-b0de-cfd82fd39471 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:35.300795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d76af4f3-d350-430d-b0de-cfd82fd39471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:35.365668 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1146/2279] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:35.373834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519b5da-96c5-4335-ab66-0b4efcfd0fdc None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.374382 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519b5da-96c5-4335-ab66-0b4efcfd0fdc None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.374790 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519b5da-96c5-4335-ab66-0b4efcfd0fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.395704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-8519b5da-96c5-4335-ab66-0b4efcfd0fdc None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:35.397347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8519b5da-96c5-4335-ab66-0b4efcfd0fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:35.406993 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1134/2280] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:35.411262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76af4f3-d350-430d-b0de-cfd82fd39471 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:35.427561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76af4f3-d350-430d-b0de-cfd82fd39471 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:35.429282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb6747-882c-4c08-a161-fd06e450d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:35.430267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb6747-882c-4c08-a161-fd06e450d7bc admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.430660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb6747-882c-4c08-a161-fd06e450d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.430951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb6747-882c-4c08-a161-fd06e450d7bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.431696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb6747-882c-4c08-a161-fd06e450d7bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:35.432140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb6747-882c-4c08-a161-fd06e450d7bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:35.433911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb6747-882c-4c08-a161-fd06e450d7bc admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:35.452097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1147/2281] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:38:35.455858 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519b5da-96c5-4335-ab66-0b4efcfd0fdc None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:35.466955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519b5da-96c5-4335-ab66-0b4efcfd0fdc None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:35.485653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0f020-80c0-45d9-9cf3-b7610478d77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:35.487148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0f020-80c0-45d9-9cf3-b7610478d77a admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.487717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0f020-80c0-45d9-9cf3-b7610478d77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.488205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0f020-80c0-45d9-9cf3-b7610478d77a admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.489055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0f020-80c0-45d9-9cf3-b7610478d77a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:35.491469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0f020-80c0-45d9-9cf3-b7610478d77a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:35.604947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1135/2282] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:35 2022] POST /identity/v3/projects => generated 359 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:35.611107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb6747-882c-4c08-a161-fd06e450d7bc admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:35.623884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb6747-882c-4c08-a161-fd06e450d7bc admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:35.690107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c925f-a1a4-41f4-8d49-73e01287de09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:35.690663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c925f-a1a4-41f4-8d49-73e01287de09 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.690943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c925f-a1a4-41f4-8d49-73e01287de09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.691214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c925f-a1a4-41f4-8d49-73e01287de09 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.691885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c925f-a1a4-41f4-8d49-73e01287de09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:35.693785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c925f-a1a4-41f4-8d49-73e01287de09 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:35.777376 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:35.812436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1148/2283] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:35 2022] POST /identity/v3/users => generated 280 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:35.816057 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0f020-80c0-45d9-9cf3-b7610478d77a admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:35.826709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0f020-80c0-45d9-9cf3-b7610478d77a admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:35.831728 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b646c-53ec-428b-b5a4-d7d3991f1469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:35.832590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b646c-53ec-428b-b5a4-d7d3991f1469 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.832905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b646c-53ec-428b-b5a4-d7d3991f1469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.833190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b646c-53ec-428b-b5a4-d7d3991f1469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.834010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b646c-53ec-428b-b5a4-d7d3991f1469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:35.835648 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b646c-53ec-428b-b5a4-d7d3991f1469 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:35.849979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1136/2284] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:35.851758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c925f-a1a4-41f4-8d49-73e01287de09 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:35.862014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c925f-a1a4-41f4-8d49-73e01287de09 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:35.866712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777cbbb-d4a7-4ce8-a1d4-d1dc4df7a252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:35.867431 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777cbbb-d4a7-4ce8-a1d4-d1dc4df7a252 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.867739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777cbbb-d4a7-4ce8-a1d4-d1dc4df7a252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.868024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777cbbb-d4a7-4ce8-a1d4-d1dc4df7a252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.868722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777cbbb-d4a7-4ce8-a1d4-d1dc4df7a252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:35.870320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777cbbb-d4a7-4ce8-a1d4-d1dc4df7a252 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:35.880528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1149/2285] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:35.885732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b646c-53ec-428b-b5a4-d7d3991f1469 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:35.896541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b646c-53ec-428b-b5a4-d7d3991f1469 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:35.901952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a61e6-3d8a-4b3e-9a1a-7aa9fb6d7702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:35.902650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a61e6-3d8a-4b3e-9a1a-7aa9fb6d7702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.904181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a61e6-3d8a-4b3e-9a1a-7aa9fb6d7702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.904669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a61e6-3d8a-4b3e-9a1a-7aa9fb6d7702 admin admin] PATH_INFO: `/v3/projects/70e925b1aab14e0f817edae15f03c696/users/195043787ccf44ac956b17150a9fbfb9/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.920283 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a61e6-3d8a-4b3e-9a1a-7aa9fb6d7702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e925b1aab14e0f817edae15f03c696, user_id=195043787ccf44ac956b17150a9fbfb9, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:35.926611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a61e6-3d8a-4b3e-9a1a-7aa9fb6d7702 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:35.971997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bb09d-f425-4852-aefe-900a94e4fb88 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.972291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bb09d-f425-4852-aefe-900a94e4fb88 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.972575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bb09d-f425-4852-aefe-900a94e4fb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.992998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-826bb09d-f425-4852-aefe-900a94e4fb88 None None] MFA Rules not processed for user `8670ec72824549f28b6530a758cbbb01`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:35.994343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-826bb09d-f425-4852-aefe-900a94e4fb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:35.994731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1137/2286] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:35 2022] PUT /identity/v3/projects/70e925b1aab14e0f817edae15f03c696/users/195043787ccf44ac956b17150a9fbfb9/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:36.005122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb67b36-6d8b-4ba7-93f1-93b465ad7503 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:36.005416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb67b36-6d8b-4ba7-93f1-93b465ad7503 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:36.005696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb67b36-6d8b-4ba7-93f1-93b465ad7503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:36.035807 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-8cb67b36-6d8b-4ba7-93f1-93b465ad7503 None None] MFA Rules not processed for user `195043787ccf44ac956b17150a9fbfb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:36.037058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8cb67b36-6d8b-4ba7-93f1-93b465ad7503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:36.053012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1150/2287] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:36.063916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:36.111185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1138/2288] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:36.146730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bb09d-f425-4852-aefe-900a94e4fb88 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:36.148184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-826bb09d-f425-4852-aefe-900a94e4fb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:36.206940 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bb09d-f425-4852-aefe-900a94e4fb88 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:36.210779 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33982e-be80-4f0b-92df-dffd0d1c9883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:36.211398 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33982e-be80-4f0b-92df-dffd0d1c9883 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:36.211686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33982e-be80-4f0b-92df-dffd0d1c9883 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:36.211962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33982e-be80-4f0b-92df-dffd0d1c9883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:36.220784 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33982e-be80-4f0b-92df-dffd0d1c9883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:36.222428 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33982e-be80-4f0b-92df-dffd0d1c9883 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:36.231790 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1151/2289] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:36.248318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb67b36-6d8b-4ba7-93f1-93b465ad7503 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:36.312879 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb67b36-6d8b-4ba7-93f1-93b465ad7503 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:36.317737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:36.318385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:36.318744 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:36.319022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] PATH_INFO: `/v3/users/195043787ccf44ac956b17150a9fbfb9` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:36.320247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195043787ccf44ac956b17150a9fbfb9)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:36.322181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:36.522826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195043787ccf44ac956b17150a9fbfb9'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:36.537381 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195043787ccf44ac956b17150a9fbfb9'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:36.538166 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195043787ccf44ac956b17150a9fbfb9'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:36.547375 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195043787ccf44ac956b17150a9fbfb9'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:36.634719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195043787ccf44ac956b17150a9fbfb9'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:36.643784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1139/2290] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:36 2022] DELETE /identity/v3/users/195043787ccf44ac956b17150a9fbfb9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:36.650172 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1114200-1f43-4ed4-8b08-6fa429881d6b None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:36.650831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1114200-1f43-4ed4-8b08-6fa429881d6b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:36.650831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1114200-1f43-4ed4-8b08-6fa429881d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:36.698927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f1114200-1f43-4ed4-8b08-6fa429881d6b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:36.699270 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f1114200-1f43-4ed4-8b08-6fa429881d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:36.781759 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1152/2291] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:36.790469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:36.792007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:36.863669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207477c7-0f33-459a-8d1e-c8223d2d2197 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:36.867866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f95b74-5572-405e-bc1a-e7ff2268904e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:36.868552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f95b74-5572-405e-bc1a-e7ff2268904e service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:36.868848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f95b74-5572-405e-bc1a-e7ff2268904e service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:36.869129 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f95b74-5572-405e-bc1a-e7ff2268904e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:36.879849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f95b74-5572-405e-bc1a-e7ff2268904e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:36.881316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f95b74-5572-405e-bc1a-e7ff2268904e service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:36.910329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1140/2292] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:37.281886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:37.464126 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:37.659746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1114200-1f43-4ed4-8b08-6fa429881d6b None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:37.661283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f1114200-1f43-4ed4-8b08-6fa429881d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:37.674325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1114200-1f43-4ed4-8b08-6fa429881d6b None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:37.680392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:37.681064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:37.681412 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:37.681599 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a admin admin] PATH_INFO: `/v3/projects/70e925b1aab14e0f817edae15f03c696` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:37.682806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e925b1aab14e0f817edae15f03c696)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:37.685790 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:37.795564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e925b1aab14e0f817edae15f03c696', 'request_id': 'req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:37.845993 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e925b1aab14e0f817edae15f03c696', 'request_id': 'req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:37.852927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e925b1aab14e0f817edae15f03c696', 'request_id': 'req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:37.869271 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a admin admin] The token cache is being invalidate because project 70e925b1aab14e0f817edae15f03c696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:37.869783 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:37.870598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-030ee320-82d7-49f3-8f0e-71fcbfaa0b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:37.873013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1153/2293] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:37 2022] DELETE /identity/v3/projects/70e925b1aab14e0f817edae15f03c696 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:37.877735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08413d-ddff-461b-8cf9-a88e636d29c6 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:37.880472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08413d-ddff-461b-8cf9-a88e636d29c6 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:37.880472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08413d-ddff-461b-8cf9-a88e636d29c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:37.899153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-9a08413d-ddff-461b-8cf9-a88e636d29c6 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:37.903364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9a08413d-ddff-461b-8cf9-a88e636d29c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:37.971241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1141/2294] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:37.974373 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3dafc-8adb-4836-9d62-0a82a165bb14 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:37.974878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3dafc-8adb-4836-9d62-0a82a165bb14 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:37.975169 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3dafc-8adb-4836-9d62-0a82a165bb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:37.998633 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6ed3dafc-8adb-4836-9d62-0a82a165bb14 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:38.000682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6ed3dafc-8adb-4836-9d62-0a82a165bb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:38.009172 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1154/2295] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:38.013614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08413d-ddff-461b-8cf9-a88e636d29c6 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:38.023950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08413d-ddff-461b-8cf9-a88e636d29c6 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:38.029231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a1041-39c7-4113-9c15-f26773672178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:38.029880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a1041-39c7-4113-9c15-f26773672178 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:38.030167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a1041-39c7-4113-9c15-f26773672178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:38.030613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a1041-39c7-4113-9c15-f26773672178 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:38.031325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a1041-39c7-4113-9c15-f26773672178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:38.031639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a1041-39c7-4113-9c15-f26773672178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:38.033424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a1041-39c7-4113-9c15-f26773672178 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:38.049259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1142/2296] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:38:38.053495 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3dafc-8adb-4836-9d62-0a82a165bb14 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:38.064479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3dafc-8adb-4836-9d62-0a82a165bb14 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:38.069246 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e452f0f-9bce-4139-b7ba-afb14b5c3254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:38.069909 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452f0f-9bce-4139-b7ba-afb14b5c3254 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:38.070518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452f0f-9bce-4139-b7ba-afb14b5c3254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:38.070518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452f0f-9bce-4139-b7ba-afb14b5c3254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:38.071209 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e452f0f-9bce-4139-b7ba-afb14b5c3254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:38.073216 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e452f0f-9bce-4139-b7ba-afb14b5c3254 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:38.208440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1155/2297] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:38 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:38:38.212372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a1041-39c7-4113-9c15-f26773672178 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:38.223499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a1041-39c7-4113-9c15-f26773672178 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:38.299744 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e40dc3-75d0-4298-a0a6-fc18720816b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:38.300422 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e40dc3-75d0-4298-a0a6-fc18720816b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:38.300701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e40dc3-75d0-4298-a0a6-fc18720816b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:38.300971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e40dc3-75d0-4298-a0a6-fc18720816b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:38.301660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e40dc3-75d0-4298-a0a6-fc18720816b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:38.303598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e40dc3-75d0-4298-a0a6-fc18720816b7 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:38.410791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1143/2298] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:38 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:38:38.414558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e452f0f-9bce-4139-b7ba-afb14b5c3254 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:38.425880 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e452f0f-9bce-4139-b7ba-afb14b5c3254 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:38.430559 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f086313-ece9-4409-bea6-39ffcf731b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:38.431171 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f086313-ece9-4409-bea6-39ffcf731b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:38.431458 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f086313-ece9-4409-bea6-39ffcf731b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:38.431735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f086313-ece9-4409-bea6-39ffcf731b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:38.432437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f086313-ece9-4409-bea6-39ffcf731b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:38.434052 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f086313-ece9-4409-bea6-39ffcf731b22 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:38.444165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1156/2299] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:38.449588 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e40dc3-75d0-4298-a0a6-fc18720816b7 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:38.461510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e40dc3-75d0-4298-a0a6-fc18720816b7 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:38.467328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31538abb-fa9d-473c-87ca-a716e894fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:38.468202 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31538abb-fa9d-473c-87ca-a716e894fa4e admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:38.468480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31538abb-fa9d-473c-87ca-a716e894fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:38.475442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31538abb-fa9d-473c-87ca-a716e894fa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:38.475442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31538abb-fa9d-473c-87ca-a716e894fa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:38.475442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31538abb-fa9d-473c-87ca-a716e894fa4e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:38.484385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1144/2300] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:38.488598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f086313-ece9-4409-bea6-39ffcf731b22 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:38.499613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f086313-ece9-4409-bea6-39ffcf731b22 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:38.504617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248286b6-3df7-408e-8b97-967d25168627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:38.505294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248286b6-3df7-408e-8b97-967d25168627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:38.505604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248286b6-3df7-408e-8b97-967d25168627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:38.505884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248286b6-3df7-408e-8b97-967d25168627 admin admin] PATH_INFO: `/v3/projects/8d5939a7ff1f40bbbdee63083b4d32ed/users/2c0593b380a442d49e6807328662a5dc/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:38.522284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248286b6-3df7-408e-8b97-967d25168627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5939a7ff1f40bbbdee63083b4d32ed, user_id=2c0593b380a442d49e6807328662a5dc, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:38.525295 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248286b6-3df7-408e-8b97-967d25168627 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:38.631493 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1157/2301] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:38 2022] PUT /identity/v3/projects/8d5939a7ff1f40bbbdee63083b4d32ed/users/2c0593b380a442d49e6807328662a5dc/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:38.649412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b6c20-6dd9-453e-81d6-8a1877ecaf9f None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:38.650059 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b6c20-6dd9-453e-81d6-8a1877ecaf9f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:38.650545 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b6c20-6dd9-453e-81d6-8a1877ecaf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:38.680899 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:38.692610 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-c64b6c20-6dd9-453e-81d6-8a1877ecaf9f None None] MFA Rules not processed for user `2c0593b380a442d49e6807328662a5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:38.693847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c64b6c20-6dd9-453e-81d6-8a1877ecaf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:38.763412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1145/2302] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:38.768109 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248286b6-3df7-408e-8b97-967d25168627 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:38.835452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248286b6-3df7-408e-8b97-967d25168627 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:38.840503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f08de7-9ae8-4bfa-b706-9b229cc5a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:38.841159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f08de7-9ae8-4bfa-b706-9b229cc5a9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:38.841448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f08de7-9ae8-4bfa-b706-9b229cc5a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:38.841727 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f08de7-9ae8-4bfa-b706-9b229cc5a9c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:38.842402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f08de7-9ae8-4bfa-b706-9b229cc5a9c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:38.844672 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f08de7-9ae8-4bfa-b706-9b229cc5a9c6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:38.846255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:38.927403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1158/2303] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:38 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:38.928568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b6c20-6dd9-453e-81d6-8a1877ecaf9f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:38.942887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b6c20-6dd9-453e-81d6-8a1877ecaf9f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:39.031675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c93f3-bada-4d55-aba7-661743c11f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:39.033632 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c93f3-bada-4d55-aba7-661743c11f56 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:39.033632 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c93f3-bada-4d55-aba7-661743c11f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:39.033632 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c93f3-bada-4d55-aba7-661743c11f56 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:39.033908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c93f3-bada-4d55-aba7-661743c11f56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:39.036069 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c93f3-bada-4d55-aba7-661743c11f56 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:39.161111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1146/2304] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:38 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:39.165181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f08de7-9ae8-4bfa-b706-9b229cc5a9c6 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:39.176941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f08de7-9ae8-4bfa-b706-9b229cc5a9c6 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:39.181853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae627e5-437f-4466-9bb5-67dcf0b8a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:39.182478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae627e5-437f-4466-9bb5-67dcf0b8a007 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:39.182793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae627e5-437f-4466-9bb5-67dcf0b8a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:39.183075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae627e5-437f-4466-9bb5-67dcf0b8a007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:39.186637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae627e5-437f-4466-9bb5-67dcf0b8a007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:39.186637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae627e5-437f-4466-9bb5-67dcf0b8a007 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:39.199052 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1159/2305] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:39.203098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c93f3-bada-4d55-aba7-661743c11f56 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:39.213255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c93f3-bada-4d55-aba7-661743c11f56 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:39.218684 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a30657-283c-438a-a2ad-97dae0587faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:39.219310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a30657-283c-438a-a2ad-97dae0587faf admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:39.219595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a30657-283c-438a-a2ad-97dae0587faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:39.219876 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a30657-283c-438a-a2ad-97dae0587faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:39.220607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a30657-283c-438a-a2ad-97dae0587faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:39.222225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a30657-283c-438a-a2ad-97dae0587faf admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:39.237148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1147/2306] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:39.238652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae627e5-437f-4466-9bb5-67dcf0b8a007 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:39.250107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae627e5-437f-4466-9bb5-67dcf0b8a007 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:39.255144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1596ff-b631-4cfb-a8a9-7acd41d5a0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:39.256081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1596ff-b631-4cfb-a8a9-7acd41d5a0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:39.256305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1596ff-b631-4cfb-a8a9-7acd41d5a0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:39.256604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1596ff-b631-4cfb-a8a9-7acd41d5a0c4 admin admin] PATH_INFO: `/v3/projects/7a9254b6f0c34ea7896655c093df8450/users/426364263eac4885944422e8ba6ca07d/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:39.272205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1596ff-b631-4cfb-a8a9-7acd41d5a0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9254b6f0c34ea7896655c093df8450, user_id=426364263eac4885944422e8ba6ca07d, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:39.275005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1596ff-b631-4cfb-a8a9-7acd41d5a0c4 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:39.297717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:39.373004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1160/2307] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:39 2022] PUT /identity/v3/projects/7a9254b6f0c34ea7896655c093df8450/users/426364263eac4885944422e8ba6ca07d/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:39.384070 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71e7a-dcb2-4622-8f1a-bf3ec6a54106 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:39.384364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71e7a-dcb2-4622-8f1a-bf3ec6a54106 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:39.384642 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71e7a-dcb2-4622-8f1a-bf3ec6a54106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:39.416260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-64e71e7a-dcb2-4622-8f1a-bf3ec6a54106 None None] MFA Rules not processed for user `426364263eac4885944422e8ba6ca07d`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:39.417487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-64e71e7a-dcb2-4622-8f1a-bf3ec6a54106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:39.452610 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:39.487763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1148/2308] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:39.492529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1596ff-b631-4cfb-a8a9-7acd41d5a0c4 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:39.563664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1596ff-b631-4cfb-a8a9-7acd41d5a0c4 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:39.568967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe29981-e6c9-4741-8174-f0ceeffaee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:39.569614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe29981-e6c9-4741-8174-f0ceeffaee42 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:39.570163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe29981-e6c9-4741-8174-f0ceeffaee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:39.570440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe29981-e6c9-4741-8174-f0ceeffaee42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:39.571173 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe29981-e6c9-4741-8174-f0ceeffaee42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:39.573148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe29981-e6c9-4741-8174-f0ceeffaee42 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:39.648021 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1161/2309] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:39 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:38:39.652510 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e71e7a-dcb2-4622-8f1a-bf3ec6a54106 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:39.656610 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:39.667218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e71e7a-dcb2-4622-8f1a-bf3ec6a54106 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:39.699391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:39.740261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05915cde-7bc1-415c-af25-09402a663dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:39.740987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05915cde-7bc1-415c-af25-09402a663dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:39.741496 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05915cde-7bc1-415c-af25-09402a663dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:39.747573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05915cde-7bc1-415c-af25-09402a663dfe admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:39.749013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05915cde-7bc1-415c-af25-09402a663dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:39.752829 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05915cde-7bc1-415c-af25-09402a663dfe admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:39.861569 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1149/2310] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:39 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:39.861663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe29981-e6c9-4741-8174-f0ceeffaee42 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:39.877726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe29981-e6c9-4741-8174-f0ceeffaee42 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:39.883662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e35e0-7ad4-439d-a593-c9dbfc1d5678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:39.884520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e35e0-7ad4-439d-a593-c9dbfc1d5678 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:39.885013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e35e0-7ad4-439d-a593-c9dbfc1d5678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:39.894604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e35e0-7ad4-439d-a593-c9dbfc1d5678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:39.894604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e35e0-7ad4-439d-a593-c9dbfc1d5678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:39.894604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e35e0-7ad4-439d-a593-c9dbfc1d5678 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:39.906446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1162/2311] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:39.910827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05915cde-7bc1-415c-af25-09402a663dfe admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:39.922438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05915cde-7bc1-415c-af25-09402a663dfe admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:39.934856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7607d7-462c-4822-a6c1-d697f94441da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:39.935300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7607d7-462c-4822-a6c1-d697f94441da admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:39.935694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7607d7-462c-4822-a6c1-d697f94441da admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:39.935968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7607d7-462c-4822-a6c1-d697f94441da admin admin] PATH_INFO: `/v3/projects/19f6680130604827adfd5d3d34362998/users/1207996529ae448bbc1d28020d0ce20c/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:39.964942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7607d7-462c-4822-a6c1-d697f94441da admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f6680130604827adfd5d3d34362998, user_id=1207996529ae448bbc1d28020d0ce20c, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:39.967577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7607d7-462c-4822-a6c1-d697f94441da admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:40.056826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1150/2312] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:39 2022] PUT /identity/v3/projects/19f6680130604827adfd5d3d34362998/users/1207996529ae448bbc1d28020d0ce20c/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:38:40.058996 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e35e0-7ad4-439d-a593-c9dbfc1d5678 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:40.099930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:40.103355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e35e0-7ad4-439d-a593-c9dbfc1d5678 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:40.132542 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:40.254134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831ac4a-8872-4935-a6b6-39e0789113c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:40.255206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ac4a-8872-4935-a6b6-39e0789113c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:40.255889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ac4a-8872-4935-a6b6-39e0789113c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:40.256514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ac4a-8872-4935-a6b6-39e0789113c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:40.257566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831ac4a-8872-4935-a6b6-39e0789113c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:40.259523 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831ac4a-8872-4935-a6b6-39e0789113c6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:40.273813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1163/2313] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:40.277733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7607d7-462c-4822-a6c1-d697f94441da admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:40.296418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7607d7-462c-4822-a6c1-d697f94441da admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:40.301989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b56131-6b18-4a72-bfbe-7625caf9d3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:40.304190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b56131-6b18-4a72-bfbe-7625caf9d3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:40.304535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b56131-6b18-4a72-bfbe-7625caf9d3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:40.305635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b56131-6b18-4a72-bfbe-7625caf9d3ec admin admin] PATH_INFO: `/v3/projects/19f6680130604827adfd5d3d34362998/users/1207996529ae448bbc1d28020d0ce20c/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:40.308047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b56131-6b18-4a72-bfbe-7625caf9d3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f6680130604827adfd5d3d34362998, user_id=1207996529ae448bbc1d28020d0ce20c, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:40.311278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b56131-6b18-4a72-bfbe-7625caf9d3ec admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:40.325752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1151/2314] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:40 2022] PUT /identity/v3/projects/19f6680130604827adfd5d3d34362998/users/1207996529ae448bbc1d28020d0ce20c/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:40.345221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46130a54-aa6b-428f-b706-b4dbe1de1d54 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:40.345221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46130a54-aa6b-428f-b706-b4dbe1de1d54 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:40.345221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46130a54-aa6b-428f-b706-b4dbe1de1d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:40.391163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-46130a54-aa6b-428f-b706-b4dbe1de1d54 None None] MFA Rules not processed for user `1207996529ae448bbc1d28020d0ce20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:40.393131 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-46130a54-aa6b-428f-b706-b4dbe1de1d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:40.517233 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:40.572825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1164/2315] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:40.588448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b56131-6b18-4a72-bfbe-7625caf9d3ec admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:40.591487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-04b56131-6b18-4a72-bfbe-7625caf9d3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:40.606961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:40.693620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b56131-6b18-4a72-bfbe-7625caf9d3ec admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:40.698772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3dee4-8172-4938-a658-fae009d88de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:40.704862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3dee4-8172-4938-a658-fae009d88de8 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:40.704862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3dee4-8172-4938-a658-fae009d88de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:40.704862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3dee4-8172-4938-a658-fae009d88de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:40.901676 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3dee4-8172-4938-a658-fae009d88de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:40.904562 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3dee4-8172-4938-a658-fae009d88de8 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:40.921644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1152/2316] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:40.937960 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:43.294163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46130a54-aa6b-428f-b706-b4dbe1de1d54 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:43.304600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46130a54-aa6b-428f-b706-b4dbe1de1d54 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:43.308695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b2f1a-e3a5-435e-bbe8-97b1f893f17f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:43.310045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b2f1a-e3a5-435e-bbe8-97b1f893f17f service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:43.310437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b2f1a-e3a5-435e-bbe8-97b1f893f17f service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:43.310850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b2f1a-e3a5-435e-bbe8-97b1f893f17f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:43.376122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b2f1a-e3a5-435e-bbe8-97b1f893f17f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:43.377596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b2f1a-e3a5-435e-bbe8-97b1f893f17f service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:43.389055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1165/2317] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:44.877701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3dee4-8172-4938-a658-fae009d88de8 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:44.886236 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3dee4-8172-4938-a658-fae009d88de8 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:44.890740 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acfded-2bc9-4eba-9a99-7cd6fd219ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:44.891352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acfded-2bc9-4eba-9a99-7cd6fd219ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:44.893285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acfded-2bc9-4eba-9a99-7cd6fd219ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:44.893285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acfded-2bc9-4eba-9a99-7cd6fd219ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:44.901496 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acfded-2bc9-4eba-9a99-7cd6fd219ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:44.903898 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acfded-2bc9-4eba-9a99-7cd6fd219ba7 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:44.913722 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1153/2318] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:45.725833 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b2f1a-e3a5-435e-bbe8-97b1f893f17f service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:45.727317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-402b2f1a-e3a5-435e-bbe8-97b1f893f17f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:45.793318 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b2f1a-e3a5-435e-bbe8-97b1f893f17f service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:45.798022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:45.798709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:45.799000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:45.799279 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] PATH_INFO: `/v3/users/4c21d06d1e06426c94e261a7d4128e49` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:45.800438 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c21d06d1e06426c94e261a7d4128e49)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:45.802419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:45.975612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c21d06d1e06426c94e261a7d4128e49'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:46.063494 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c21d06d1e06426c94e261a7d4128e49'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:46.070229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:46.079745 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c21d06d1e06426c94e261a7d4128e49'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:46.079745 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c21d06d1e06426c94e261a7d4128e49'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:46.079745 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c21d06d1e06426c94e261a7d4128e49'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:46.096656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1166/2319] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:45 2022] DELETE /identity/v3/users/4c21d06d1e06426c94e261a7d4128e49 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:46.101059 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa482a-6573-4bdd-94fa-78ce41330ea5 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:46.102703 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa482a-6573-4bdd-94fa-78ce41330ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:46.102703 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa482a-6573-4bdd-94fa-78ce41330ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:46.120650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-3cfa482a-6573-4bdd-94fa-78ce41330ea5 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:46.122618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3cfa482a-6573-4bdd-94fa-78ce41330ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:46.198746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1154/2320] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:46.210222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:46.212503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:46.282362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412701c9-62bb-4696-ac37-542368088402 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:46.287672 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266532a-3cc4-4e3d-9232-f1624b123668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:46.288305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266532a-3cc4-4e3d-9232-f1624b123668 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:46.288593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266532a-3cc4-4e3d-9232-f1624b123668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:46.289052 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266532a-3cc4-4e3d-9232-f1624b123668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:46.302113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266532a-3cc4-4e3d-9232-f1624b123668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:46.303996 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266532a-3cc4-4e3d-9232-f1624b123668 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:46.314715 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1167/2321] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:38:46.722430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa482a-6573-4bdd-94fa-78ce41330ea5 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:46.723895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3cfa482a-6573-4bdd-94fa-78ce41330ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:46.736787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa482a-6573-4bdd-94fa-78ce41330ea5 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:46.742799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:46.743452 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:46.743734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:46.744015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2 admin admin] PATH_INFO: `/v3/projects/07a784be88cd401192378f67a725e5bf` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:46.745201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a784be88cd401192378f67a725e5bf)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:46.747933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:46.996456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a784be88cd401192378f67a725e5bf', 'request_id': 'req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:47.002864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a784be88cd401192378f67a725e5bf', 'request_id': 'req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:47.074866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a784be88cd401192378f67a725e5bf', 'request_id': 'req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:47.087577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2 admin admin] The token cache is being invalidate because project 07a784be88cd401192378f67a725e5bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:47.087985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:47.088718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-e415fdd3-87ee-4f4c-b11e-9e622426c2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:47.090352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1155/2322] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:46 2022] DELETE /identity/v3/projects/07a784be88cd401192378f67a725e5bf => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:47.096000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b0361-7ce0-447c-973a-70fcf3fcef2b None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:47.101522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b0361-7ce0-447c-973a-70fcf3fcef2b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:47.101522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b0361-7ce0-447c-973a-70fcf3fcef2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:47.118266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-706b0361-7ce0-447c-973a-70fcf3fcef2b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:47.119958 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-706b0361-7ce0-447c-973a-70fcf3fcef2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:47.196261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1168/2323] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:47.204763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aba375-55b8-4d55-afbd-e5ab93ac6294 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:47.205605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aba375-55b8-4d55-afbd-e5ab93ac6294 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:47.205884 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aba375-55b8-4d55-afbd-e5ab93ac6294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:47.226679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-26aba375-55b8-4d55-afbd-e5ab93ac6294 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:47.228108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-26aba375-55b8-4d55-afbd-e5ab93ac6294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:47.237203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1156/2324] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:47.241718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b0361-7ce0-447c-973a-70fcf3fcef2b None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:47.252240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b0361-7ce0-447c-973a-70fcf3fcef2b None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:47.257629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2539c2-ed33-4600-b961-b751a09cfc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:47.258274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2539c2-ed33-4600-b961-b751a09cfc2c admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:47.258587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2539c2-ed33-4600-b961-b751a09cfc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:47.259074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2539c2-ed33-4600-b961-b751a09cfc2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:47.261916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2539c2-ed33-4600-b961-b751a09cfc2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:47.261916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2539c2-ed33-4600-b961-b751a09cfc2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:47.261916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2539c2-ed33-4600-b961-b751a09cfc2c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:47.275953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1169/2325] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:38:47.281997 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aba375-55b8-4d55-afbd-e5ab93ac6294 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:47.292250 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aba375-55b8-4d55-afbd-e5ab93ac6294 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:47.297672 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b17ff5-76b8-443f-80cc-5e3e46312fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:47.298294 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b17ff5-76b8-443f-80cc-5e3e46312fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:47.298657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b17ff5-76b8-443f-80cc-5e3e46312fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:47.298938 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b17ff5-76b8-443f-80cc-5e3e46312fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:47.299734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b17ff5-76b8-443f-80cc-5e3e46312fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:47.301778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b17ff5-76b8-443f-80cc-5e3e46312fdf admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:47.409130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1157/2326] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:47 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:47.413243 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2539c2-ed33-4600-b961-b751a09cfc2c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:47.425504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2539c2-ed33-4600-b961-b751a09cfc2c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:47.489647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e3818-bbff-4112-a594-ca24d785723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:47.490401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3818-bbff-4112-a594-ca24d785723a admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:47.490730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3818-bbff-4112-a594-ca24d785723a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:47.491008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3818-bbff-4112-a594-ca24d785723a admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:47.491815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e3818-bbff-4112-a594-ca24d785723a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:47.493868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e3818-bbff-4112-a594-ca24d785723a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:47.561020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:47.567442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1170/2327] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:47 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:47.571382 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b17ff5-76b8-443f-80cc-5e3e46312fdf admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:47.583037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b17ff5-76b8-443f-80cc-5e3e46312fdf admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:47.588029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bd7a6-f6c3-47e9-81c7-d00c4392a7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:47.588650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bd7a6-f6c3-47e9-81c7-d00c4392a7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:47.590461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bd7a6-f6c3-47e9-81c7-d00c4392a7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:47.590461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bd7a6-f6c3-47e9-81c7-d00c4392a7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:47.590461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bd7a6-f6c3-47e9-81c7-d00c4392a7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:47.591673 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bd7a6-f6c3-47e9-81c7-d00c4392a7e2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:47.602158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1158/2328] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:47.606224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e3818-bbff-4112-a594-ca24d785723a admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:47.616296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e3818-bbff-4112-a594-ca24d785723a admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:47.621256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e31f7-b140-45c7-9010-bd7c7465e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:47.622451 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e31f7-b140-45c7-9010-bd7c7465e190 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:47.622885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e31f7-b140-45c7-9010-bd7c7465e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:47.623173 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e31f7-b140-45c7-9010-bd7c7465e190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:47.623868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e31f7-b140-45c7-9010-bd7c7465e190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:47.625462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e31f7-b140-45c7-9010-bd7c7465e190 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:47.636109 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1171/2329] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:47.647779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bd7a6-f6c3-47e9-81c7-d00c4392a7e2 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:47.658385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bd7a6-f6c3-47e9-81c7-d00c4392a7e2 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:47.662985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00373ae-c56f-4602-9b5c-f6057dbdfc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:47.663646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00373ae-c56f-4602-9b5c-f6057dbdfc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:47.663929 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00373ae-c56f-4602-9b5c-f6057dbdfc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:47.664208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00373ae-c56f-4602-9b5c-f6057dbdfc65 admin admin] PATH_INFO: `/v3/projects/a49dcb863cd24a3cab8162c18ddf78f0/users/5091a0547e964c6d80b947191072e809/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:47.678583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00373ae-c56f-4602-9b5c-f6057dbdfc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49dcb863cd24a3cab8162c18ddf78f0, user_id=5091a0547e964c6d80b947191072e809, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:47.681216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00373ae-c56f-4602-9b5c-f6057dbdfc65 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:47.751610 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:47.758363 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1159/2330] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:47 2022] PUT /identity/v3/projects/a49dcb863cd24a3cab8162c18ddf78f0/users/5091a0547e964c6d80b947191072e809/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:47.761953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a0f49-4e5b-4a5e-b1b4-221fb52d6619 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:47.762255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a0f49-4e5b-4a5e-b1b4-221fb52d6619 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:47.762587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a0f49-4e5b-4a5e-b1b4-221fb52d6619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:47.782557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9c7a0f49-4e5b-4a5e-b1b4-221fb52d6619 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:47.783773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9c7a0f49-4e5b-4a5e-b1b4-221fb52d6619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:47.846092 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1172/2331] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:47.855928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00373ae-c56f-4602-9b5c-f6057dbdfc65 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:47.858170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d00373ae-c56f-4602-9b5c-f6057dbdfc65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:47.922821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00373ae-c56f-4602-9b5c-f6057dbdfc65 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:47.926414 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44965ea5-84aa-4748-ae51-c9c3d607433c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:47.927093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44965ea5-84aa-4748-ae51-c9c3d607433c service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:47.927377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44965ea5-84aa-4748-ae51-c9c3d607433c service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:47.927705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44965ea5-84aa-4748-ae51-c9c3d607433c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:47.937453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44965ea5-84aa-4748-ae51-c9c3d607433c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:47.938935 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44965ea5-84aa-4748-ae51-c9c3d607433c service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:47.948758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1160/2332] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:47.989961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2067c24-ec1c-4e9e-bc4b-cf0553a2ffdd None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:47.990499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2067c24-ec1c-4e9e-bc4b-cf0553a2ffdd None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:47.990824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2067c24-ec1c-4e9e-bc4b-cf0553a2ffdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:48.013730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e2067c24-ec1c-4e9e-bc4b-cf0553a2ffdd None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:48.014979 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e2067c24-ec1c-4e9e-bc4b-cf0553a2ffdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:48.074015 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1173/2333] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:38:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:48.126523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44965ea5-84aa-4748-ae51-c9c3d607433c service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:48.135373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-44965ea5-84aa-4748-ae51-c9c3d607433c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:48.220143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44965ea5-84aa-4748-ae51-c9c3d607433c service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:48.227624 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6195c55-e435-4cf0-be3c-b7bf865ff31b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:48.228258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6195c55-e435-4cf0-be3c-b7bf865ff31b service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:48.228573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6195c55-e435-4cf0-be3c-b7bf865ff31b service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:48.228987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6195c55-e435-4cf0-be3c-b7bf865ff31b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:48.238403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6195c55-e435-4cf0-be3c-b7bf865ff31b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:48.240090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6195c55-e435-4cf0-be3c-b7bf865ff31b service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:48.248183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1161/2334] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:38:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:38:49.562437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2067c24-ec1c-4e9e-bc4b-cf0553a2ffdd None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:49.564144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e2067c24-ec1c-4e9e-bc4b-cf0553a2ffdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:49.595931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2067c24-ec1c-4e9e-bc4b-cf0553a2ffdd None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:49.603524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:49.607137 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:49.607539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:49.607936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] PATH_INFO: `/v3/users/2c0593b380a442d49e6807328662a5dc` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:49.610397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c0593b380a442d49e6807328662a5dc)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:49.617600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:49.846508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c0593b380a442d49e6807328662a5dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:49.937879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c0593b380a442d49e6807328662a5dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:49.947131 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c0593b380a442d49e6807328662a5dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:49.951427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c0593b380a442d49e6807328662a5dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:49.952348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c0593b380a442d49e6807328662a5dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:50.039119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1174/2335] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:49 2022] DELETE /identity/v3/users/2c0593b380a442d49e6807328662a5dc => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:50.039274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb57913-e812-4fe1-bba9-244ff277377b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:50.039274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb57913-e812-4fe1-bba9-244ff277377b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:50.039274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb57913-e812-4fe1-bba9-244ff277377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:50.113316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-6cb57913-e812-4fe1-bba9-244ff277377b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:50.114772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-6cb57913-e812-4fe1-bba9-244ff277377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:50.226022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1162/2336] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:50.238040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:50.239722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:50.247206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:50.323724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43227a-750b-4961-8cb7-fd08cd49fea5 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:50.330654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab568d8-e2dc-4ef0-8629-bb5a2af9ffcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:50.331290 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab568d8-e2dc-4ef0-8629-bb5a2af9ffcd service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:50.331879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab568d8-e2dc-4ef0-8629-bb5a2af9ffcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:50.332186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab568d8-e2dc-4ef0-8629-bb5a2af9ffcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:50.346434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab568d8-e2dc-4ef0-8629-bb5a2af9ffcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:50.346434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab568d8-e2dc-4ef0-8629-bb5a2af9ffcd service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:50.359486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1175/2337] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:51.167685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb57913-e812-4fe1-bba9-244ff277377b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:51.170617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-6cb57913-e812-4fe1-bba9-244ff277377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:51.195442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb57913-e812-4fe1-bba9-244ff277377b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:51.203240 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:51.204202 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:51.204758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:51.205262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] PATH_INFO: `/v3/projects/8d5939a7ff1f40bbbdee63083b4d32ed` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:51.206734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d5939a7ff1f40bbbdee63083b4d32ed)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:51.216142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:51.361611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:51.428965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d5939a7ff1f40bbbdee63083b4d32ed', 'request_id': 'req-565a97ae-294d-4812-95e4-8a3e4c35f4bd'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:51.436633 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d5939a7ff1f40bbbdee63083b4d32ed', 'request_id': 'req-565a97ae-294d-4812-95e4-8a3e4c35f4bd'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:51.549073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d5939a7ff1f40bbbdee63083b4d32ed', 'request_id': 'req-565a97ae-294d-4812-95e4-8a3e4c35f4bd'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:51.566084 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] The token cache is being invalidate because project 8d5939a7ff1f40bbbdee63083b4d32ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:51.566387 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:51.567208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:51.572161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1163/2338] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:51 2022] DELETE /identity/v3/projects/8d5939a7ff1f40bbbdee63083b4d32ed => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:51.575439 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab568d8-e2dc-4ef0-8629-bb5a2af9ffcd service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:51.590105 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab568d8-e2dc-4ef0-8629-bb5a2af9ffcd service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:51.692124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:51.692124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:51.692124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:51.692124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] PATH_INFO: `/v3/users/426364263eac4885944422e8ba6ca07d` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:51.693247 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=426364263eac4885944422e8ba6ca07d)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:51.695833 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:51.933613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426364263eac4885944422e8ba6ca07d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:52.060415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426364263eac4885944422e8ba6ca07d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:52.085423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426364263eac4885944422e8ba6ca07d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:52.085423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426364263eac4885944422e8ba6ca07d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:52.085423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426364263eac4885944422e8ba6ca07d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:52.100569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1176/2339] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:51 2022] DELETE /identity/v3/users/426364263eac4885944422e8ba6ca07d => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:52.958437 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:52.959999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:53.000115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a97ae-294d-4812-95e4-8a3e4c35f4bd admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:53.155122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:53.156297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:53.156297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:53.156580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] PATH_INFO: `/v3/projects/7a9254b6f0c34ea7896655c093df8450` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:53.157932 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9254b6f0c34ea7896655c093df8450)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:53.162233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:53.329356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9254b6f0c34ea7896655c093df8450', 'request_id': 'req-835f75d7-8f79-4141-9214-bedcffe1a62f'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:53.344224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9254b6f0c34ea7896655c093df8450', 'request_id': 'req-835f75d7-8f79-4141-9214-bedcffe1a62f'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:53.424700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9254b6f0c34ea7896655c093df8450', 'request_id': 'req-835f75d7-8f79-4141-9214-bedcffe1a62f'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:53.437000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] The token cache is being invalidate because project 7a9254b6f0c34ea7896655c093df8450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:53.437347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:53.442200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:53.447309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1164/2340] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:52 2022] DELETE /identity/v3/projects/7a9254b6f0c34ea7896655c093df8450 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:53.452139 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:53.453680 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:53.468524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0200a00-34c6-4c12-b503-97e93e827362 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:53.507747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:53.556430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859aec9-7486-4bca-8f7b-81de56cd1326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:53.557125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859aec9-7486-4bca-8f7b-81de56cd1326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:53.557415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859aec9-7486-4bca-8f7b-81de56cd1326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:53.557695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859aec9-7486-4bca-8f7b-81de56cd1326 admin admin] PATH_INFO: `/v3/users/1207996529ae448bbc1d28020d0ce20c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:53.572177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859aec9-7486-4bca-8f7b-81de56cd1326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1207996529ae448bbc1d28020d0ce20c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:53.574677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859aec9-7486-4bca-8f7b-81de56cd1326 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:53.847929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7859aec9-7486-4bca-8f7b-81de56cd1326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1207996529ae448bbc1d28020d0ce20c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:53.926451 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7859aec9-7486-4bca-8f7b-81de56cd1326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1207996529ae448bbc1d28020d0ce20c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:53.937644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7859aec9-7486-4bca-8f7b-81de56cd1326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1207996529ae448bbc1d28020d0ce20c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:53.941355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7859aec9-7486-4bca-8f7b-81de56cd1326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1207996529ae448bbc1d28020d0ce20c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:53.942435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7859aec9-7486-4bca-8f7b-81de56cd1326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1207996529ae448bbc1d28020d0ce20c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:54.007132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1177/2341] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:53 2022] DELETE /identity/v3/users/1207996529ae448bbc1d28020d0ce20c => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:54.847551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:54.849390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:54.877433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f75d7-8f79-4141-9214-bedcffe1a62f admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:54.959959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:54.982313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0098f-f380-4e8b-9452-8a769a440b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:54.983341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0098f-f380-4e8b-9452-8a769a440b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:54.988128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0098f-f380-4e8b-9452-8a769a440b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:54.988128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0098f-f380-4e8b-9452-8a769a440b2e admin admin] PATH_INFO: `/v3/projects/19f6680130604827adfd5d3d34362998` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:54.988128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0098f-f380-4e8b-9452-8a769a440b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f6680130604827adfd5d3d34362998)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:54.988128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0098f-f380-4e8b-9452-8a769a440b2e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:55.112010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8df0098f-f380-4e8b-9452-8a769a440b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f6680130604827adfd5d3d34362998', 'request_id': 'req-8df0098f-f380-4e8b-9452-8a769a440b2e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:55.127006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8df0098f-f380-4e8b-9452-8a769a440b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f6680130604827adfd5d3d34362998', 'request_id': 'req-8df0098f-f380-4e8b-9452-8a769a440b2e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:55.235258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8df0098f-f380-4e8b-9452-8a769a440b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f6680130604827adfd5d3d34362998', 'request_id': 'req-8df0098f-f380-4e8b-9452-8a769a440b2e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:55.253794 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8df0098f-f380-4e8b-9452-8a769a440b2e admin admin] The token cache is being invalidate because project 19f6680130604827adfd5d3d34362998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:55.254093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8df0098f-f380-4e8b-9452-8a769a440b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:55.254849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-8df0098f-f380-4e8b-9452-8a769a440b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:55.263928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1165/2342] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:54 2022] DELETE /identity/v3/projects/19f6680130604827adfd5d3d34362998 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:55.268698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc977f-d44f-42f7-b34a-1f46d47d225d None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:55.269234 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc977f-d44f-42f7-b34a-1f46d47d225d None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:55.269325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc977f-d44f-42f7-b34a-1f46d47d225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:55.304947 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-35fc977f-d44f-42f7-b34a-1f46d47d225d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:55.306276 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-35fc977f-d44f-42f7-b34a-1f46d47d225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:55.476244 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1178/2343] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:55.485126 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b742b-8d1d-452f-b63f-8c20f6c4cb21 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:55.485419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b742b-8d1d-452f-b63f-8c20f6c4cb21 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:55.485707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b742b-8d1d-452f-b63f-8c20f6c4cb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:55.525189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-123b742b-8d1d-452f-b63f-8c20f6c4cb21 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:55.526517 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-123b742b-8d1d-452f-b63f-8c20f6c4cb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:55.543684 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1166/2344] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:55.547652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc977f-d44f-42f7-b34a-1f46d47d225d None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:55.577938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc977f-d44f-42f7-b34a-1f46d47d225d None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:55.600641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e48be-465b-416e-83f5-f4a8e422cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:55.601557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e48be-465b-416e-83f5-f4a8e422cf13 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:55.602019 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e48be-465b-416e-83f5-f4a8e422cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:55.602465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e48be-465b-416e-83f5-f4a8e422cf13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:55.604213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e48be-465b-416e-83f5-f4a8e422cf13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:38:55.604690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e48be-465b-416e-83f5-f4a8e422cf13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:55.606864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e48be-465b-416e-83f5-f4a8e422cf13 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:55.632456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1179/2345] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:38:55.636759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b742b-8d1d-452f-b63f-8c20f6c4cb21 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:55.651151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b742b-8d1d-452f-b63f-8c20f6c4cb21 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:55.667062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c0eed-4f59-4749-a1e3-2763d7a8ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:55.671213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c0eed-4f59-4749-a1e3-2763d7a8ad20 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:55.671672 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c0eed-4f59-4749-a1e3-2763d7a8ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:55.672358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c0eed-4f59-4749-a1e3-2763d7a8ad20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:55.673553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c0eed-4f59-4749-a1e3-2763d7a8ad20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:55.678996 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c0eed-4f59-4749-a1e3-2763d7a8ad20 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:55.867369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1167/2346] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:55 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:38:55.871124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e48be-465b-416e-83f5-f4a8e422cf13 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:55.882865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e48be-465b-416e-83f5-f4a8e422cf13 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:55.930053 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:55.970356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cb39c-1877-47f3-9704-9902978bd341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:55.971110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cb39c-1877-47f3-9704-9902978bd341 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:55.971673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cb39c-1877-47f3-9704-9902978bd341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:55.972026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cb39c-1877-47f3-9704-9902978bd341 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:55.972801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cb39c-1877-47f3-9704-9902978bd341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:55.975039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cb39c-1877-47f3-9704-9902978bd341 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:56.078386 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1180/2347] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:55 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:38:56.079430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c0eed-4f59-4749-a1e3-2763d7a8ad20 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:56.099475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c0eed-4f59-4749-a1e3-2763d7a8ad20 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:56.118200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d727f-7732-4dee-bdbf-879bb68812f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:56.118200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d727f-7732-4dee-bdbf-879bb68812f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:56.118200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d727f-7732-4dee-bdbf-879bb68812f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:56.118200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d727f-7732-4dee-bdbf-879bb68812f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:56.118718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d727f-7732-4dee-bdbf-879bb68812f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:56.118718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d727f-7732-4dee-bdbf-879bb68812f5 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:56.126546 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1168/2348] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:38:56.129817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cb39c-1877-47f3-9704-9902978bd341 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:56.148276 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cb39c-1877-47f3-9704-9902978bd341 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:56.158623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83549e-179e-494c-a634-38332cc38933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:56.159368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83549e-179e-494c-a634-38332cc38933 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:56.159654 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83549e-179e-494c-a634-38332cc38933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:56.159938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83549e-179e-494c-a634-38332cc38933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:56.160661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83549e-179e-494c-a634-38332cc38933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:56.162861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83549e-179e-494c-a634-38332cc38933 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:56.177821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1181/2349] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:56.178777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d727f-7732-4dee-bdbf-879bb68812f5 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:56.194396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d727f-7732-4dee-bdbf-879bb68812f5 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:56.201475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f494ded-978b-41b3-beb9-291737e40612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:56.202204 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f494ded-978b-41b3-beb9-291737e40612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:56.202527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f494ded-978b-41b3-beb9-291737e40612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:56.202802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f494ded-978b-41b3-beb9-291737e40612 admin admin] PATH_INFO: `/v3/projects/fad1e4c98e404c8d83099f3391acbc9c/users/7e4c1ab0adae4b4cb008384437d6a20d/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:56.236085 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f494ded-978b-41b3-beb9-291737e40612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad1e4c98e404c8d83099f3391acbc9c, user_id=7e4c1ab0adae4b4cb008384437d6a20d, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:56.240147 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f494ded-978b-41b3-beb9-291737e40612 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:56.317408 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1169/2350] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:56 2022] PUT /identity/v3/projects/fad1e4c98e404c8d83099f3391acbc9c/users/7e4c1ab0adae4b4cb008384437d6a20d/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:56.328218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc937b6b-986d-4612-b289-009040c17c59 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:56.329219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc937b6b-986d-4612-b289-009040c17c59 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:56.329820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc937b6b-986d-4612-b289-009040c17c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:56.405374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-fc937b6b-986d-4612-b289-009040c17c59 None None] MFA Rules not processed for user `7e4c1ab0adae4b4cb008384437d6a20d`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:56.406904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-fc937b6b-986d-4612-b289-009040c17c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:56.526813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1182/2351] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:56.536304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f494ded-978b-41b3-beb9-291737e40612 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:56.538167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7f494ded-978b-41b3-beb9-291737e40612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:56.650595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f494ded-978b-41b3-beb9-291737e40612 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:56.656067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2ca5f-89ea-49e8-9f77-881dc24c0de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:56.656706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2ca5f-89ea-49e8-9f77-881dc24c0de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:56.656995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2ca5f-89ea-49e8-9f77-881dc24c0de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:56.657273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2ca5f-89ea-49e8-9f77-881dc24c0de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:56.678338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2ca5f-89ea-49e8-9f77-881dc24c0de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:56.679885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2ca5f-89ea-49e8-9f77-881dc24c0de7 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:56.710629 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1170/2352] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:57.202409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f016844-c58e-4ba2-ac63-d5a5403f2c65 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:57.202851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f016844-c58e-4ba2-ac63-d5a5403f2c65 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:57.203208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f016844-c58e-4ba2-ac63-d5a5403f2c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:57.235884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8f016844-c58e-4ba2-ac63-d5a5403f2c65 None None] MFA Rules not processed for user `5091a0547e964c6d80b947191072e809`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:57.244668 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8f016844-c58e-4ba2-ac63-d5a5403f2c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:57.339939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1183/2353] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:38:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:57.345262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2ca5f-89ea-49e8-9f77-881dc24c0de7 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:57.346882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b6b2ca5f-89ea-49e8-9f77-881dc24c0de7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:57.367091 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:57.417731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2ca5f-89ea-49e8-9f77-881dc24c0de7 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:57.427203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498958cc-55a4-4cd8-82a7-fe9b5b25ecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:57.428028 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498958cc-55a4-4cd8-82a7-fe9b5b25ecaf admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:57.428327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498958cc-55a4-4cd8-82a7-fe9b5b25ecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:57.428618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498958cc-55a4-4cd8-82a7-fe9b5b25ecaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:57.429305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498958cc-55a4-4cd8-82a7-fe9b5b25ecaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:57.431342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498958cc-55a4-4cd8-82a7-fe9b5b25ecaf admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:58.532475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1171/2354] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:38:57 2022] POST /identity/v3/projects => generated 371 bytes in 1188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:58.538177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f016844-c58e-4ba2-ac63-d5a5403f2c65 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:58.572808 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f016844-c58e-4ba2-ac63-d5a5403f2c65 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:58.636934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:58.692404 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594e404-2ae8-4fb9-be65-440e6d627bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:58.693372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e404-2ae8-4fb9-be65-440e6d627bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:58.693809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e404-2ae8-4fb9-be65-440e6d627bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:58.694413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e404-2ae8-4fb9-be65-440e6d627bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:58.694985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594e404-2ae8-4fb9-be65-440e6d627bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:58.697670 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594e404-2ae8-4fb9-be65-440e6d627bc4 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:58.812027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1184/2355] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:38:58 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:38:58.815997 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498958cc-55a4-4cd8-82a7-fe9b5b25ecaf admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:58.829073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498958cc-55a4-4cd8-82a7-fe9b5b25ecaf admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:58.845161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40760271-c20b-4284-b49e-f06350f122a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:58.845811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40760271-c20b-4284-b49e-f06350f122a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:58.846098 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40760271-c20b-4284-b49e-f06350f122a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:58.846389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40760271-c20b-4284-b49e-f06350f122a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:58.847117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40760271-c20b-4284-b49e-f06350f122a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:58.852778 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40760271-c20b-4284-b49e-f06350f122a6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:58.866908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1172/2356] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:58.871504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594e404-2ae8-4fb9-be65-440e6d627bc4 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:58.891018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594e404-2ae8-4fb9-be65-440e6d627bc4 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:58.897746 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71ceb6-243f-4fcc-9ed6-ed88bf2fa353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:58.898604 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71ceb6-243f-4fcc-9ed6-ed88bf2fa353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:58.899000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71ceb6-243f-4fcc-9ed6-ed88bf2fa353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:58.901878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71ceb6-243f-4fcc-9ed6-ed88bf2fa353 admin admin] PATH_INFO: `/v3/projects/bd0b06bdf283429dbf62fa10abf29f6f/users/856ee1ce4ac347118944e2267f122623/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:58.928858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71ceb6-243f-4fcc-9ed6-ed88bf2fa353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0b06bdf283429dbf62fa10abf29f6f, user_id=856ee1ce4ac347118944e2267f122623, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:58.932901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71ceb6-243f-4fcc-9ed6-ed88bf2fa353 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:59.016391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1185/2357] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:58 2022] PUT /identity/v3/projects/bd0b06bdf283429dbf62fa10abf29f6f/users/856ee1ce4ac347118944e2267f122623/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:59.017735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40760271-c20b-4284-b49e-f06350f122a6 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:59.035652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40760271-c20b-4284-b49e-f06350f122a6 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:59.125913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2062502-5f77-49d1-9c0a-2ec9497738c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:59.126682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2062502-5f77-49d1-9c0a-2ec9497738c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:59.126964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2062502-5f77-49d1-9c0a-2ec9497738c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:59.127247 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2062502-5f77-49d1-9c0a-2ec9497738c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:59.127951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2062502-5f77-49d1-9c0a-2ec9497738c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:59.129567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2062502-5f77-49d1-9c0a-2ec9497738c6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:59.141925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1173/2358] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:38:59.145840 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71ceb6-243f-4fcc-9ed6-ed88bf2fa353 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:59.158136 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71ceb6-243f-4fcc-9ed6-ed88bf2fa353 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:59.165633 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e3875-9f46-46a9-9a72-23a485442ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:59.166712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e3875-9f46-46a9-9a72-23a485442ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:59.166712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e3875-9f46-46a9-9a72-23a485442ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:59.171998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e3875-9f46-46a9-9a72-23a485442ba8 admin admin] PATH_INFO: `/v3/projects/bd0b06bdf283429dbf62fa10abf29f6f/users/856ee1ce4ac347118944e2267f122623/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:59.171998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e3875-9f46-46a9-9a72-23a485442ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0b06bdf283429dbf62fa10abf29f6f, user_id=856ee1ce4ac347118944e2267f122623, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:59.173538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e3875-9f46-46a9-9a72-23a485442ba8 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:59.197411 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1186/2359] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:38:59 2022] PUT /identity/v3/projects/bd0b06bdf283429dbf62fa10abf29f6f/users/856ee1ce4ac347118944e2267f122623/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:39:01.426371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2062502-5f77-49d1-9c0a-2ec9497738c6 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:01.467181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2062502-5f77-49d1-9c0a-2ec9497738c6 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:01.767546 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:01.768578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:01.769237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:01.770937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] PATH_INFO: `/v3/users/7e4c1ab0adae4b4cb008384437d6a20d` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:01.776181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e4c1ab0adae4b4cb008384437d6a20d)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:01.785507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:01.977216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:02.080927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e4c1ab0adae4b4cb008384437d6a20d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:02.108416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e4c1ab0adae4b4cb008384437d6a20d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:02.109206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e4c1ab0adae4b4cb008384437d6a20d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:02.129075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e4c1ab0adae4b4cb008384437d6a20d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:02.228728 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e4c1ab0adae4b4cb008384437d6a20d'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:02.243142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1174/2360] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:39:01 2022] DELETE /identity/v3/users/7e4c1ab0adae4b4cb008384437d6a20d => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:39:02.244881 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eefaf0-b0b5-4301-b9ea-d83d30bfc25d None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:02.245328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eefaf0-b0b5-4301-b9ea-d83d30bfc25d None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:02.245443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eefaf0-b0b5-4301-b9ea-d83d30bfc25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:02.282518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e4eefaf0-b0b5-4301-b9ea-d83d30bfc25d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:02.283754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e4eefaf0-b0b5-4301-b9ea-d83d30bfc25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:02.407479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1187/2361] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:02.413560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:02.415246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:02.538682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e2652-ca5a-4a69-b747-755359fc7c55 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:02.551352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afed4d9-c5b2-42f1-8128-9342b54ed3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:02.552015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed4d9-c5b2-42f1-8128-9342b54ed3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:02.552307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed4d9-c5b2-42f1-8128-9342b54ed3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:02.552604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed4d9-c5b2-42f1-8128-9342b54ed3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:02.573235 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afed4d9-c5b2-42f1-8128-9342b54ed3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:02.574786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afed4d9-c5b2-42f1-8128-9342b54ed3e3 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:02.597477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1175/2362] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:03.984112 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eefaf0-b0b5-4301-b9ea-d83d30bfc25d None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:03.985675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e4eefaf0-b0b5-4301-b9ea-d83d30bfc25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:04.036832 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eefaf0-b0b5-4301-b9ea-d83d30bfc25d None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:04.067880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5cb1d-4e5a-4bbe-8b98-ef6511e0b52b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:04.069040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5cb1d-4e5a-4bbe-8b98-ef6511e0b52b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:04.069480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5cb1d-4e5a-4bbe-8b98-ef6511e0b52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:04.085034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:04.087132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:04.089128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:04.089637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c admin admin] PATH_INFO: `/v3/projects/fad1e4c98e404c8d83099f3391acbc9c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:04.092548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-f1a5cb1d-4e5a-4bbe-8b98-ef6511e0b52b None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:04.094010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f1a5cb1d-4e5a-4bbe-8b98-ef6511e0b52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:04.094260 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad1e4c98e404c8d83099f3391acbc9c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:04.097875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:04.169635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1176/2363] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:39:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:04.206620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5cb1d-4e5a-4bbe-8b98-ef6511e0b52b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:04.208538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f1a5cb1d-4e5a-4bbe-8b98-ef6511e0b52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:04.288601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad1e4c98e404c8d83099f3391acbc9c', 'request_id': 'req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:04.302224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:04.321115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5cb1d-4e5a-4bbe-8b98-ef6511e0b52b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:04.354765 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad1e4c98e404c8d83099f3391acbc9c', 'request_id': 'req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:04.364776 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad1e4c98e404c8d83099f3391acbc9c', 'request_id': 'req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:04.388707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c admin admin] The token cache is being invalidate because project fad1e4c98e404c8d83099f3391acbc9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:39:04.389008 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:04.391282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-c12a116f-0fdc-4ecf-b8ed-e42c5653f77c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:04.393753 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1188/2364] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:39:03 2022] DELETE /identity/v3/projects/fad1e4c98e404c8d83099f3391acbc9c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:39:04.400023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0b00c-702b-4564-b742-ab7515ace8de None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:04.406775 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846adf42-d7a9-4be3-9b06-e167c7c3c3ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:04.406920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0b00c-702b-4564-b742-ab7515ace8de None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:04.406920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0b00c-702b-4564-b742-ab7515ace8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:04.407128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846adf42-d7a9-4be3-9b06-e167c7c3c3ab service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:04.407128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846adf42-d7a9-4be3-9b06-e167c7c3c3ab service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:04.407128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846adf42-d7a9-4be3-9b06-e167c7c3c3ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:04.407128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-846adf42-d7a9-4be3-9b06-e167c7c3c3ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:04.424333 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:04.432843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-dfc0b00c-702b-4564-b742-ab7515ace8de None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:04.435349 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-dfc0b00c-702b-4564-b742-ab7515ace8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:04.523364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846adf42-d7a9-4be3-9b06-e167c7c3c3ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:04.525084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1189/2365] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:39:04.533109 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846adf42-d7a9-4be3-9b06-e167c7c3c3ab service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:04.535517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c076e-5a3c-4d2f-8a2a-d9f3454a41fd None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:04.540146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c076e-5a3c-4d2f-8a2a-d9f3454a41fd None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:04.540146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c076e-5a3c-4d2f-8a2a-d9f3454a41fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:04.542601 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1177/2366] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:39:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:39:04.577944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-229c076e-5a3c-4d2f-8a2a-d9f3454a41fd None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:04.580831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-229c076e-5a3c-4d2f-8a2a-d9f3454a41fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:04.595707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846adf42-d7a9-4be3-9b06-e167c7c3c3ab service swift] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:04.602993 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1190/2367] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:04.610079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846adf42-d7a9-4be3-9b06-e167c7c3c3ab service swift] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:04.621076 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad014a9-b943-46fc-b73c-f2bb6d1d3562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:04.626615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad014a9-b943-46fc-b73c-f2bb6d1d3562 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:04.626615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad014a9-b943-46fc-b73c-f2bb6d1d3562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:04.626615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad014a9-b943-46fc-b73c-f2bb6d1d3562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:04.627142 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad014a9-b943-46fc-b73c-f2bb6d1d3562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:39:04.627462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad014a9-b943-46fc-b73c-f2bb6d1d3562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:04.630924 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad014a9-b943-46fc-b73c-f2bb6d1d3562 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:04.656970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1178/2368] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:39:04.670818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c076e-5a3c-4d2f-8a2a-d9f3454a41fd None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:04.682288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c076e-5a3c-4d2f-8a2a-d9f3454a41fd None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:04.698223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae321f8-2f2a-4468-9df6-c0cef8187cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:04.698962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae321f8-2f2a-4468-9df6-c0cef8187cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:04.699234 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae321f8-2f2a-4468-9df6-c0cef8187cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:04.699565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae321f8-2f2a-4468-9df6-c0cef8187cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:04.701074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae321f8-2f2a-4468-9df6-c0cef8187cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:04.704375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae321f8-2f2a-4468-9df6-c0cef8187cd6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:04.798072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1191/2369] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:39:04 2022] POST /identity/v3/projects => generated 399 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:39:04.799476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad014a9-b943-46fc-b73c-f2bb6d1d3562 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:04.829454 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad014a9-b943-46fc-b73c-f2bb6d1d3562 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:05.023403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072cd85-8094-4ae5-bb88-9511fa3116cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:05.026833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072cd85-8094-4ae5-bb88-9511fa3116cc admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:05.027928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072cd85-8094-4ae5-bb88-9511fa3116cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:05.028534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072cd85-8094-4ae5-bb88-9511fa3116cc admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:05.039241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072cd85-8094-4ae5-bb88-9511fa3116cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:05.048132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072cd85-8094-4ae5-bb88-9511fa3116cc admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:05.167520 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1179/2370] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:39:04 2022] POST /identity/v3/users => generated 300 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:39:05.172828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae321f8-2f2a-4468-9df6-c0cef8187cd6 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:05.192217 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae321f8-2f2a-4468-9df6-c0cef8187cd6 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:05.225531 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395232bd-9099-4756-8387-57c8c8ee3e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:05.230323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395232bd-9099-4756-8387-57c8c8ee3e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:05.230648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395232bd-9099-4756-8387-57c8c8ee3e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:05.240351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395232bd-9099-4756-8387-57c8c8ee3e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:05.241232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395232bd-9099-4756-8387-57c8c8ee3e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:05.243096 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395232bd-9099-4756-8387-57c8c8ee3e5c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:05.307577 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1192/2371] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:39:05.312322 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072cd85-8094-4ae5-bb88-9511fa3116cc admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:05.335097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072cd85-8094-4ae5-bb88-9511fa3116cc admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:05.351945 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102f409-9f1a-4a42-bbac-a69e42c1ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:05.352611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102f409-9f1a-4a42-bbac-a69e42c1ede4 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:05.352907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102f409-9f1a-4a42-bbac-a69e42c1ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:05.358956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102f409-9f1a-4a42-bbac-a69e42c1ede4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:05.360838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102f409-9f1a-4a42-bbac-a69e42c1ede4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:05.364530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102f409-9f1a-4a42-bbac-a69e42c1ede4 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:05.394394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1180/2372] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:39:05.398450 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395232bd-9099-4756-8387-57c8c8ee3e5c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:05.414232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395232bd-9099-4756-8387-57c8c8ee3e5c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:05.435709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95eb42-6b70-4ae2-8a71-26513792473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:05.436673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95eb42-6b70-4ae2-8a71-26513792473d admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:05.437113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95eb42-6b70-4ae2-8a71-26513792473d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:05.437575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95eb42-6b70-4ae2-8a71-26513792473d admin admin] PATH_INFO: `/v3/projects/ee1f8624e55342969ba7a010cc1c4d92/users/1297aa1470744e9497ebe930c5f93bbc/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:05.473570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95eb42-6b70-4ae2-8a71-26513792473d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1f8624e55342969ba7a010cc1c4d92, user_id=1297aa1470744e9497ebe930c5f93bbc, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:05.476775 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95eb42-6b70-4ae2-8a71-26513792473d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:05.556818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1193/2373] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:39:05 2022] PUT /identity/v3/projects/ee1f8624e55342969ba7a010cc1c4d92/users/1297aa1470744e9497ebe930c5f93bbc/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:39:05.639605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29278b91-b246-4bca-a616-cd9df2146326 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:05.640052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29278b91-b246-4bca-a616-cd9df2146326 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:05.640668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29278b91-b246-4bca-a616-cd9df2146326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:05.648121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:05.686187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-29278b91-b246-4bca-a616-cd9df2146326 None None] MFA Rules not processed for user `1297aa1470744e9497ebe930c5f93bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:05.688028 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-29278b91-b246-4bca-a616-cd9df2146326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:05.823099 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1181/2374] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:39:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:05.835940 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95eb42-6b70-4ae2-8a71-26513792473d admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:05.837858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5a95eb42-6b70-4ae2-8a71-26513792473d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:05.971100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95eb42-6b70-4ae2-8a71-26513792473d admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:05.977213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e852ea-468f-4335-8177-499b79671d78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:05.978530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e852ea-468f-4335-8177-499b79671d78 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:05.978787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e852ea-468f-4335-8177-499b79671d78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:05.979074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e852ea-468f-4335-8177-499b79671d78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:06.000784 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e852ea-468f-4335-8177-499b79671d78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:06.004801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e852ea-468f-4335-8177-499b79671d78 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:06.044086 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1194/2375] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:07.961563 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53462335-43d6-438d-ab3f-cddc583e602c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:07.961563 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53462335-43d6-438d-ab3f-cddc583e602c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:07.962310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53462335-43d6-438d-ab3f-cddc583e602c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:08.017661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-53462335-43d6-438d-ab3f-cddc583e602c None None] MFA Rules not processed for user `856ee1ce4ac347118944e2267f122623`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:08.018912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-53462335-43d6-438d-ab3f-cddc583e602c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:08.174216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1182/2376] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:39:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:08.188664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e852ea-468f-4335-8177-499b79671d78 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:08.190224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-51e852ea-468f-4335-8177-499b79671d78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:08.344009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:08.391099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e852ea-468f-4335-8177-499b79671d78 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:08.404766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9c2b4-afbd-46bb-93c7-348b8224492f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:08.406028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9c2b4-afbd-46bb-93c7-348b8224492f service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:08.406407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9c2b4-afbd-46bb-93c7-348b8224492f service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:08.406820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9c2b4-afbd-46bb-93c7-348b8224492f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:08.409924 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-56f9c2b4-afbd-46bb-93c7-348b8224492f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:08.556347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9c2b4-afbd-46bb-93c7-348b8224492f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:08.558540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9c2b4-afbd-46bb-93c7-348b8224492f service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:08.580574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1195/2377] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:12.346367 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acbdd9-3504-402e-aea2-5455754c4f0b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:12.346926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acbdd9-3504-402e-aea2-5455754c4f0b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:12.347009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acbdd9-3504-402e-aea2-5455754c4f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:12.395455 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-27acbdd9-3504-402e-aea2-5455754c4f0b None None] MFA Rules not processed for user `5091a0547e964c6d80b947191072e809`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:12.397670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-27acbdd9-3504-402e-aea2-5455754c4f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:12.420570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1183/2378] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:39:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:12.504975 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9c2b4-afbd-46bb-93c7-348b8224492f service nova] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:12.674034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9c2b4-afbd-46bb-93c7-348b8224492f service nova] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:12.680514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6b166-4a3f-4114-95d1-7d7ed0a3d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:12.681281 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6b166-4a3f-4114-95d1-7d7ed0a3d2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:12.681575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6b166-4a3f-4114-95d1-7d7ed0a3d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:12.681858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6b166-4a3f-4114-95d1-7d7ed0a3d2de admin admin] PATH_INFO: `/v3/users/1297aa1470744e9497ebe930c5f93bbc` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:12.683101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6b166-4a3f-4114-95d1-7d7ed0a3d2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=1297aa1470744e9497ebe930c5f93bbc)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:12.694964 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6b166-4a3f-4114-95d1-7d7ed0a3d2de admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:12.878811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09c423-1f83-4cbd-a9dc-b0d6abede580 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:12.879333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09c423-1f83-4cbd-a9dc-b0d6abede580 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:12.879805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09c423-1f83-4cbd-a9dc-b0d6abede580 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:12.881827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1184/2379] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:39:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:39:12.892235 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc92fd-06ee-4de5-a5b7-6b8eb5fd7565 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:12.892807 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc92fd-06ee-4de5-a5b7-6b8eb5fd7565 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:12.893401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc92fd-06ee-4de5-a5b7-6b8eb5fd7565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:12.941200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-45d6b166-4a3f-4114-95d1-7d7ed0a3d2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1297aa1470744e9497ebe930c5f93bbc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:12.951267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-52bc92fd-06ee-4de5-a5b7-6b8eb5fd7565 None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:12.953370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-52bc92fd-06ee-4de5-a5b7-6b8eb5fd7565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:12.981203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1185/2380] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:39:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:39:12.998076 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc92fd-06ee-4de5-a5b7-6b8eb5fd7565 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:13.001152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-52bc92fd-06ee-4de5-a5b7-6b8eb5fd7565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:13.030004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-45d6b166-4a3f-4114-95d1-7d7ed0a3d2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1297aa1470744e9497ebe930c5f93bbc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:13.040547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-45d6b166-4a3f-4114-95d1-7d7ed0a3d2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1297aa1470744e9497ebe930c5f93bbc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:13.041749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-45d6b166-4a3f-4114-95d1-7d7ed0a3d2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1297aa1470744e9497ebe930c5f93bbc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:13.042422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-45d6b166-4a3f-4114-95d1-7d7ed0a3d2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1297aa1470744e9497ebe930c5f93bbc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:13.085103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1196/2381] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:39:12 2022] DELETE /identity/v3/users/1297aa1470744e9497ebe930c5f93bbc => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:39:13.086914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34c992-4b31-450e-a538-3add432caa8b None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:13.087274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34c992-4b31-450e-a538-3add432caa8b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:13.087556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34c992-4b31-450e-a538-3add432caa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:13.104208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:13.122589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc92fd-06ee-4de5-a5b7-6b8eb5fd7565 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:13.125284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-5b34c992-4b31-450e-a538-3add432caa8b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:13.126989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5b34c992-4b31-450e-a538-3add432caa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:13.155905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:13.243012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2e507-8163-419b-86a8-4e41a2605ab8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bd2ed69b324e85b8166135f045b840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:13.243012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2e507-8163-419b-86a8-4e41a2605ab8 service glance] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:13.243012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2e507-8163-419b-86a8-4e41a2605ab8 service glance] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:13.243012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2e507-8163-419b-86a8-4e41a2605ab8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:13.243452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1197/2382] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:13.243543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-83c2e507-8163-419b-86a8-4e41a2605ab8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:13.253009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34c992-4b31-450e-a538-3add432caa8b None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:13.255007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5b34c992-4b31-450e-a538-3add432caa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:13.426813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34c992-4b31-450e-a538-3add432caa8b None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:13.433623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef73ecf-1855-45e1-a37e-17596fd8cc81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:13.437469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef73ecf-1855-45e1-a37e-17596fd8cc81 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:13.437469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef73ecf-1855-45e1-a37e-17596fd8cc81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:13.437469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef73ecf-1855-45e1-a37e-17596fd8cc81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:13.451862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2e507-8163-419b-86a8-4e41a2605ab8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:13.455835 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2e507-8163-419b-86a8-4e41a2605ab8 service glance] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:13.484914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef73ecf-1855-45e1-a37e-17596fd8cc81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:13.486840 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef73ecf-1855-45e1-a37e-17596fd8cc81 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:13.488415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1186/2383] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:13.531124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1198/2384] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:13.757460 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc0375-69b4-4ff7-89ea-1be6b5ca8e88 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:13.758242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc0375-69b4-4ff7-89ea-1be6b5ca8e88 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:13.758762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc0375-69b4-4ff7-89ea-1be6b5ca8e88 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:13.760732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1187/2385] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:39:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:39:13.766963 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84d068-bde8-40d7-a5e1-d2b89813acef None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:13.767169 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84d068-bde8-40d7-a5e1-d2b89813acef None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:13.768413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84d068-bde8-40d7-a5e1-d2b89813acef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:13.815116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6f84d068-bde8-40d7-a5e1-d2b89813acef None None] MFA Rules not processed for user `1ac08ad57a8e442d89ba1881abf43cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:13.816418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6f84d068-bde8-40d7-a5e1-d2b89813acef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:13.828325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1199/2386] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:39:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:39:13.845602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc0375-69b4-4ff7-89ea-1be6b5ca8e88 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:13.860153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc0375-69b4-4ff7-89ea-1be6b5ca8e88 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:13.865580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb4860-fa43-43d6-a5a6-d0af280587f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:13.866345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb4860-fa43-43d6-a5a6-d0af280587f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:13.866787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb4860-fa43-43d6-a5a6-d0af280587f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:13.867171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb4860-fa43-43d6-a5a6-d0af280587f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:13.875657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb4860-fa43-43d6-a5a6-d0af280587f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:13.877220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb4860-fa43-43d6-a5a6-d0af280587f7 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:13.893471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1188/2387] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:14.086186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d3262-7533-492f-95c8-1035f2faccb9 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:14.087240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d3262-7533-492f-95c8-1035f2faccb9 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:14.087593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d3262-7533-492f-95c8-1035f2faccb9 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:14.089527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1200/2388] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:39:14.102013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c370b-944d-4a24-bf7b-4d9eccf86a3b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:14.102301 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c370b-944d-4a24-bf7b-4d9eccf86a3b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:14.102849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c370b-944d-4a24-bf7b-4d9eccf86a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:14.145919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-176c370b-944d-4a24-bf7b-4d9eccf86a3b None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:14.150680 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-176c370b-944d-4a24-bf7b-4d9eccf86a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:14.180019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1189/2389] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:39:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:39:14.197274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d3262-7533-492f-95c8-1035f2faccb9 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:14.199091 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-588d3262-7533-492f-95c8-1035f2faccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:14.236778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d3262-7533-492f-95c8-1035f2faccb9 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:14.249100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38277802-8f60-4eb2-a947-a8a9d67922a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:14.249729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277802-8f60-4eb2-a947-a8a9d67922a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:14.250007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277802-8f60-4eb2-a947-a8a9d67922a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:14.250279 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277802-8f60-4eb2-a947-a8a9d67922a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:14.260948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38277802-8f60-4eb2-a947-a8a9d67922a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:14.262702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38277802-8f60-4eb2-a947-a8a9d67922a3 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:14.274671 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1201/2390] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:14.342913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c370b-944d-4a24-bf7b-4d9eccf86a3b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:14.344508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-176c370b-944d-4a24-bf7b-4d9eccf86a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:14.366619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c370b-944d-4a24-bf7b-4d9eccf86a3b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:14.374295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:14.375750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:14.376104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:14.376635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] PATH_INFO: `/v3/projects/ee1f8624e55342969ba7a010cc1c4d92` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:14.378018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee1f8624e55342969ba7a010cc1c4d92)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:14.380136 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:14.552676 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee1f8624e55342969ba7a010cc1c4d92', 'request_id': 'req-4c105a3c-b8fc-4c80-813c-da00ef6da02b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:14.568832 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee1f8624e55342969ba7a010cc1c4d92', 'request_id': 'req-4c105a3c-b8fc-4c80-813c-da00ef6da02b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:14.635726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee1f8624e55342969ba7a010cc1c4d92', 'request_id': 'req-4c105a3c-b8fc-4c80-813c-da00ef6da02b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:14.650914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] The token cache is being invalidate because project ee1f8624e55342969ba7a010cc1c4d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:39:14.651238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:14.652048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:14.655205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1190/2391] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:39:14 2022] DELETE /identity/v3/projects/ee1f8624e55342969ba7a010cc1c4d92 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:39:24.269400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=61 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:24.647004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:28.343463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5ab83-1a01-48b2-ae0c-33f1507c12c6 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:28.343953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5ab83-1a01-48b2-ae0c-33f1507c12c6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:28.343953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5ab83-1a01-48b2-ae0c-33f1507c12c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:28.364118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-5dc5ab83-1a01-48b2-ae0c-33f1507c12c6 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:28.365531 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5dc5ab83-1a01-48b2-ae0c-33f1507c12c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:28.437117 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1202/2392] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:39:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:28.449484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:28.451831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:28.527291 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c105a3c-b8fc-4c80-813c-da00ef6da02b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:28.538546 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee38bf0-7a44-4a3b-87c9-bb95ca218f3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:28.539206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee38bf0-7a44-4a3b-87c9-bb95ca218f3d service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:28.539498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee38bf0-7a44-4a3b-87c9-bb95ca218f3d service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:28.539776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee38bf0-7a44-4a3b-87c9-bb95ca218f3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:28.550518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee38bf0-7a44-4a3b-87c9-bb95ca218f3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:28.552139 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee38bf0-7a44-4a3b-87c9-bb95ca218f3d service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:28.561189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1191/2393] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:39:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:39:29.337950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36025106-0927-4a53-bcb8-3afd8bde1e18 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:29.338455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36025106-0927-4a53-bcb8-3afd8bde1e18 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:29.338898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36025106-0927-4a53-bcb8-3afd8bde1e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:29.360970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-36025106-0927-4a53-bcb8-3afd8bde1e18 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:29.362185 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-36025106-0927-4a53-bcb8-3afd8bde1e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:29.369485 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1203/2394] 10.222.0.60 () {58 vars in 967 bytes} [Thu Aug 4 02:39:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:39:29.394093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee38bf0-7a44-4a3b-87c9-bb95ca218f3d service swift] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:29.405985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee38bf0-7a44-4a3b-87c9-bb95ca218f3d service swift] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:29.411799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfa8c2-9af6-40ef-b2af-b135df3143bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:29.412605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfa8c2-9af6-40ef-b2af-b135df3143bd service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:29.413039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfa8c2-9af6-40ef-b2af-b135df3143bd service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:29.413674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfa8c2-9af6-40ef-b2af-b135df3143bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:29.423913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfa8c2-9af6-40ef-b2af-b135df3143bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:29.427872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfa8c2-9af6-40ef-b2af-b135df3143bd service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:29.438951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1192/2395] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:39:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:39:36.592864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36025106-0927-4a53-bcb8-3afd8bde1e18 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:36.594928 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-36025106-0927-4a53-bcb8-3afd8bde1e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:36.692747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36025106-0927-4a53-bcb8-3afd8bde1e18 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:36.697450 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bac3a0-1fd2-450a-a7bc-2d3706f312e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:36.698106 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bac3a0-1fd2-450a-a7bc-2d3706f312e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:36.698390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bac3a0-1fd2-450a-a7bc-2d3706f312e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:36.698694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bac3a0-1fd2-450a-a7bc-2d3706f312e7 admin admin] PATH_INFO: `/v3/users/8670ec72824549f28b6530a758cbbb01` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:36.699873 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bac3a0-1fd2-450a-a7bc-2d3706f312e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8670ec72824549f28b6530a758cbbb01)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:36.702608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bac3a0-1fd2-450a-a7bc-2d3706f312e7 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:36.879374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-41bac3a0-1fd2-450a-a7bc-2d3706f312e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8670ec72824549f28b6530a758cbbb01'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:36.943691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-41bac3a0-1fd2-450a-a7bc-2d3706f312e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8670ec72824549f28b6530a758cbbb01'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:36.952012 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-41bac3a0-1fd2-450a-a7bc-2d3706f312e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8670ec72824549f28b6530a758cbbb01'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:36.952698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-41bac3a0-1fd2-450a-a7bc-2d3706f312e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8670ec72824549f28b6530a758cbbb01'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:36.953374 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-41bac3a0-1fd2-450a-a7bc-2d3706f312e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8670ec72824549f28b6530a758cbbb01'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:36.975575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1204/2396] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:39:36 2022] DELETE /identity/v3/users/8670ec72824549f28b6530a758cbbb01 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:39:37.232576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfa8c2-9af6-40ef-b2af-b135df3143bd service swift] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:37.251593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfa8c2-9af6-40ef-b2af-b135df3143bd service swift] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:37.422883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09700ea1-6f88-44d1-83f0-b448788500fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:37.423568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09700ea1-6f88-44d1-83f0-b448788500fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:37.423830 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09700ea1-6f88-44d1-83f0-b448788500fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:37.424104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09700ea1-6f88-44d1-83f0-b448788500fe admin admin] PATH_INFO: `/v3/projects/1be664f3b7f144268f3e4e4835f16cdc` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:37.426558 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09700ea1-6f88-44d1-83f0-b448788500fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be664f3b7f144268f3e4e4835f16cdc)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:37.428515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09700ea1-6f88-44d1-83f0-b448788500fe admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:37.599649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-09700ea1-6f88-44d1-83f0-b448788500fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be664f3b7f144268f3e4e4835f16cdc', 'request_id': 'req-09700ea1-6f88-44d1-83f0-b448788500fe'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:37.617980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-09700ea1-6f88-44d1-83f0-b448788500fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be664f3b7f144268f3e4e4835f16cdc', 'request_id': 'req-09700ea1-6f88-44d1-83f0-b448788500fe'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:37.688192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-09700ea1-6f88-44d1-83f0-b448788500fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be664f3b7f144268f3e4e4835f16cdc', 'request_id': 'req-09700ea1-6f88-44d1-83f0-b448788500fe'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:37.729758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-09700ea1-6f88-44d1-83f0-b448788500fe admin admin] The token cache is being invalidate because project 1be664f3b7f144268f3e4e4835f16cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:39:37.730091 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-09700ea1-6f88-44d1-83f0-b448788500fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:37.730786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-09700ea1-6f88-44d1-83f0-b448788500fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:39:37.732948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1193/2397] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:39:37 2022] DELETE /identity/v3/projects/1be664f3b7f144268f3e4e4835f16cdc => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:39:37.738267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242423e-55fb-4801-8053-8ebcb517bbea None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:37.738831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242423e-55fb-4801-8053-8ebcb517bbea None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:37.738831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242423e-55fb-4801-8053-8ebcb517bbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:37.781958 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-0242423e-55fb-4801-8053-8ebcb517bbea None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:37.786427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0242423e-55fb-4801-8053-8ebcb517bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:37.815882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:37.905649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1205/2398] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:37.907632 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d835d5-8167-4bbd-ad9c-be7e4874054c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:37.918545 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d835d5-8167-4bbd-ad9c-be7e4874054c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:37.918545 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d835d5-8167-4bbd-ad9c-be7e4874054c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:37.939672 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:37.948111 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-95d835d5-8167-4bbd-ad9c-be7e4874054c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:37.949337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-95d835d5-8167-4bbd-ad9c-be7e4874054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:37.959475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1194/2399] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:37.963766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242423e-55fb-4801-8053-8ebcb517bbea None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:37.977103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242423e-55fb-4801-8053-8ebcb517bbea None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:37.980308 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811fcba-9987-4588-8408-0aaf8c4b4d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:37.981110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811fcba-9987-4588-8408-0aaf8c4b4d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:37.981483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811fcba-9987-4588-8408-0aaf8c4b4d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:37.981858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811fcba-9987-4588-8408-0aaf8c4b4d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:37.982933 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811fcba-9987-4588-8408-0aaf8c4b4d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:39:37.983538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811fcba-9987-4588-8408-0aaf8c4b4d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:37.985527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811fcba-9987-4588-8408-0aaf8c4b4d40 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:37.999042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1206/2400] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:39:38.005300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d835d5-8167-4bbd-ad9c-be7e4874054c None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:38.013392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d835d5-8167-4bbd-ad9c-be7e4874054c None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:38.021895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1003e-ca38-451d-9c98-6438ba9afb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:38.024630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1003e-ca38-451d-9c98-6438ba9afb41 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:38.025073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1003e-ca38-451d-9c98-6438ba9afb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:38.025512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1003e-ca38-451d-9c98-6438ba9afb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:38.026467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1003e-ca38-451d-9c98-6438ba9afb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:38.028994 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1003e-ca38-451d-9c98-6438ba9afb41 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:38.140230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1195/2401] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:39:38 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:39:38.144556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811fcba-9987-4588-8408-0aaf8c4b4d40 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:38.155536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811fcba-9987-4588-8408-0aaf8c4b4d40 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:38.210575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db95d8-e301-4e2e-8864-f5d1ef543226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:38.211192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db95d8-e301-4e2e-8864-f5d1ef543226 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:38.211479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db95d8-e301-4e2e-8864-f5d1ef543226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:38.211762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db95d8-e301-4e2e-8864-f5d1ef543226 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:38.212436 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db95d8-e301-4e2e-8864-f5d1ef543226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:38.214364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db95d8-e301-4e2e-8864-f5d1ef543226 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:38.333215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1207/2402] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:39:38 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:39:38.337645 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1003e-ca38-451d-9c98-6438ba9afb41 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:38.348411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1003e-ca38-451d-9c98-6438ba9afb41 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:38.353165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ece47-a305-4f0e-b500-f3e90d83e407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:38.353856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ece47-a305-4f0e-b500-f3e90d83e407 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:38.354209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ece47-a305-4f0e-b500-f3e90d83e407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:38.354506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ece47-a305-4f0e-b500-f3e90d83e407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:38.355213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ece47-a305-4f0e-b500-f3e90d83e407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:38.356813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ece47-a305-4f0e-b500-f3e90d83e407 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:38.367864 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1196/2403] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:39:38.372107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db95d8-e301-4e2e-8864-f5d1ef543226 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:38.383162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db95d8-e301-4e2e-8864-f5d1ef543226 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:38.387799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e360c5e-aa32-4948-90b3-0a6815dee25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:38.388402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e360c5e-aa32-4948-90b3-0a6815dee25a admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:38.389560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e360c5e-aa32-4948-90b3-0a6815dee25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:38.389931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e360c5e-aa32-4948-90b3-0a6815dee25a admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:38.390676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e360c5e-aa32-4948-90b3-0a6815dee25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:38.392276 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e360c5e-aa32-4948-90b3-0a6815dee25a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:38.403964 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1208/2404] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:39:38.408255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ece47-a305-4f0e-b500-f3e90d83e407 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:38.417976 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ece47-a305-4f0e-b500-f3e90d83e407 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:38.422582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24768e9d-8de2-465e-9b88-aae62635c353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:38.423241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24768e9d-8de2-465e-9b88-aae62635c353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:38.423529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24768e9d-8de2-465e-9b88-aae62635c353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:38.423805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24768e9d-8de2-465e-9b88-aae62635c353 admin admin] PATH_INFO: `/v3/projects/d4fe7f2d6527462fad384192641c555f/users/6ec1b6e2d2e2489490eacf7b4dffa3d2/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:38.439084 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24768e9d-8de2-465e-9b88-aae62635c353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4fe7f2d6527462fad384192641c555f, user_id=6ec1b6e2d2e2489490eacf7b4dffa3d2, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:38.443874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24768e9d-8de2-465e-9b88-aae62635c353 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:38.532863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1197/2405] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:39:38 2022] PUT /identity/v3/projects/d4fe7f2d6527462fad384192641c555f/users/6ec1b6e2d2e2489490eacf7b4dffa3d2/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:39:38.535679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f28b0a-4f37-4f29-aebe-41f3124defa7 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:38.536015 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f28b0a-4f37-4f29-aebe-41f3124defa7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:38.536581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f28b0a-4f37-4f29-aebe-41f3124defa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:38.580615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-d3f28b0a-4f37-4f29-aebe-41f3124defa7 None None] MFA Rules not processed for user `6ec1b6e2d2e2489490eacf7b4dffa3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:38.582698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d3f28b0a-4f37-4f29-aebe-41f3124defa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:38.674532 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1209/2406] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:39:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:38.686017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24768e9d-8de2-465e-9b88-aae62635c353 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:38.687772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-24768e9d-8de2-465e-9b88-aae62635c353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:38.759029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24768e9d-8de2-465e-9b88-aae62635c353 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:38.762551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967948f0-0205-4b71-9114-b3485b9efe51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bd2ed69b324e85b8166135f045b840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:38.762551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967948f0-0205-4b71-9114-b3485b9efe51 service glance] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:38.762551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967948f0-0205-4b71-9114-b3485b9efe51 service glance] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:38.763060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967948f0-0205-4b71-9114-b3485b9efe51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:38.771704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967948f0-0205-4b71-9114-b3485b9efe51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:38.773147 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967948f0-0205-4b71-9114-b3485b9efe51 service glance] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:38.783544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1198/2407] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:40.085296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f28b0a-4f37-4f29-aebe-41f3124defa7 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:40.086849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d3f28b0a-4f37-4f29-aebe-41f3124defa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:40.101400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:40.174737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f28b0a-4f37-4f29-aebe-41f3124defa7 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:40.181094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c6b3-a32a-4437-b795-2346c6ca2e94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '423ac00601f84e3d9c6cc6ee20eee6ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:40.182056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c6b3-a32a-4437-b795-2346c6ca2e94 service placement] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:40.182407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c6b3-a32a-4437-b795-2346c6ca2e94 service placement] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:40.186380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c6b3-a32a-4437-b795-2346c6ca2e94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:40.186380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-dd00c6b3-a32a-4437-b795-2346c6ca2e94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:40.199053 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00c6b3-a32a-4437-b795-2346c6ca2e94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:40.202212 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00c6b3-a32a-4437-b795-2346c6ca2e94 service placement] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:40.219825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1210/2408] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:39:48.583443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb92681-7dc2-446a-a853-822791d76877 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:48.583970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb92681-7dc2-446a-a853-822791d76877 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:48.583970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb92681-7dc2-446a-a853-822791d76877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:48.604349 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-efb92681-7dc2-446a-a853-822791d76877 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:48.605690 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-efb92681-7dc2-446a-a853-822791d76877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:48.667652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1199/2409] 10.222.0.60 () {58 vars in 967 bytes} [Thu Aug 4 02:39:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:39:48.692009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c6b3-a32a-4437-b795-2346c6ca2e94 service placement] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:48.694135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-dd00c6b3-a32a-4437-b795-2346c6ca2e94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:48.773460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c6b3-a32a-4437-b795-2346c6ca2e94 service placement] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:48.778723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c561067-d46a-41d4-be55-d1e6b38e6481 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:48.779908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c561067-d46a-41d4-be55-d1e6b38e6481 service swift] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:48.780204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c561067-d46a-41d4-be55-d1e6b38e6481 service swift] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:48.780449 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c561067-d46a-41d4-be55-d1e6b38e6481 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:48.791986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c561067-d46a-41d4-be55-d1e6b38e6481 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:48.793587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c561067-d46a-41d4-be55-d1e6b38e6481 service swift] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:48.802649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1211/2410] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:39:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:39:50.099554 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbfa85-8f88-4bea-b45a-71d05d665beb None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:50.100084 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbfa85-8f88-4bea-b45a-71d05d665beb None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:50.100084 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbfa85-8f88-4bea-b45a-71d05d665beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:50.119702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-78bbfa85-8f88-4bea-b45a-71d05d665beb None None] MFA Rules not processed for user `2e47969dca184aec92e620fcd53d6a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:50.120895 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-78bbfa85-8f88-4bea-b45a-71d05d665beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:50.175756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:50.187454 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1200/2411] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:39:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:53.405749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c561067-d46a-41d4-be55-d1e6b38e6481 service swift] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:53.407197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-7c561067-d46a-41d4-be55-d1e6b38e6481 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:53.465170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c561067-d46a-41d4-be55-d1e6b38e6481 service swift] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:53.468846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1461a1-3bdf-4208-9071-7e3f05542e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:53.469469 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1461a1-3bdf-4208-9071-7e3f05542e35 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:53.469758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1461a1-3bdf-4208-9071-7e3f05542e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:53.470102 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1461a1-3bdf-4208-9071-7e3f05542e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:53.471907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5d1461a1-3bdf-4208-9071-7e3f05542e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:53.525504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:53.538211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1461a1-3bdf-4208-9071-7e3f05542e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:53.539797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1461a1-3bdf-4208-9071-7e3f05542e35 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:53.550359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1212/2412] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:00.303120 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:03.566403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=8 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:04.326185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbfa85-8f88-4bea-b45a-71d05d665beb None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:04.387719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbfa85-8f88-4bea-b45a-71d05d665beb None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:04.392163 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:04.393312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:04.393590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:04.393862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] PATH_INFO: `/v3/users/6ec1b6e2d2e2489490eacf7b4dffa3d2` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:04.395039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec1b6e2d2e2489490eacf7b4dffa3d2)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:04.396949 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:04.580899 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec1b6e2d2e2489490eacf7b4dffa3d2'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:04.592825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec1b6e2d2e2489490eacf7b4dffa3d2'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:04.593550 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec1b6e2d2e2489490eacf7b4dffa3d2'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:04.600675 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec1b6e2d2e2489490eacf7b4dffa3d2'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:04.663451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec1b6e2d2e2489490eacf7b4dffa3d2'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:04.669779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1201/2413] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:40:04 2022] DELETE /identity/v3/users/6ec1b6e2d2e2489490eacf7b4dffa3d2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:04.674679 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49cd5d-376e-4f27-a386-d85c78e2b8f6 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:04.675160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49cd5d-376e-4f27-a386-d85c78e2b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:04.675261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49cd5d-376e-4f27-a386-d85c78e2b8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:04.694739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8b49cd5d-376e-4f27-a386-d85c78e2b8f6 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:04.695950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8b49cd5d-376e-4f27-a386-d85c78e2b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:04.753869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1213/2414] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:04.763645 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:04.765047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:04.822532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1f3ab-7f05-4fd4-9604-52a1ecf52006 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:04.826220 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c3ef7-39ea-4306-a6b4-842dada8d047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:04.826876 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c3ef7-39ea-4306-a6b4-842dada8d047 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:04.827159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c3ef7-39ea-4306-a6b4-842dada8d047 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:04.827437 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c3ef7-39ea-4306-a6b4-842dada8d047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:04.837709 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c3ef7-39ea-4306-a6b4-842dada8d047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:04.839136 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c3ef7-39ea-4306-a6b4-842dada8d047 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:04.848765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1202/2415] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:05.527941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49cd5d-376e-4f27-a386-d85c78e2b8f6 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:05.529632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8b49cd5d-376e-4f27-a386-d85c78e2b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:05.541684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49cd5d-376e-4f27-a386-d85c78e2b8f6 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:05.546245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3381d7f-83d4-43c8-8596-00e8358e45e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:05.546963 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3381d7f-83d4-43c8-8596-00e8358e45e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:05.547251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3381d7f-83d4-43c8-8596-00e8358e45e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:05.547531 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3381d7f-83d4-43c8-8596-00e8358e45e4 admin admin] PATH_INFO: `/v3/projects/d4fe7f2d6527462fad384192641c555f` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:05.548704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3381d7f-83d4-43c8-8596-00e8358e45e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4fe7f2d6527462fad384192641c555f)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:05.550678 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3381d7f-83d4-43c8-8596-00e8358e45e4 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:05.659533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b3381d7f-83d4-43c8-8596-00e8358e45e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4fe7f2d6527462fad384192641c555f', 'request_id': 'req-b3381d7f-83d4-43c8-8596-00e8358e45e4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:05.726189 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b3381d7f-83d4-43c8-8596-00e8358e45e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4fe7f2d6527462fad384192641c555f', 'request_id': 'req-b3381d7f-83d4-43c8-8596-00e8358e45e4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:05.731910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b3381d7f-83d4-43c8-8596-00e8358e45e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4fe7f2d6527462fad384192641c555f', 'request_id': 'req-b3381d7f-83d4-43c8-8596-00e8358e45e4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:05.743194 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b3381d7f-83d4-43c8-8596-00e8358e45e4 admin admin] The token cache is being invalidate because project d4fe7f2d6527462fad384192641c555f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:40:05.743480 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b3381d7f-83d4-43c8-8596-00e8358e45e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:05.744093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b3381d7f-83d4-43c8-8596-00e8358e45e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:05.745589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1214/2416] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:40:05 2022] DELETE /identity/v3/projects/d4fe7f2d6527462fad384192641c555f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:05.750451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acf541-765f-4691-8a90-8d89e09f93e0 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:05.750943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acf541-765f-4691-8a90-8d89e09f93e0 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:05.751067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acf541-765f-4691-8a90-8d89e09f93e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:05.770649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-17acf541-765f-4691-8a90-8d89e09f93e0 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:05.771779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-17acf541-765f-4691-8a90-8d89e09f93e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:05.789370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:05.832201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1203/2417] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:05.841281 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4abc36-eb80-4422-9afb-2e3eda4996c7 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:05.841574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4abc36-eb80-4422-9afb-2e3eda4996c7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:05.841862 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4abc36-eb80-4422-9afb-2e3eda4996c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:05.863088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-fa4abc36-eb80-4422-9afb-2e3eda4996c7 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:05.864316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-fa4abc36-eb80-4422-9afb-2e3eda4996c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:05.872394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1215/2418] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:05.876885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acf541-765f-4691-8a90-8d89e09f93e0 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:05.886688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acf541-765f-4691-8a90-8d89e09f93e0 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:05.891270 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f93d0-1650-452d-8054-8e57bc637f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:05.896948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f93d0-1650-452d-8054-8e57bc637f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:05.896948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f93d0-1650-452d-8054-8e57bc637f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:05.896948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f93d0-1650-452d-8054-8e57bc637f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:05.896948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f93d0-1650-452d-8054-8e57bc637f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:40:05.896948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f93d0-1650-452d-8054-8e57bc637f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:05.896948 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f93d0-1650-452d-8054-8e57bc637f50 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:05.908619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1204/2419] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:40:05.912882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4abc36-eb80-4422-9afb-2e3eda4996c7 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:05.922051 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4abc36-eb80-4422-9afb-2e3eda4996c7 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:05.926800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc568334-5728-4d8e-88d1-d40120da8e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:05.927401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc568334-5728-4d8e-88d1-d40120da8e5b admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:05.927685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc568334-5728-4d8e-88d1-d40120da8e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:05.927962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc568334-5728-4d8e-88d1-d40120da8e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:05.928634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc568334-5728-4d8e-88d1-d40120da8e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:05.930587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc568334-5728-4d8e-88d1-d40120da8e5b admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:06.036516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1216/2420] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:40:05 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:06.040630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f93d0-1650-452d-8054-8e57bc637f50 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:06.051403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f93d0-1650-452d-8054-8e57bc637f50 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:06.108189 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d90b3c-5746-4a85-b4ef-aa4b43312d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:06.108806 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d90b3c-5746-4a85-b4ef-aa4b43312d9c admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:06.109091 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d90b3c-5746-4a85-b4ef-aa4b43312d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:06.109394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d90b3c-5746-4a85-b4ef-aa4b43312d9c admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:06.110066 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d90b3c-5746-4a85-b4ef-aa4b43312d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:06.112278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d90b3c-5746-4a85-b4ef-aa4b43312d9c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:06.189689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1205/2421] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:40:06 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:06.194142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc568334-5728-4d8e-88d1-d40120da8e5b admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:06.204348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc568334-5728-4d8e-88d1-d40120da8e5b admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:06.209815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f7b30-07ba-40fa-9852-a93f4b2a83a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:06.210409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f7b30-07ba-40fa-9852-a93f4b2a83a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:06.210719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f7b30-07ba-40fa-9852-a93f4b2a83a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:06.210991 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f7b30-07ba-40fa-9852-a93f4b2a83a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:06.211685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f7b30-07ba-40fa-9852-a93f4b2a83a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:06.213350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f7b30-07ba-40fa-9852-a93f4b2a83a8 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:06.223296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1217/2422] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:06.227086 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d90b3c-5746-4a85-b4ef-aa4b43312d9c admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:06.237442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d90b3c-5746-4a85-b4ef-aa4b43312d9c admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:06.242172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28771d-f0c7-46a3-8b43-df6e1d742359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:06.242862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28771d-f0c7-46a3-8b43-df6e1d742359 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:06.243150 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28771d-f0c7-46a3-8b43-df6e1d742359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:06.243430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28771d-f0c7-46a3-8b43-df6e1d742359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:06.244129 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28771d-f0c7-46a3-8b43-df6e1d742359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:06.245732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28771d-f0c7-46a3-8b43-df6e1d742359 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:06.256772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1206/2423] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:06.260936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f7b30-07ba-40fa-9852-a93f4b2a83a8 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:06.271484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f7b30-07ba-40fa-9852-a93f4b2a83a8 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:06.276034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7a35a-5249-4e84-b9ac-b668ca4f495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:06.276680 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7a35a-5249-4e84-b9ac-b668ca4f495c admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:06.276966 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7a35a-5249-4e84-b9ac-b668ca4f495c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:06.277241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7a35a-5249-4e84-b9ac-b668ca4f495c admin admin] PATH_INFO: `/v3/projects/08807b23c81443f8b976061def1cfbab/users/2cb66c00ddef482d95cf096dc9edef69/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:06.293059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7a35a-5249-4e84-b9ac-b668ca4f495c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08807b23c81443f8b976061def1cfbab, user_id=2cb66c00ddef482d95cf096dc9edef69, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:06.295705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7a35a-5249-4e84-b9ac-b668ca4f495c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:06.354749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1218/2424] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:40:06 2022] PUT /identity/v3/projects/08807b23c81443f8b976061def1cfbab/users/2cb66c00ddef482d95cf096dc9edef69/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:06.376237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9af28-3d7e-4810-9fa3-845b4523377b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:06.376573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9af28-3d7e-4810-9fa3-845b4523377b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:06.377403 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9af28-3d7e-4810-9fa3-845b4523377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:06.404954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-6cc9af28-3d7e-4810-9fa3-845b4523377b None None] MFA Rules not processed for user `2cb66c00ddef482d95cf096dc9edef69`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:06.406161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-6cc9af28-3d7e-4810-9fa3-845b4523377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:06.468070 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1207/2425] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:06.479288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7a35a-5249-4e84-b9ac-b668ca4f495c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:06.480960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-37e7a35a-5249-4e84-b9ac-b668ca4f495c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:06.503972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:06.538287 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7a35a-5249-4e84-b9ac-b668ca4f495c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:06.541983 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12733943-5993-4c97-81a5-e3640804edb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:06.542648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733943-5993-4c97-81a5-e3640804edb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:06.543178 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733943-5993-4c97-81a5-e3640804edb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:06.543600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733943-5993-4c97-81a5-e3640804edb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:06.552741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12733943-5993-4c97-81a5-e3640804edb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:06.555156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12733943-5993-4c97-81a5-e3640804edb0 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:06.562764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1219/2426] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:06.588835 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9af28-3d7e-4810-9fa3-845b4523377b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:06.608095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:06.650445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9af28-3d7e-4810-9fa3-845b4523377b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:06.655350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:06.655978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:06.656259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:06.656536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] PATH_INFO: `/v3/users/2cb66c00ddef482d95cf096dc9edef69` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:06.657692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb66c00ddef482d95cf096dc9edef69)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:06.660406 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:06.797746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb66c00ddef482d95cf096dc9edef69'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:06.810353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb66c00ddef482d95cf096dc9edef69'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:06.811149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb66c00ddef482d95cf096dc9edef69'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:06.818187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb66c00ddef482d95cf096dc9edef69'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:06.875192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb66c00ddef482d95cf096dc9edef69'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:06.881701 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1208/2427] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:40:06 2022] DELETE /identity/v3/users/2cb66c00ddef482d95cf096dc9edef69 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:06.886467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc01afd-c80a-42d3-8545-2c286c81098c None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:06.886927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc01afd-c80a-42d3-8545-2c286c81098c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:06.887059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc01afd-c80a-42d3-8545-2c286c81098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:06.906027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9cc01afd-c80a-42d3-8545-2c286c81098c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:06.907251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9cc01afd-c80a-42d3-8545-2c286c81098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:06.965760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1220/2428] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:06.975378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:06.976774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:07.032235 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54aeb3-e09a-43c2-8c99-2495b236118c admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:07.035966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e03f0-c723-4d1a-a23b-d24c779ec79b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:07.036596 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e03f0-c723-4d1a-a23b-d24c779ec79b service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:07.036878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e03f0-c723-4d1a-a23b-d24c779ec79b service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:07.037149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e03f0-c723-4d1a-a23b-d24c779ec79b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:07.046784 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e03f0-c723-4d1a-a23b-d24c779ec79b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:07.048275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e03f0-c723-4d1a-a23b-d24c779ec79b service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:07.057722 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1209/2429] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:40:07.425362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc01afd-c80a-42d3-8545-2c286c81098c None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:07.428788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9cc01afd-c80a-42d3-8545-2c286c81098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:07.441085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc01afd-c80a-42d3-8545-2c286c81098c None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:07.445927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914dc2a-3692-4bc4-a70d-8a568293de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:07.446628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914dc2a-3692-4bc4-a70d-8a568293de2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:07.446918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914dc2a-3692-4bc4-a70d-8a568293de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:07.447203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914dc2a-3692-4bc4-a70d-8a568293de2d admin admin] PATH_INFO: `/v3/projects/08807b23c81443f8b976061def1cfbab` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:07.448406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914dc2a-3692-4bc4-a70d-8a568293de2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=08807b23c81443f8b976061def1cfbab)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:07.450334 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914dc2a-3692-4bc4-a70d-8a568293de2d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:07.545493 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b914dc2a-3692-4bc4-a70d-8a568293de2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08807b23c81443f8b976061def1cfbab', 'request_id': 'req-b914dc2a-3692-4bc4-a70d-8a568293de2d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:07.617943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b914dc2a-3692-4bc4-a70d-8a568293de2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08807b23c81443f8b976061def1cfbab', 'request_id': 'req-b914dc2a-3692-4bc4-a70d-8a568293de2d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:07.623917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b914dc2a-3692-4bc4-a70d-8a568293de2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08807b23c81443f8b976061def1cfbab', 'request_id': 'req-b914dc2a-3692-4bc4-a70d-8a568293de2d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:07.635195 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b914dc2a-3692-4bc4-a70d-8a568293de2d admin admin] The token cache is being invalidate because project 08807b23c81443f8b976061def1cfbab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:40:07.635488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b914dc2a-3692-4bc4-a70d-8a568293de2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:07.636113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b914dc2a-3692-4bc4-a70d-8a568293de2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:07.637621 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1221/2430] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:40:07 2022] DELETE /identity/v3/projects/08807b23c81443f8b976061def1cfbab => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:07.647791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741ccfa-b484-4bb7-b6b0-ecbc6042c2f5 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:07.648080 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741ccfa-b484-4bb7-b6b0-ecbc6042c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:07.648362 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741ccfa-b484-4bb7-b6b0-ecbc6042c2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:07.668206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2741ccfa-b484-4bb7-b6b0-ecbc6042c2f5 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:07.669407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2741ccfa-b484-4bb7-b6b0-ecbc6042c2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:07.703712 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:07.729451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1210/2431] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:07.737995 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7561d21-379d-443f-a457-3de88ab76adc None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:07.738287 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7561d21-379d-443f-a457-3de88ab76adc None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:07.738606 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7561d21-379d-443f-a457-3de88ab76adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:07.758187 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-a7561d21-379d-443f-a457-3de88ab76adc None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:07.759433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a7561d21-379d-443f-a457-3de88ab76adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:07.772806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1222/2432] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:07.777318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741ccfa-b484-4bb7-b6b0-ecbc6042c2f5 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:07.788337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741ccfa-b484-4bb7-b6b0-ecbc6042c2f5 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:07.792923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6c3e4-26ef-4e44-91c8-0fa88c8570ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:07.793532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6c3e4-26ef-4e44-91c8-0fa88c8570ca admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:07.793820 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6c3e4-26ef-4e44-91c8-0fa88c8570ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:07.794101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6c3e4-26ef-4e44-91c8-0fa88c8570ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:07.794840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6c3e4-26ef-4e44-91c8-0fa88c8570ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:40:07.795152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6c3e4-26ef-4e44-91c8-0fa88c8570ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:07.796763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6c3e4-26ef-4e44-91c8-0fa88c8570ca admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:07.808830 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1211/2433] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:40:07.813045 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7561d21-379d-443f-a457-3de88ab76adc None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:07.822508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7561d21-379d-443f-a457-3de88ab76adc None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:07.827206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32b795-3d8e-4ccc-9667-398f56b4497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:07.827813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32b795-3d8e-4ccc-9667-398f56b4497e admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:07.828097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32b795-3d8e-4ccc-9667-398f56b4497e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:07.828380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32b795-3d8e-4ccc-9667-398f56b4497e admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:07.829044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32b795-3d8e-4ccc-9667-398f56b4497e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:07.831652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32b795-3d8e-4ccc-9667-398f56b4497e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:07.980484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1223/2434] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:40:07 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:07.984774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6c3e4-26ef-4e44-91c8-0fa88c8570ca admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:07.995073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6c3e4-26ef-4e44-91c8-0fa88c8570ca admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:08.057743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ba98f-63e6-40ac-92e4-576d45b4e75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:08.059751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ba98f-63e6-40ac-92e4-576d45b4e75c admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:08.059751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ba98f-63e6-40ac-92e4-576d45b4e75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:08.059751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ba98f-63e6-40ac-92e4-576d45b4e75c admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:08.059751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ba98f-63e6-40ac-92e4-576d45b4e75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:08.061583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ba98f-63e6-40ac-92e4-576d45b4e75c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:08.150113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1212/2435] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:40:07 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:08.154608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32b795-3d8e-4ccc-9667-398f56b4497e admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:08.165750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32b795-3d8e-4ccc-9667-398f56b4497e admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:08.170408 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740ff22-c13a-43f4-8dce-0ef28e40234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:08.171049 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740ff22-c13a-43f4-8dce-0ef28e40234a admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:08.171328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740ff22-c13a-43f4-8dce-0ef28e40234a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:08.171610 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740ff22-c13a-43f4-8dce-0ef28e40234a admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:08.172304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740ff22-c13a-43f4-8dce-0ef28e40234a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:08.173952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740ff22-c13a-43f4-8dce-0ef28e40234a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:08.184063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1224/2436] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:08.188046 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ba98f-63e6-40ac-92e4-576d45b4e75c admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:08.198643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ba98f-63e6-40ac-92e4-576d45b4e75c admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:08.203311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cb99e-ee13-4637-b9d6-768f5e174d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:08.203914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cb99e-ee13-4637-b9d6-768f5e174d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:08.204203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cb99e-ee13-4637-b9d6-768f5e174d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:08.204480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cb99e-ee13-4637-b9d6-768f5e174d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:08.206350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cb99e-ee13-4637-b9d6-768f5e174d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:08.208012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cb99e-ee13-4637-b9d6-768f5e174d57 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:08.217832 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1213/2437] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:08.221877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740ff22-c13a-43f4-8dce-0ef28e40234a admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:08.231647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740ff22-c13a-43f4-8dce-0ef28e40234a admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:08.236223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5a816-aedb-4d65-b829-87052761cd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:08.236863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5a816-aedb-4d65-b829-87052761cd58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:08.237145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5a816-aedb-4d65-b829-87052761cd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:08.237455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5a816-aedb-4d65-b829-87052761cd58 admin admin] PATH_INFO: `/v3/projects/6b0b28cbffb04bd98552c26685e674ab/users/9e727894025848fa9aceed55e83f85dc/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:08.239733 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:08.252908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5a816-aedb-4d65-b829-87052761cd58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0b28cbffb04bd98552c26685e674ab, user_id=9e727894025848fa9aceed55e83f85dc, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:08.255676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5a816-aedb-4d65-b829-87052761cd58 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:08.343710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1225/2438] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:40:08 2022] PUT /identity/v3/projects/6b0b28cbffb04bd98552c26685e674ab/users/9e727894025848fa9aceed55e83f85dc/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:08.354903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba54499-7808-40ab-9d6d-6d1e2c79bfbe None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:08.358726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba54499-7808-40ab-9d6d-6d1e2c79bfbe None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:08.358726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba54499-7808-40ab-9d6d-6d1e2c79bfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:08.385672 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2ba54499-7808-40ab-9d6d-6d1e2c79bfbe None None] MFA Rules not processed for user `9e727894025848fa9aceed55e83f85dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:08.386918 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2ba54499-7808-40ab-9d6d-6d1e2c79bfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:08.449812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1214/2439] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:08.461339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5a816-aedb-4d65-b829-87052761cd58 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:08.463120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6ae5a816-aedb-4d65-b829-87052761cd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:08.519497 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5a816-aedb-4d65-b829-87052761cd58 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:08.523165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3f710-bea7-46e2-8121-e4cc83eb3511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:08.523778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3f710-bea7-46e2-8121-e4cc83eb3511 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:08.524064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3f710-bea7-46e2-8121-e4cc83eb3511 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:08.524343 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3f710-bea7-46e2-8121-e4cc83eb3511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:08.532841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3f710-bea7-46e2-8121-e4cc83eb3511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:08.534280 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3f710-bea7-46e2-8121-e4cc83eb3511 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:08.543342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1226/2440] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:10.263024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d55368-3173-42ac-8aeb-94a879fd5402 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:10.263555 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d55368-3173-42ac-8aeb-94a879fd5402 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:10.263728 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d55368-3173-42ac-8aeb-94a879fd5402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:10.284347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-a1d55368-3173-42ac-8aeb-94a879fd5402 None None] MFA Rules not processed for user `9e727894025848fa9aceed55e83f85dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:10.285566 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a1d55368-3173-42ac-8aeb-94a879fd5402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:10.292436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1215/2441] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:18.539673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:20.278889 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:27.737028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c838-d79c-49f5-871b-83fdecc4444c None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:27.737481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c838-d79c-49f5-871b-83fdecc4444c None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:27.737589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c838-d79c-49f5-871b-83fdecc4444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:27.757449 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6a93c838-d79c-49f5-871b-83fdecc4444c None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:27.758686 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6a93c838-d79c-49f5-871b-83fdecc4444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:27.812847 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1227/2442] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:40:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:27.825130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d55368-3173-42ac-8aeb-94a879fd5402 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:27.826519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a1d55368-3173-42ac-8aeb-94a879fd5402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:27.896372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d55368-3173-42ac-8aeb-94a879fd5402 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:27.901272 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf1848-70e0-4e88-b1de-50f77b107a6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:27.901891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf1848-70e0-4e88-b1de-50f77b107a6f service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:27.902181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf1848-70e0-4e88-b1de-50f77b107a6f service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:27.902464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf1848-70e0-4e88-b1de-50f77b107a6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:27.910856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf1848-70e0-4e88-b1de-50f77b107a6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:27.912447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf1848-70e0-4e88-b1de-50f77b107a6f service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:27.920430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1216/2443] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:40:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:40:28.779799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d53d5-80c3-43cd-90bc-1cefe5d623e0 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:28.780253 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d53d5-80c3-43cd-90bc-1cefe5d623e0 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:28.780344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d53d5-80c3-43cd-90bc-1cefe5d623e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:28.799602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-649d53d5-80c3-43cd-90bc-1cefe5d623e0 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:28.800959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-649d53d5-80c3-43cd-90bc-1cefe5d623e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:28.808190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1228/2444] 10.222.0.60 () {58 vars in 967 bytes} [Thu Aug 4 02:40:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:28.820425 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf1848-70e0-4e88-b1de-50f77b107a6f service swift] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:28.830900 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf1848-70e0-4e88-b1de-50f77b107a6f service swift] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:28.836628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4326-1e5a-4415-b4ac-07ae6b099d3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:28.837238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4326-1e5a-4415-b4ac-07ae6b099d3e service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:28.837524 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4326-1e5a-4415-b4ac-07ae6b099d3e service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:28.837800 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4326-1e5a-4415-b4ac-07ae6b099d3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:28.846036 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4326-1e5a-4415-b4ac-07ae6b099d3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:28.847649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4326-1e5a-4415-b4ac-07ae6b099d3e service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:28.856394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1217/2445] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:40:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:40:29.383038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8739d-92eb-4aa3-ad91-53f818c15a69 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:29.389155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8739d-92eb-4aa3-ad91-53f818c15a69 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:29.389155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8739d-92eb-4aa3-ad91-53f818c15a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:29.404336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-5df8739d-92eb-4aa3-ad91-53f818c15a69 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:29.405565 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5df8739d-92eb-4aa3-ad91-53f818c15a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:29.412709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1229/2446] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:40:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:29.424418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4326-1e5a-4415-b4ac-07ae6b099d3e service swift] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:29.435160 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4326-1e5a-4415-b4ac-07ae6b099d3e service swift] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:29.440155 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852acefb-491e-4d97-b579-7f2c4b0627e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:29.440757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852acefb-491e-4d97-b579-7f2c4b0627e6 service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:29.441041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852acefb-491e-4d97-b579-7f2c4b0627e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:29.441318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852acefb-491e-4d97-b579-7f2c4b0627e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:29.449926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852acefb-491e-4d97-b579-7f2c4b0627e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:29.451543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852acefb-491e-4d97-b579-7f2c4b0627e6 service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:29.460239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1218/2447] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:40:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:40:29.974931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b3e33-c065-42fa-8989-3e3c5b916fc0 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:29.975442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b3e33-c065-42fa-8989-3e3c5b916fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:29.975551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b3e33-c065-42fa-8989-3e3c5b916fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:29.994456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-675b3e33-c065-42fa-8989-3e3c5b916fc0 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:29.995672 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-675b3e33-c065-42fa-8989-3e3c5b916fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:30.003027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1230/2448] 10.222.0.60 () {58 vars in 967 bytes} [Thu Aug 4 02:40:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:30.016092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852acefb-491e-4d97-b579-7f2c4b0627e6 service swift] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:30.027282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852acefb-491e-4d97-b579-7f2c4b0627e6 service swift] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:30.032693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e2c9c-350d-4d3a-88b1-e989763a0bad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:30.033290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e2c9c-350d-4d3a-88b1-e989763a0bad service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:30.033572 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e2c9c-350d-4d3a-88b1-e989763a0bad service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:30.033848 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e2c9c-350d-4d3a-88b1-e989763a0bad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:30.042114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e2c9c-350d-4d3a-88b1-e989763a0bad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:30.043746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e2c9c-350d-4d3a-88b1-e989763a0bad service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:30.052288 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1219/2449] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:40:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:40:32.642470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b3e33-c065-42fa-8989-3e3c5b916fc0 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:32.703815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b3e33-c065-42fa-8989-3e3c5b916fc0 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:32.708804 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:32.709432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:32.709712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:32.709983 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] PATH_INFO: `/v3/users/9e727894025848fa9aceed55e83f85dc` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:32.711154 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e727894025848fa9aceed55e83f85dc)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:32.713071 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:32.865383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e727894025848fa9aceed55e83f85dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:32.920774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e727894025848fa9aceed55e83f85dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:32.927891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e727894025848fa9aceed55e83f85dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:32.932747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e727894025848fa9aceed55e83f85dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:32.932747 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e727894025848fa9aceed55e83f85dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:32.947028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1231/2450] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:40:32 2022] DELETE /identity/v3/users/9e727894025848fa9aceed55e83f85dc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:32.951487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148c1e3-6166-4327-8fcc-aa0e43e40be2 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:32.951960 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148c1e3-6166-4327-8fcc-aa0e43e40be2 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:32.952058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148c1e3-6166-4327-8fcc-aa0e43e40be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:32.970926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-a148c1e3-6166-4327-8fcc-aa0e43e40be2 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:32.972117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a148c1e3-6166-4327-8fcc-aa0e43e40be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:33.030027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1220/2451] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:33.039714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:33.041171 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:33.050610 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:33.107345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b2ee3-6fc8-4b04-b322-482007556a2d admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:33.112793 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36094818-c902-4407-9f4f-0847521702b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:33.113741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36094818-c902-4407-9f4f-0847521702b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:33.114001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36094818-c902-4407-9f4f-0847521702b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:33.114368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36094818-c902-4407-9f4f-0847521702b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:33.126926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36094818-c902-4407-9f4f-0847521702b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:33.128640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36094818-c902-4407-9f4f-0847521702b0 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:33.140564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1232/2452] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:33.380256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148c1e3-6166-4327-8fcc-aa0e43e40be2 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:33.381719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a148c1e3-6166-4327-8fcc-aa0e43e40be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:33.395007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148c1e3-6166-4327-8fcc-aa0e43e40be2 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:33.399933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1e6ee-a892-4196-9df5-8f9d7b929908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:33.400581 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1e6ee-a892-4196-9df5-8f9d7b929908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:33.400867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1e6ee-a892-4196-9df5-8f9d7b929908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:33.401143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1e6ee-a892-4196-9df5-8f9d7b929908 admin admin] PATH_INFO: `/v3/projects/6b0b28cbffb04bd98552c26685e674ab` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:33.402311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1e6ee-a892-4196-9df5-8f9d7b929908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0b28cbffb04bd98552c26685e674ab)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:33.404580 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1e6ee-a892-4196-9df5-8f9d7b929908 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:33.667161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:33.670233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d6e1e6ee-a892-4196-9df5-8f9d7b929908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0b28cbffb04bd98552c26685e674ab', 'request_id': 'req-d6e1e6ee-a892-4196-9df5-8f9d7b929908'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:33.675865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d6e1e6ee-a892-4196-9df5-8f9d7b929908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0b28cbffb04bd98552c26685e674ab', 'request_id': 'req-d6e1e6ee-a892-4196-9df5-8f9d7b929908'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:33.761664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d6e1e6ee-a892-4196-9df5-8f9d7b929908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0b28cbffb04bd98552c26685e674ab', 'request_id': 'req-d6e1e6ee-a892-4196-9df5-8f9d7b929908'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:33.773942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d6e1e6ee-a892-4196-9df5-8f9d7b929908 admin admin] The token cache is being invalidate because project 6b0b28cbffb04bd98552c26685e674ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:40:33.774148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d6e1e6ee-a892-4196-9df5-8f9d7b929908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:33.774808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d6e1e6ee-a892-4196-9df5-8f9d7b929908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:33.776430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1221/2453] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:40:33 2022] DELETE /identity/v3/projects/6b0b28cbffb04bd98552c26685e674ab => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:33.781823 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960bf41-a3ef-48ab-99ba-911d812f2c04 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:33.782325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960bf41-a3ef-48ab-99ba-911d812f2c04 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:33.782501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960bf41-a3ef-48ab-99ba-911d812f2c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:33.804264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-1960bf41-a3ef-48ab-99ba-911d812f2c04 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:33.805541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1960bf41-a3ef-48ab-99ba-911d812f2c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:33.865014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1233/2454] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:40:33.872700 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b712cfa-9e1e-4730-9961-fe21fda05788 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:33.873011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b712cfa-9e1e-4730-9961-fe21fda05788 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:33.873287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b712cfa-9e1e-4730-9961-fe21fda05788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:33.892479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-3b712cfa-9e1e-4730-9961-fe21fda05788 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:33.893619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3b712cfa-9e1e-4730-9961-fe21fda05788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:33.901651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1222/2455] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:33.906159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960bf41-a3ef-48ab-99ba-911d812f2c04 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:33.916441 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960bf41-a3ef-48ab-99ba-911d812f2c04 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:33.921066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444a7f8-1468-40ab-b85d-38f22ce6d0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:33.921675 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a7f8-1468-40ab-b85d-38f22ce6d0cd admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:33.921958 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a7f8-1468-40ab-b85d-38f22ce6d0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:33.922235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a7f8-1468-40ab-b85d-38f22ce6d0cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:33.922973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444a7f8-1468-40ab-b85d-38f22ce6d0cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:40:33.923283 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444a7f8-1468-40ab-b85d-38f22ce6d0cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:33.924886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444a7f8-1468-40ab-b85d-38f22ce6d0cd admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:33.936964 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1234/2456] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:40:33.941339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b712cfa-9e1e-4730-9961-fe21fda05788 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:33.950543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b712cfa-9e1e-4730-9961-fe21fda05788 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:33.955201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cee61-8ea2-43e1-a3cc-a034e66d6dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:33.955810 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cee61-8ea2-43e1-a3cc-a034e66d6dda admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:33.956094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cee61-8ea2-43e1-a3cc-a034e66d6dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:33.956369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cee61-8ea2-43e1-a3cc-a034e66d6dda admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:33.957035 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cee61-8ea2-43e1-a3cc-a034e66d6dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:33.959278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cee61-8ea2-43e1-a3cc-a034e66d6dda admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:34.083045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1223/2457] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:40:33 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:34.087325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444a7f8-1468-40ab-b85d-38f22ce6d0cd admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:34.099497 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444a7f8-1468-40ab-b85d-38f22ce6d0cd admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:34.157946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4de7b-ac9c-41c8-8677-f91b1d12df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:34.158566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4de7b-ac9c-41c8-8677-f91b1d12df59 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:34.158862 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4de7b-ac9c-41c8-8677-f91b1d12df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:34.159142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4de7b-ac9c-41c8-8677-f91b1d12df59 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:34.159817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4de7b-ac9c-41c8-8677-f91b1d12df59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:34.162423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4de7b-ac9c-41c8-8677-f91b1d12df59 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:34.235583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1235/2458] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:40:34 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:34.239852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cee61-8ea2-43e1-a3cc-a034e66d6dda admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:34.250183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cee61-8ea2-43e1-a3cc-a034e66d6dda admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:34.254792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2cfc8-d1a2-4ed3-a2e4-08e454daefd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:34.255466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2cfc8-d1a2-4ed3-a2e4-08e454daefd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:34.255748 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2cfc8-d1a2-4ed3-a2e4-08e454daefd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:34.256019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2cfc8-d1a2-4ed3-a2e4-08e454daefd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:34.256752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2cfc8-d1a2-4ed3-a2e4-08e454daefd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:34.258368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2cfc8-d1a2-4ed3-a2e4-08e454daefd9 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:34.268361 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1224/2459] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:34.276478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4de7b-ac9c-41c8-8677-f91b1d12df59 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:34.290368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4de7b-ac9c-41c8-8677-f91b1d12df59 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:34.295483 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7c0e6-b217-4d50-9bf2-22aabcaa09e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:34.296195 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7c0e6-b217-4d50-9bf2-22aabcaa09e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:34.296471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7c0e6-b217-4d50-9bf2-22aabcaa09e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:34.296748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7c0e6-b217-4d50-9bf2-22aabcaa09e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:34.297454 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7c0e6-b217-4d50-9bf2-22aabcaa09e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:34.299096 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7c0e6-b217-4d50-9bf2-22aabcaa09e9 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:34.310608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1236/2460] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:34.316992 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2cfc8-d1a2-4ed3-a2e4-08e454daefd9 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:34.328323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2cfc8-d1a2-4ed3-a2e4-08e454daefd9 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:34.333894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217d144-699a-46a3-bd9e-b115919cfef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:34.334616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217d144-699a-46a3-bd9e-b115919cfef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:34.334927 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217d144-699a-46a3-bd9e-b115919cfef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:34.335392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217d144-699a-46a3-bd9e-b115919cfef5 admin admin] PATH_INFO: `/v3/projects/b14b11a92ccb494ea480962861bac477/users/8a7246f0c1f44d968ca839d36ecae75e/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:34.352135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217d144-699a-46a3-bd9e-b115919cfef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14b11a92ccb494ea480962861bac477, user_id=8a7246f0c1f44d968ca839d36ecae75e, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:34.354817 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217d144-699a-46a3-bd9e-b115919cfef5 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:34.423882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1225/2461] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:40:34 2022] PUT /identity/v3/projects/b14b11a92ccb494ea480962861bac477/users/8a7246f0c1f44d968ca839d36ecae75e/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:34.429367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5af7d9-85f4-4a72-97f0-4230c2955dfa None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:34.429662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5af7d9-85f4-4a72-97f0-4230c2955dfa None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:34.429943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5af7d9-85f4-4a72-97f0-4230c2955dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:34.452059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9d5af7d9-85f4-4a72-97f0-4230c2955dfa None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:34.453263 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9d5af7d9-85f4-4a72-97f0-4230c2955dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:34.462794 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:34.514735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1237/2462] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:34.527296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217d144-699a-46a3-bd9e-b115919cfef5 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:34.529347 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9217d144-699a-46a3-bd9e-b115919cfef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:34.587535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217d144-699a-46a3-bd9e-b115919cfef5 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:34.592554 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba9e7c-ffd0-4347-90fd-381ffbb0f6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:34.593262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba9e7c-ffd0-4347-90fd-381ffbb0f6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:34.593627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba9e7c-ffd0-4347-90fd-381ffbb0f6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:34.593979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba9e7c-ffd0-4347-90fd-381ffbb0f6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:34.603661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba9e7c-ffd0-4347-90fd-381ffbb0f6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:34.605156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba9e7c-ffd0-4347-90fd-381ffbb0f6b5 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:34.614808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1226/2463] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:41.792831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e67eca-e66d-43ee-8aa5-6c1f01e89f03 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:41.793359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e67eca-e66d-43ee-8aa5-6c1f01e89f03 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:41.793448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e67eca-e66d-43ee-8aa5-6c1f01e89f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:41.833184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-86e67eca-e66d-43ee-8aa5-6c1f01e89f03 None None] MFA Rules not processed for user `8a7246f0c1f44d968ca839d36ecae75e`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:41.833184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-86e67eca-e66d-43ee-8aa5-6c1f01e89f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:41.899772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1238/2464] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:41.904598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba9e7c-ffd0-4347-90fd-381ffbb0f6b5 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:41.918939 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba9e7c-ffd0-4347-90fd-381ffbb0f6b5 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:41.921894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88536b8-a24a-4657-b9d0-a8abef7a6299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:41.922782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88536b8-a24a-4657-b9d0-a8abef7a6299 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:41.923977 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88536b8-a24a-4657-b9d0-a8abef7a6299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:41.924399 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88536b8-a24a-4657-b9d0-a8abef7a6299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:41.925275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88536b8-a24a-4657-b9d0-a8abef7a6299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:41.928661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88536b8-a24a-4657-b9d0-a8abef7a6299 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:42.059116 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1227/2465] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:40:41 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:42.063659 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e67eca-e66d-43ee-8aa5-6c1f01e89f03 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:42.075743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e67eca-e66d-43ee-8aa5-6c1f01e89f03 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:42.146819 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a1dc9-4efc-4221-8d48-9fbd755eb4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:42.147595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a1dc9-4efc-4221-8d48-9fbd755eb4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:42.147887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a1dc9-4efc-4221-8d48-9fbd755eb4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:42.148213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a1dc9-4efc-4221-8d48-9fbd755eb4e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:42.148960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a1dc9-4efc-4221-8d48-9fbd755eb4e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:42.151063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a1dc9-4efc-4221-8d48-9fbd755eb4e6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:42.236515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1239/2466] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:40:42 2022] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:40:42.241173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88536b8-a24a-4657-b9d0-a8abef7a6299 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:42.252176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88536b8-a24a-4657-b9d0-a8abef7a6299 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:42.258010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caac40-a70e-4620-91d7-03fc484efcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:42.258352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caac40-a70e-4620-91d7-03fc484efcda admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:42.258352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caac40-a70e-4620-91d7-03fc484efcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:42.258679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41caac40-a70e-4620-91d7-03fc484efcda admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:42.259396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41caac40-a70e-4620-91d7-03fc484efcda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:42.261016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41caac40-a70e-4620-91d7-03fc484efcda admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:42.272677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1228/2467] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:40:42.277059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a1dc9-4efc-4221-8d48-9fbd755eb4e6 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:42.288238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a1dc9-4efc-4221-8d48-9fbd755eb4e6 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:42.293035 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c96eb-ebf2-410c-bc58-9664ee598c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:42.293718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c96eb-ebf2-410c-bc58-9664ee598c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:42.294011 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c96eb-ebf2-410c-bc58-9664ee598c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:42.294292 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c96eb-ebf2-410c-bc58-9664ee598c26 admin admin] PATH_INFO: `/v3/projects/330d77a7bd414a0dbc401c900a3ce688/users/27e4a4e58d744bac91683645307f127a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:42.310146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c96eb-ebf2-410c-bc58-9664ee598c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330d77a7bd414a0dbc401c900a3ce688, user_id=27e4a4e58d744bac91683645307f127a, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:42.312910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c96eb-ebf2-410c-bc58-9664ee598c26 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:42.374863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1240/2468] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:40:42 2022] PUT /identity/v3/projects/330d77a7bd414a0dbc401c900a3ce688/users/27e4a4e58d744bac91683645307f127a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:40:42.378796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caac40-a70e-4620-91d7-03fc484efcda admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:42.389815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41caac40-a70e-4620-91d7-03fc484efcda admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:42.436419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:42.458600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f32a83-f61c-49d4-8efe-73e961c0da15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:42.459177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f32a83-f61c-49d4-8efe-73e961c0da15 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:42.459669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f32a83-f61c-49d4-8efe-73e961c0da15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:42.460277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f32a83-f61c-49d4-8efe-73e961c0da15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:42.461357 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f32a83-f61c-49d4-8efe-73e961c0da15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:42.463364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f32a83-f61c-49d4-8efe-73e961c0da15 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:42.476372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1229/2469] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:40:42.480516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c96eb-ebf2-410c-bc58-9664ee598c26 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:42.494567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c96eb-ebf2-410c-bc58-9664ee598c26 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:42.500255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6c29-5807-4a98-9b74-3d27d69817bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:42.500995 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6c29-5807-4a98-9b74-3d27d69817bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:42.501311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6c29-5807-4a98-9b74-3d27d69817bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:42.501595 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6c29-5807-4a98-9b74-3d27d69817bf admin admin] PATH_INFO: `/v3/projects/330d77a7bd414a0dbc401c900a3ce688/users/27e4a4e58d744bac91683645307f127a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:42.503814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f6c29-5807-4a98-9b74-3d27d69817bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=330d77a7bd414a0dbc401c900a3ce688, user_id=27e4a4e58d744bac91683645307f127a, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:42.506960 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f6c29-5807-4a98-9b74-3d27d69817bf admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:42.510782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:42.518816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1241/2470] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:40:42 2022] PUT /identity/v3/projects/330d77a7bd414a0dbc401c900a3ce688/users/27e4a4e58d744bac91683645307f127a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:44.266093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6632c-23d7-46ee-8935-5cc128aeacad None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:44.271585 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6632c-23d7-46ee-8935-5cc128aeacad None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:44.272108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6632c-23d7-46ee-8935-5cc128aeacad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:44.325583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-21a6632c-23d7-46ee-8935-5cc128aeacad None None] MFA Rules not processed for user `64be537a50754c838554d1a2e0a4177a`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:44.327670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-21a6632c-23d7-46ee-8935-5cc128aeacad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:44.435913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1230/2471] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:50.905488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad38540-6aca-49c8-8abb-575879c02799 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:50.906418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad38540-6aca-49c8-8abb-575879c02799 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:50.906717 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad38540-6aca-49c8-8abb-575879c02799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:50.937259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-1ad38540-6aca-49c8-8abb-575879c02799 None None] MFA Rules not processed for user `27e4a4e58d744bac91683645307f127a`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:50.938710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1ad38540-6aca-49c8-8abb-575879c02799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:51.015119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1242/2472] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:40:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:51.028371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6632c-23d7-46ee-8935-5cc128aeacad None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:51.033795 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-21a6632c-23d7-46ee-8935-5cc128aeacad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:51.109880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6632c-23d7-46ee-8935-5cc128aeacad None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:51.119225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd4e4c-4b02-49ff-837a-dc94de64b5ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bd2ed69b324e85b8166135f045b840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:51.120134 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd4e4c-4b02-49ff-837a-dc94de64b5ab service glance] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:51.120418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd4e4c-4b02-49ff-837a-dc94de64b5ab service glance] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:51.120692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd4e4c-4b02-49ff-837a-dc94de64b5ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:51.193359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd4e4c-4b02-49ff-837a-dc94de64b5ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:51.194863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd4e4c-4b02-49ff-837a-dc94de64b5ab service glance] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:51.205161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1231/2473] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:51.478280 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10888cae-67bc-4e38-88db-53ff77d893df None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:51.478589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10888cae-67bc-4e38-88db-53ff77d893df None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:51.478866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10888cae-67bc-4e38-88db-53ff77d893df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:51.505817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-10888cae-67bc-4e38-88db-53ff77d893df None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:51.511240 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-10888cae-67bc-4e38-88db-53ff77d893df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:51.611784 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1243/2474] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:40:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:40:51.635396 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd4e4c-4b02-49ff-837a-dc94de64b5ab service glance] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:51.636782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e5fd4e4c-4b02-49ff-837a-dc94de64b5ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:51.677798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=100 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:51.715251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd4e4c-4b02-49ff-837a-dc94de64b5ab service glance] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:51.721138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8c9d1-eda1-4cf8-8d39-634a26818382 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:51.722360 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8c9d1-eda1-4cf8-8d39-634a26818382 service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:51.723166 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8c9d1-eda1-4cf8-8d39-634a26818382 service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:51.723450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8c9d1-eda1-4cf8-8d39-634a26818382 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:51.733461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8c9d1-eda1-4cf8-8d39-634a26818382 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:51.735132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8c9d1-eda1-4cf8-8d39-634a26818382 service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:51.743468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1232/2475] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:40:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:41:01.604574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=61 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:01.740218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=16 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:03.838144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0160ce-0b63-4eb0-bb52-65ff5cafc852 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:03.838780 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0160ce-0b63-4eb0-bb52-65ff5cafc852 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:03.838780 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0160ce-0b63-4eb0-bb52-65ff5cafc852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:03.858364 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8f0160ce-0b63-4eb0-bb52-65ff5cafc852 None None] MFA Rules not processed for user `8a7246f0c1f44d968ca839d36ecae75e`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:03.859726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8f0160ce-0b63-4eb0-bb52-65ff5cafc852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:03.867749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1244/2476] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:04.919973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382e91-9234-471a-a118-1d0926787e90 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.920488 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382e91-9234-471a-a118-1d0926787e90 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.920568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382e91-9234-471a-a118-1d0926787e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.942062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-cb382e91-9234-471a-a118-1d0926787e90 None None] MFA Rules not processed for user `99068d55e19e4b3cbf9197ca46d86fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:04.943333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cb382e91-9234-471a-a118-1d0926787e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:05.002687 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1233/2477] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:08.219061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737317b-ca75-4057-a242-7167679bf89f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:08.219629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737317b-ca75-4057-a242-7167679bf89f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:08.219629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737317b-ca75-4057-a242-7167679bf89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:08.244360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e737317b-ca75-4057-a242-7167679bf89f None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:08.245899 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e737317b-ca75-4057-a242-7167679bf89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:08.255858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1245/2478] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:41:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:08.270951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb382e91-9234-471a-a118-1d0926787e90 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:08.289952 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb382e91-9234-471a-a118-1d0926787e90 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:08.296521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd395a2-dc7f-465b-9475-7f70b78151cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:08.297475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd395a2-dc7f-465b-9475-7f70b78151cd service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:08.297999 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd395a2-dc7f-465b-9475-7f70b78151cd service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:08.298544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd395a2-dc7f-465b-9475-7f70b78151cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:08.309881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd395a2-dc7f-465b-9475-7f70b78151cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:08.312171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd395a2-dc7f-465b-9475-7f70b78151cd service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:08.324457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1234/2479] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:41:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:41:12.558099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737317b-ca75-4057-a242-7167679bf89f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:12.568669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e737317b-ca75-4057-a242-7167679bf89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:12.675888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737317b-ca75-4057-a242-7167679bf89f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:12.682217 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bcc18-2924-4d07-a271-916dd74be286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:12.683252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bcc18-2924-4d07-a271-916dd74be286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:12.683831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bcc18-2924-4d07-a271-916dd74be286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:12.684360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bcc18-2924-4d07-a271-916dd74be286 admin admin] PATH_INFO: `/v3/users/2e47969dca184aec92e620fcd53d6a5c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:12.686034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bcc18-2924-4d07-a271-916dd74be286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e47969dca184aec92e620fcd53d6a5c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:12.691632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bcc18-2924-4d07-a271-916dd74be286 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:12.939083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a66bcc18-2924-4d07-a271-916dd74be286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e47969dca184aec92e620fcd53d6a5c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.030197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a66bcc18-2924-4d07-a271-916dd74be286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e47969dca184aec92e620fcd53d6a5c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.059006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a66bcc18-2924-4d07-a271-916dd74be286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e47969dca184aec92e620fcd53d6a5c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.060082 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a66bcc18-2924-4d07-a271-916dd74be286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e47969dca184aec92e620fcd53d6a5c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.061018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a66bcc18-2924-4d07-a271-916dd74be286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e47969dca184aec92e620fcd53d6a5c'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.093623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1246/2480] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:12 2022] DELETE /identity/v3/users/2e47969dca184aec92e620fcd53d6a5c => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:41:13.570372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd395a2-dc7f-465b-9475-7f70b78151cd service swift] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:13.584626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd395a2-dc7f-465b-9475-7f70b78151cd service swift] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:13.673012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:13.674971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:13.675475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:13.676075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48 admin admin] PATH_INFO: `/v3/projects/651f296b94d342488b3cd98998a08e02` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:13.677766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=651f296b94d342488b3cd98998a08e02)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:13.680128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:13.805243 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '651f296b94d342488b3cd98998a08e02', 'request_id': 'req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.810879 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '651f296b94d342488b3cd98998a08e02', 'request_id': 'req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.869819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '651f296b94d342488b3cd98998a08e02', 'request_id': 'req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.886735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48 admin admin] The token cache is being invalidate because project 651f296b94d342488b3cd98998a08e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:13.887201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.888024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-ba7d3f85-bb65-4739-9b7d-98a4585b5e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.890303 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1235/2481] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:13 2022] DELETE /identity/v3/projects/651f296b94d342488b3cd98998a08e02 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:13.895884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a44f7-a28f-4547-8b51-6e11cf51fa17 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:13.898415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a44f7-a28f-4547-8b51-6e11cf51fa17 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:13.898415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a44f7-a28f-4547-8b51-6e11cf51fa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:13.917063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-443a44f7-a28f-4547-8b51-6e11cf51fa17 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:13.918309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-443a44f7-a28f-4547-8b51-6e11cf51fa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:13.990022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1247/2482] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:13.998652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da2ee5-87a0-4ea9-ac4c-6075143969c7 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:13.999023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da2ee5-87a0-4ea9-ac4c-6075143969c7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:13.999255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da2ee5-87a0-4ea9-ac4c-6075143969c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:14.020070 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-77da2ee5-87a0-4ea9-ac4c-6075143969c7 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:14.025933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-77da2ee5-87a0-4ea9-ac4c-6075143969c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:14.038519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1236/2483] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:14.042003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a44f7-a28f-4547-8b51-6e11cf51fa17 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:14.057699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a44f7-a28f-4547-8b51-6e11cf51fa17 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:14.063091 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc316acc-6d1f-42dc-a2c3-34aaf475267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:14.063714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc316acc-6d1f-42dc-a2c3-34aaf475267c admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:14.064001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc316acc-6d1f-42dc-a2c3-34aaf475267c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:14.064277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc316acc-6d1f-42dc-a2c3-34aaf475267c admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:14.064987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc316acc-6d1f-42dc-a2c3-34aaf475267c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:14.065294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc316acc-6d1f-42dc-a2c3-34aaf475267c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:14.067482 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc316acc-6d1f-42dc-a2c3-34aaf475267c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:14.069246 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:14.080235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1248/2484] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:41:14.087483 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da2ee5-87a0-4ea9-ac4c-6075143969c7 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:14.096918 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da2ee5-87a0-4ea9-ac4c-6075143969c7 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:14.101991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaa987-8527-40d1-a554-e4d17ef5c44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:14.102657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaa987-8527-40d1-a554-e4d17ef5c44a admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:14.102944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaa987-8527-40d1-a554-e4d17ef5c44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:14.103559 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaa987-8527-40d1-a554-e4d17ef5c44a admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:14.104290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaa987-8527-40d1-a554-e4d17ef5c44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:14.106355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaa987-8527-40d1-a554-e4d17ef5c44a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:14.124613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:14.232458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1237/2485] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:14 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:14.236564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc316acc-6d1f-42dc-a2c3-34aaf475267c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:14.248860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc316acc-6d1f-42dc-a2c3-34aaf475267c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:14.338120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d63d6-7b84-495f-b012-af77927aebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:14.338820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d63d6-7b84-495f-b012-af77927aebdb admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:14.339103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d63d6-7b84-495f-b012-af77927aebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:14.339380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d63d6-7b84-495f-b012-af77927aebdb admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:14.340077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d63d6-7b84-495f-b012-af77927aebdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:14.342183 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d63d6-7b84-495f-b012-af77927aebdb admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:14.426560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1249/2486] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:14 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:14.430029 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaa987-8527-40d1-a554-e4d17ef5c44a admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:14.442305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaa987-8527-40d1-a554-e4d17ef5c44a admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:14.447561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61576bc7-f471-479d-95e5-e7bc474878fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:14.448243 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61576bc7-f471-479d-95e5-e7bc474878fe admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:14.448551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61576bc7-f471-479d-95e5-e7bc474878fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:14.448844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61576bc7-f471-479d-95e5-e7bc474878fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:14.449575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61576bc7-f471-479d-95e5-e7bc474878fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:14.451497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61576bc7-f471-479d-95e5-e7bc474878fe admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:14.474534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1238/2487] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:14.476211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d63d6-7b84-495f-b012-af77927aebdb admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:14.487519 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d63d6-7b84-495f-b012-af77927aebdb admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:14.492924 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393d4d7-012a-4a37-a581-dab3f4262d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:14.493548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393d4d7-012a-4a37-a581-dab3f4262d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:14.493836 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393d4d7-012a-4a37-a581-dab3f4262d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:14.494113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393d4d7-012a-4a37-a581-dab3f4262d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:14.494851 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393d4d7-012a-4a37-a581-dab3f4262d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:14.496474 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393d4d7-012a-4a37-a581-dab3f4262d9e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:14.508055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1250/2488] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:14.512622 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61576bc7-f471-479d-95e5-e7bc474878fe admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:14.523457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61576bc7-f471-479d-95e5-e7bc474878fe admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:14.528165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9b0fe-8487-48e3-8fd1-e0b9c32c96b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:14.529080 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9b0fe-8487-48e3-8fd1-e0b9c32c96b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:14.529360 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9b0fe-8487-48e3-8fd1-e0b9c32c96b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:14.529634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9b0fe-8487-48e3-8fd1-e0b9c32c96b6 admin admin] PATH_INFO: `/v3/projects/76d761a50cf1463b9b0666478ae67a3a/users/a25cbfe7a16340f0a178c167e2ca1be4/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:14.549008 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9b0fe-8487-48e3-8fd1-e0b9c32c96b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d761a50cf1463b9b0666478ae67a3a, user_id=a25cbfe7a16340f0a178c167e2ca1be4, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:14.553906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9b0fe-8487-48e3-8fd1-e0b9c32c96b6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:14.698802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1239/2489] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:14 2022] PUT /identity/v3/projects/76d761a50cf1463b9b0666478ae67a3a/users/a25cbfe7a16340f0a178c167e2ca1be4/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:14.709337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce851c4-2d23-45c9-948c-759cf2a51941 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:14.709941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce851c4-2d23-45c9-948c-759cf2a51941 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:14.710599 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce851c4-2d23-45c9-948c-759cf2a51941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:14.755836 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-5ce851c4-2d23-45c9-948c-759cf2a51941 None None] MFA Rules not processed for user `a25cbfe7a16340f0a178c167e2ca1be4`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:14.755836 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5ce851c4-2d23-45c9-948c-759cf2a51941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:14.870230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1251/2490] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:14.877476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9b0fe-8487-48e3-8fd1-e0b9c32c96b6 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:14.879674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-75c9b0fe-8487-48e3-8fd1-e0b9c32c96b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:14.980185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9b0fe-8487-48e3-8fd1-e0b9c32c96b6 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:14.986642 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cef23-d369-42cf-b78b-57d9993d0249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:14.987331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cef23-d369-42cf-b78b-57d9993d0249 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:14.987865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cef23-d369-42cf-b78b-57d9993d0249 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:14.988856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cef23-d369-42cf-b78b-57d9993d0249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:14.999975 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cef23-d369-42cf-b78b-57d9993d0249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:15.004171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cef23-d369-42cf-b78b-57d9993d0249 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:15.014043 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1240/2491] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:18.275718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce851c4-2d23-45c9-948c-759cf2a51941 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:18.349201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce851c4-2d23-45c9-948c-759cf2a51941 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:18.353973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:18.354658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:18.354976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:18.355253 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] PATH_INFO: `/v3/users/a25cbfe7a16340f0a178c167e2ca1be4` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:18.359361 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25cbfe7a16340f0a178c167e2ca1be4)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:18.361342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:18.365243 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:18.570862 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25cbfe7a16340f0a178c167e2ca1be4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:18.624245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25cbfe7a16340f0a178c167e2ca1be4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:18.633192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25cbfe7a16340f0a178c167e2ca1be4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:18.634024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25cbfe7a16340f0a178c167e2ca1be4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:18.634772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25cbfe7a16340f0a178c167e2ca1be4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:18.652056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1252/2492] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:18 2022] DELETE /identity/v3/users/a25cbfe7a16340f0a178c167e2ca1be4 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:18.656979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757d2a0-5b8a-4c2f-8ed2-9341490fe113 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:18.657570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757d2a0-5b8a-4c2f-8ed2-9341490fe113 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:18.658030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757d2a0-5b8a-4c2f-8ed2-9341490fe113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:18.678655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2757d2a0-5b8a-4c2f-8ed2-9341490fe113 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:18.680124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2757d2a0-5b8a-4c2f-8ed2-9341490fe113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:18.749866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1241/2493] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:18.757564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:18.759184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:18.822144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e5363-f36b-4fe6-8db9-40355ac50782 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:18.825809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a82ce5-29e9-4b72-b38e-cf05b3d9b157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:18.826441 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a82ce5-29e9-4b72-b38e-cf05b3d9b157 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:18.826762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a82ce5-29e9-4b72-b38e-cf05b3d9b157 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:18.827040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a82ce5-29e9-4b72-b38e-cf05b3d9b157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:18.838174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a82ce5-29e9-4b72-b38e-cf05b3d9b157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:18.839695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a82ce5-29e9-4b72-b38e-cf05b3d9b157 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:18.850459 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1253/2494] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:19.261643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757d2a0-5b8a-4c2f-8ed2-9341490fe113 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:19.263377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2757d2a0-5b8a-4c2f-8ed2-9341490fe113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:19.276518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757d2a0-5b8a-4c2f-8ed2-9341490fe113 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:19.281492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0f350-4720-461e-8294-eb29951c503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:19.282136 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0f350-4720-461e-8294-eb29951c503e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:19.282446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0f350-4720-461e-8294-eb29951c503e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:19.282754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0f350-4720-461e-8294-eb29951c503e admin admin] PATH_INFO: `/v3/projects/76d761a50cf1463b9b0666478ae67a3a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:19.283979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0f350-4720-461e-8294-eb29951c503e admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d761a50cf1463b9b0666478ae67a3a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:19.286385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0f350-4720-461e-8294-eb29951c503e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:19.386758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:19.398399 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1e0f350-4720-461e-8294-eb29951c503e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d761a50cf1463b9b0666478ae67a3a', 'request_id': 'req-d1e0f350-4720-461e-8294-eb29951c503e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:19.406119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1e0f350-4720-461e-8294-eb29951c503e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d761a50cf1463b9b0666478ae67a3a', 'request_id': 'req-d1e0f350-4720-461e-8294-eb29951c503e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:19.481239 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1e0f350-4720-461e-8294-eb29951c503e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d761a50cf1463b9b0666478ae67a3a', 'request_id': 'req-d1e0f350-4720-461e-8294-eb29951c503e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:19.493904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1e0f350-4720-461e-8294-eb29951c503e admin admin] The token cache is being invalidate because project 76d761a50cf1463b9b0666478ae67a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:19.494193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1e0f350-4720-461e-8294-eb29951c503e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:19.494890 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1e0f350-4720-461e-8294-eb29951c503e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:19.496465 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1242/2495] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:19 2022] DELETE /identity/v3/projects/76d761a50cf1463b9b0666478ae67a3a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:19.501224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae452a9-5b9e-445e-9273-e0e1712e6cd8 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:19.501723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae452a9-5b9e-445e-9273-e0e1712e6cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:19.501826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae452a9-5b9e-445e-9273-e0e1712e6cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:19.521295 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-0ae452a9-5b9e-445e-9273-e0e1712e6cd8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:19.522437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0ae452a9-5b9e-445e-9273-e0e1712e6cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:19.581422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1254/2496] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:19.589200 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01df5-b3be-4c0a-8d92-f4b81dcbdcc5 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:19.589491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01df5-b3be-4c0a-8d92-f4b81dcbdcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:19.589797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01df5-b3be-4c0a-8d92-f4b81dcbdcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:19.609898 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-66b01df5-b3be-4c0a-8d92-f4b81dcbdcc5 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:19.611199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-66b01df5-b3be-4c0a-8d92-f4b81dcbdcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:19.619878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1243/2497] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:19.624094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae452a9-5b9e-445e-9273-e0e1712e6cd8 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:19.633835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae452a9-5b9e-445e-9273-e0e1712e6cd8 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:19.638505 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24663f-4f89-4f52-b72e-cb9d54861fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:19.639114 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24663f-4f89-4f52-b72e-cb9d54861fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:19.639399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24663f-4f89-4f52-b72e-cb9d54861fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:19.639674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24663f-4f89-4f52-b72e-cb9d54861fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:19.640402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24663f-4f89-4f52-b72e-cb9d54861fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:19.640711 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24663f-4f89-4f52-b72e-cb9d54861fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:19.642302 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24663f-4f89-4f52-b72e-cb9d54861fcf admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:19.653861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1255/2498] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:41:19.657976 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01df5-b3be-4c0a-8d92-f4b81dcbdcc5 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:19.667997 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01df5-b3be-4c0a-8d92-f4b81dcbdcc5 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:19.672662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e28f6-5587-4f7b-aadd-16f363748ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:19.673263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e28f6-5587-4f7b-aadd-16f363748ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:19.673544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e28f6-5587-4f7b-aadd-16f363748ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:19.673815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e28f6-5587-4f7b-aadd-16f363748ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:19.674480 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e28f6-5587-4f7b-aadd-16f363748ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:19.677424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e28f6-5587-4f7b-aadd-16f363748ad6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:19.756743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1244/2499] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:19 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:19.761153 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24663f-4f89-4f52-b72e-cb9d54861fcf admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:19.771870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24663f-4f89-4f52-b72e-cb9d54861fcf admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:19.779965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:19.828975 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50373ef0-e496-41c7-9e53-e10aee2a13ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:19.829591 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50373ef0-e496-41c7-9e53-e10aee2a13ba admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:19.829878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50373ef0-e496-41c7-9e53-e10aee2a13ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:19.830158 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50373ef0-e496-41c7-9e53-e10aee2a13ba admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:19.830857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50373ef0-e496-41c7-9e53-e10aee2a13ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:19.833498 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50373ef0-e496-41c7-9e53-e10aee2a13ba admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:19.938275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1256/2500] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:19 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:19.942651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e28f6-5587-4f7b-aadd-16f363748ad6 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:19.953183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e28f6-5587-4f7b-aadd-16f363748ad6 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:19.958278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada2d59-75e0-4229-bba3-0d147e627932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:19.958912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada2d59-75e0-4229-bba3-0d147e627932 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:19.959193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada2d59-75e0-4229-bba3-0d147e627932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:19.959471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada2d59-75e0-4229-bba3-0d147e627932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:19.960217 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada2d59-75e0-4229-bba3-0d147e627932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:19.961834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada2d59-75e0-4229-bba3-0d147e627932 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:19.971681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1245/2501] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:19.976097 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50373ef0-e496-41c7-9e53-e10aee2a13ba admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:19.985859 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50373ef0-e496-41c7-9e53-e10aee2a13ba admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:19.990452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bf49b-2112-4dfe-bbaf-03337b579264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:19.991078 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bf49b-2112-4dfe-bbaf-03337b579264 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:19.991358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bf49b-2112-4dfe-bbaf-03337b579264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:19.991632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bf49b-2112-4dfe-bbaf-03337b579264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:19.992320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bf49b-2112-4dfe-bbaf-03337b579264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:19.993909 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bf49b-2112-4dfe-bbaf-03337b579264 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:20.004265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1257/2502] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:20.008284 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada2d59-75e0-4229-bba3-0d147e627932 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:20.018049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada2d59-75e0-4229-bba3-0d147e627932 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:20.023254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7291a-0c7f-4d60-bdfa-cddb159f6ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:20.023842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7291a-0c7f-4d60-bdfa-cddb159f6ace admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:20.024123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7291a-0c7f-4d60-bdfa-cddb159f6ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:20.024397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7291a-0c7f-4d60-bdfa-cddb159f6ace admin admin] PATH_INFO: `/v3/projects/c33b8d16158b4dbf81b3301242f706d9/users/cf6072c414a949b18c125e9fec0c2b0c/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:20.039890 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7291a-0c7f-4d60-bdfa-cddb159f6ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33b8d16158b4dbf81b3301242f706d9, user_id=cf6072c414a949b18c125e9fec0c2b0c, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:20.043348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7291a-0c7f-4d60-bdfa-cddb159f6ace admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:20.121412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1246/2503] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:20 2022] PUT /identity/v3/projects/c33b8d16158b4dbf81b3301242f706d9/users/cf6072c414a949b18c125e9fec0c2b0c/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:20.133866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f72a96-7dd4-41d1-9a6b-cba112377d6b None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:20.134161 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f72a96-7dd4-41d1-9a6b-cba112377d6b None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:20.134445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f72a96-7dd4-41d1-9a6b-cba112377d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:20.165368 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c5f72a96-7dd4-41d1-9a6b-cba112377d6b None None] MFA Rules not processed for user `cf6072c414a949b18c125e9fec0c2b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:20.166619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c5f72a96-7dd4-41d1-9a6b-cba112377d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:20.230396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1258/2504] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:20.235040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7291a-0c7f-4d60-bdfa-cddb159f6ace admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:20.297409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7291a-0c7f-4d60-bdfa-cddb159f6ace admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:20.302065 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3db7f4-afc6-4249-840d-a7f677123c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:20.302698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3db7f4-afc6-4249-840d-a7f677123c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:20.302983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3db7f4-afc6-4249-840d-a7f677123c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:20.303257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3db7f4-afc6-4249-840d-a7f677123c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:20.303914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3db7f4-afc6-4249-840d-a7f677123c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:20.305812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3db7f4-afc6-4249-840d-a7f677123c9b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:20.398769 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1247/2505] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:20 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:41:20.402826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f72a96-7dd4-41d1-9a6b-cba112377d6b None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:20.413942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f72a96-7dd4-41d1-9a6b-cba112377d6b None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:20.475663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa60358-cd61-416e-bbbe-bda662020cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:20.476430 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa60358-cd61-416e-bbbe-bda662020cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:20.476714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa60358-cd61-416e-bbbe-bda662020cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:20.476987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa60358-cd61-416e-bbbe-bda662020cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:20.477657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa60358-cd61-416e-bbbe-bda662020cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:20.479680 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa60358-cd61-416e-bbbe-bda662020cf4 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:20.558561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1259/2506] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:20 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:41:20.562875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3db7f4-afc6-4249-840d-a7f677123c9b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:20.574100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3db7f4-afc6-4249-840d-a7f677123c9b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:20.578833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e89b5-6f81-4ae0-8978-11d6f8b8c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:20.579450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e89b5-6f81-4ae0-8978-11d6f8b8c610 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:20.579730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e89b5-6f81-4ae0-8978-11d6f8b8c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:20.580004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e89b5-6f81-4ae0-8978-11d6f8b8c610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:20.580704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e89b5-6f81-4ae0-8978-11d6f8b8c610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:20.582627 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e89b5-6f81-4ae0-8978-11d6f8b8c610 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:20.594764 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1248/2507] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:20.605784 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa60358-cd61-416e-bbbe-bda662020cf4 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:20.616640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa60358-cd61-416e-bbbe-bda662020cf4 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:20.621258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168ff7c-7ec2-4a90-a9ad-c8dbb48d9354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:20.621916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168ff7c-7ec2-4a90-a9ad-c8dbb48d9354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:20.622225 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168ff7c-7ec2-4a90-a9ad-c8dbb48d9354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:20.622579 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168ff7c-7ec2-4a90-a9ad-c8dbb48d9354 admin admin] PATH_INFO: `/v3/projects/eb7fa314dcf34f1795b0d128dcfbfcb3/users/fe04f0833e4d43588fa082882cab0290/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:20.625664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:20.639089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168ff7c-7ec2-4a90-a9ad-c8dbb48d9354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7fa314dcf34f1795b0d128dcfbfcb3, user_id=fe04f0833e4d43588fa082882cab0290, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:20.641930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168ff7c-7ec2-4a90-a9ad-c8dbb48d9354 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:20.744758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1260/2508] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:20 2022] PUT /identity/v3/projects/eb7fa314dcf34f1795b0d128dcfbfcb3/users/fe04f0833e4d43588fa082882cab0290/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:20.748725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e89b5-6f81-4ae0-8978-11d6f8b8c610 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:20.759785 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e89b5-6f81-4ae0-8978-11d6f8b8c610 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:20.793221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:20.817192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceb6ff-bf7b-4f50-bdd6-e8e39b267330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:20.817971 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceb6ff-bf7b-4f50-bdd6-e8e39b267330 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:20.818299 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceb6ff-bf7b-4f50-bdd6-e8e39b267330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:20.818815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceb6ff-bf7b-4f50-bdd6-e8e39b267330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:20.819963 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecceb6ff-bf7b-4f50-bdd6-e8e39b267330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:20.821699 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecceb6ff-bf7b-4f50-bdd6-e8e39b267330 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:20.835416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1249/2509] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:20.836584 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168ff7c-7ec2-4a90-a9ad-c8dbb48d9354 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:20.847907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168ff7c-7ec2-4a90-a9ad-c8dbb48d9354 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:20.852925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aea8f4-57bf-4597-be35-7dde11af2bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:20.854086 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aea8f4-57bf-4597-be35-7dde11af2bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:20.854086 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aea8f4-57bf-4597-be35-7dde11af2bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:20.854299 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aea8f4-57bf-4597-be35-7dde11af2bb1 admin admin] PATH_INFO: `/v3/projects/eb7fa314dcf34f1795b0d128dcfbfcb3/users/fe04f0833e4d43588fa082882cab0290/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:20.856218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aea8f4-57bf-4597-be35-7dde11af2bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7fa314dcf34f1795b0d128dcfbfcb3, user_id=fe04f0833e4d43588fa082882cab0290, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:20.858919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aea8f4-57bf-4597-be35-7dde11af2bb1 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:20.870107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1261/2510] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:20 2022] PUT /identity/v3/projects/eb7fa314dcf34f1795b0d128dcfbfcb3/users/fe04f0833e4d43588fa082882cab0290/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:20.881759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c474a-5d29-450f-88aa-fd72e2425e95 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:20.882051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c474a-5d29-450f-88aa-fd72e2425e95 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:20.882364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c474a-5d29-450f-88aa-fd72e2425e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:20.910944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-0c6c474a-5d29-450f-88aa-fd72e2425e95 None None] MFA Rules not processed for user `fe04f0833e4d43588fa082882cab0290`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:20.912180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0c6c474a-5d29-450f-88aa-fd72e2425e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:20.982446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1250/2511] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:20.994288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aea8f4-57bf-4597-be35-7dde11af2bb1 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:20.996099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e1aea8f4-57bf-4597-be35-7dde11af2bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:21.055427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aea8f4-57bf-4597-be35-7dde11af2bb1 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:21.059094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135654c-5a9d-461f-a155-b7109490dff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:21.059713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135654c-5a9d-461f-a155-b7109490dff5 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:21.059997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135654c-5a9d-461f-a155-b7109490dff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:21.060272 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135654c-5a9d-461f-a155-b7109490dff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:21.069499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135654c-5a9d-461f-a155-b7109490dff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:21.070927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135654c-5a9d-461f-a155-b7109490dff5 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:21.080316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1262/2512] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:24.820091 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c474a-5d29-450f-88aa-fd72e2425e95 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:24.885002 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c474a-5d29-450f-88aa-fd72e2425e95 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:24.889625 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:24.890268 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:24.890589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:24.890873 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] PATH_INFO: `/v3/users/cf6072c414a949b18c125e9fec0c2b0c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:24.892072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6072c414a949b18c125e9fec0c2b0c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:24.894020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:25.056477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6072c414a949b18c125e9fec0c2b0c'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:25.067042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:25.069235 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6072c414a949b18c125e9fec0c2b0c'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:25.069908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6072c414a949b18c125e9fec0c2b0c'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:25.076770 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6072c414a949b18c125e9fec0c2b0c'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:25.161248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6072c414a949b18c125e9fec0c2b0c'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:25.167592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1251/2513] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:24 2022] DELETE /identity/v3/users/cf6072c414a949b18c125e9fec0c2b0c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:25.172342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88356580-adc9-4dd3-a7e7-77b75370ee79 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:25.172837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88356580-adc9-4dd3-a7e7-77b75370ee79 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:25.172936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88356580-adc9-4dd3-a7e7-77b75370ee79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:25.193775 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-88356580-adc9-4dd3-a7e7-77b75370ee79 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:25.195182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-88356580-adc9-4dd3-a7e7-77b75370ee79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:25.257206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1263/2514] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:25.267136 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:25.268438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:25.330965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd611c00-7e80-4ba3-bb6d-835bfe2f76ca admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:25.337330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedbfd4-0b8e-4701-ad16-e7b60df77d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:25.338425 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedbfd4-0b8e-4701-ad16-e7b60df77d1c service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:25.338425 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedbfd4-0b8e-4701-ad16-e7b60df77d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:25.338650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedbfd4-0b8e-4701-ad16-e7b60df77d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:25.348311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedbfd4-0b8e-4701-ad16-e7b60df77d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:25.349768 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedbfd4-0b8e-4701-ad16-e7b60df77d1c service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:25.359779 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1252/2515] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:25.820032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88356580-adc9-4dd3-a7e7-77b75370ee79 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:25.821462 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-88356580-adc9-4dd3-a7e7-77b75370ee79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:25.836758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88356580-adc9-4dd3-a7e7-77b75370ee79 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:25.839942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:25.840590 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:25.840875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:25.841155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] PATH_INFO: `/v3/projects/c33b8d16158b4dbf81b3301242f706d9` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:25.842409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33b8d16158b4dbf81b3301242f706d9)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:25.844355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:25.979517 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33b8d16158b4dbf81b3301242f706d9', 'request_id': 'req-1396964c-6f2b-46e4-a538-002f0c956146'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.069787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33b8d16158b4dbf81b3301242f706d9', 'request_id': 'req-1396964c-6f2b-46e4-a538-002f0c956146'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.076252 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33b8d16158b4dbf81b3301242f706d9', 'request_id': 'req-1396964c-6f2b-46e4-a538-002f0c956146'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.084223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:26.088900 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] The token cache is being invalidate because project c33b8d16158b4dbf81b3301242f706d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:26.089194 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.089845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.091484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1264/2516] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:25 2022] DELETE /identity/v3/projects/c33b8d16158b4dbf81b3301242f706d9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:26.095484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedbfd4-0b8e-4701-ad16-e7b60df77d1c service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:26.106939 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedbfd4-0b8e-4701-ad16-e7b60df77d1c service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:26.168827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e170b-836f-4e3c-9f85-e166e0855e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:26.169487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e170b-836f-4e3c-9f85-e166e0855e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:26.169772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e170b-836f-4e3c-9f85-e166e0855e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:26.170049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e170b-836f-4e3c-9f85-e166e0855e9b admin admin] PATH_INFO: `/v3/users/fe04f0833e4d43588fa082882cab0290` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:26.171470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e170b-836f-4e3c-9f85-e166e0855e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe04f0833e4d43588fa082882cab0290)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:26.173422 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e170b-836f-4e3c-9f85-e166e0855e9b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:26.369663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-700e170b-836f-4e3c-9f85-e166e0855e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe04f0833e4d43588fa082882cab0290'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.383898 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-700e170b-836f-4e3c-9f85-e166e0855e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe04f0833e4d43588fa082882cab0290'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.384598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-700e170b-836f-4e3c-9f85-e166e0855e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe04f0833e4d43588fa082882cab0290'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.391538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-700e170b-836f-4e3c-9f85-e166e0855e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe04f0833e4d43588fa082882cab0290'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.469674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-700e170b-836f-4e3c-9f85-e166e0855e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe04f0833e4d43588fa082882cab0290'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.472197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:26.476809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1253/2517] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:26 2022] DELETE /identity/v3/users/fe04f0833e4d43588fa082882cab0290 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:26.917107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:26.918652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:26.940869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396964c-6f2b-46e4-a538-002f0c956146 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:27.009123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd23d6c-33dd-4ac2-879d-b76deed410e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:27.009685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd23d6c-33dd-4ac2-879d-b76deed410e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:27.009969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd23d6c-33dd-4ac2-879d-b76deed410e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:27.010249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd23d6c-33dd-4ac2-879d-b76deed410e6 admin admin] PATH_INFO: `/v3/projects/eb7fa314dcf34f1795b0d128dcfbfcb3` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:27.011445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd23d6c-33dd-4ac2-879d-b76deed410e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7fa314dcf34f1795b0d128dcfbfcb3)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:27.013391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd23d6c-33dd-4ac2-879d-b76deed410e6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:27.160387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6dd23d6c-33dd-4ac2-879d-b76deed410e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7fa314dcf34f1795b0d128dcfbfcb3', 'request_id': 'req-6dd23d6c-33dd-4ac2-879d-b76deed410e6'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:27.229572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6dd23d6c-33dd-4ac2-879d-b76deed410e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7fa314dcf34f1795b0d128dcfbfcb3', 'request_id': 'req-6dd23d6c-33dd-4ac2-879d-b76deed410e6'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:27.235618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6dd23d6c-33dd-4ac2-879d-b76deed410e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7fa314dcf34f1795b0d128dcfbfcb3', 'request_id': 'req-6dd23d6c-33dd-4ac2-879d-b76deed410e6'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:27.247892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6dd23d6c-33dd-4ac2-879d-b76deed410e6 admin admin] The token cache is being invalidate because project eb7fa314dcf34f1795b0d128dcfbfcb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:27.248188 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6dd23d6c-33dd-4ac2-879d-b76deed410e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:27.248857 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6dd23d6c-33dd-4ac2-879d-b76deed410e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:27.250390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1265/2518] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:26 2022] DELETE /identity/v3/projects/eb7fa314dcf34f1795b0d128dcfbfcb3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:41:27.255354 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8acf52-71b2-4d96-8c51-f9f99d8720e2 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:27.255856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8acf52-71b2-4d96-8c51-f9f99d8720e2 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:27.256107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8acf52-71b2-4d96-8c51-f9f99d8720e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:27.279350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-8d8acf52-71b2-4d96-8c51-f9f99d8720e2 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:27.280707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8d8acf52-71b2-4d96-8c51-f9f99d8720e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:27.350804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1254/2519] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:27.360204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414d10c-8dc2-455d-acaa-562fd700eade None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:27.360579 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414d10c-8dc2-455d-acaa-562fd700eade None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:27.360943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414d10c-8dc2-455d-acaa-562fd700eade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:27.381346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-5414d10c-8dc2-455d-acaa-562fd700eade None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:27.382600 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5414d10c-8dc2-455d-acaa-562fd700eade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:27.390880 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1266/2520] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:27.396050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8acf52-71b2-4d96-8c51-f9f99d8720e2 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:27.406113 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8acf52-71b2-4d96-8c51-f9f99d8720e2 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:27.411648 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723258e3-05ac-4784-be42-43f990342df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:27.412312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723258e3-05ac-4784-be42-43f990342df4 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:27.412601 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723258e3-05ac-4784-be42-43f990342df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:27.412908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723258e3-05ac-4784-be42-43f990342df4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:27.413611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723258e3-05ac-4784-be42-43f990342df4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:27.413921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723258e3-05ac-4784-be42-43f990342df4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:27.415564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723258e3-05ac-4784-be42-43f990342df4 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:27.427953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1255/2521] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:41:27.432459 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414d10c-8dc2-455d-acaa-562fd700eade None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:27.441969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414d10c-8dc2-455d-acaa-562fd700eade None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:27.446707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab062b9-b4a9-4c6a-a982-9d8bbb7baae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:27.447323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab062b9-b4a9-4c6a-a982-9d8bbb7baae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:27.447612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab062b9-b4a9-4c6a-a982-9d8bbb7baae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:27.447890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab062b9-b4a9-4c6a-a982-9d8bbb7baae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:27.448553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab062b9-b4a9-4c6a-a982-9d8bbb7baae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:27.450560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab062b9-b4a9-4c6a-a982-9d8bbb7baae1 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:27.552937 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1267/2522] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:27 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:27.557134 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723258e3-05ac-4784-be42-43f990342df4 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:27.567630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723258e3-05ac-4784-be42-43f990342df4 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:27.627153 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4e8d5-dc88-4d47-a1c3-8ba1de063e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:27.627785 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4e8d5-dc88-4d47-a1c3-8ba1de063e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:27.628172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4e8d5-dc88-4d47-a1c3-8ba1de063e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:27.628422 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4e8d5-dc88-4d47-a1c3-8ba1de063e36 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:27.629589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4e8d5-dc88-4d47-a1c3-8ba1de063e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:27.631571 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4e8d5-dc88-4d47-a1c3-8ba1de063e36 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:27.728077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1256/2523] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:27 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:27.732262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab062b9-b4a9-4c6a-a982-9d8bbb7baae1 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:27.744961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab062b9-b4a9-4c6a-a982-9d8bbb7baae1 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:27.750897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c05deb-bef8-4df5-b7c7-f037f7b3499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:27.752018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c05deb-bef8-4df5-b7c7-f037f7b3499c admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:27.752301 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c05deb-bef8-4df5-b7c7-f037f7b3499c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:27.752577 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c05deb-bef8-4df5-b7c7-f037f7b3499c admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:27.753273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c05deb-bef8-4df5-b7c7-f037f7b3499c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:27.755099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c05deb-bef8-4df5-b7c7-f037f7b3499c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:27.765529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1268/2524] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:27.769860 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4e8d5-dc88-4d47-a1c3-8ba1de063e36 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:27.780068 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4e8d5-dc88-4d47-a1c3-8ba1de063e36 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:27.784818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d1478-93ac-46a8-8956-a654ce989955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:27.785338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d1478-93ac-46a8-8956-a654ce989955 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:27.785619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d1478-93ac-46a8-8956-a654ce989955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:27.785894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d1478-93ac-46a8-8956-a654ce989955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:27.786613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d1478-93ac-46a8-8956-a654ce989955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:27.788770 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d1478-93ac-46a8-8956-a654ce989955 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:27.799430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1257/2525] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:27.808774 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c05deb-bef8-4df5-b7c7-f037f7b3499c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:27.819396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c05deb-bef8-4df5-b7c7-f037f7b3499c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:27.824100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ca6f5-2660-40a1-a560-99d43264aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:27.824759 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ca6f5-2660-40a1-a560-99d43264aff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:27.825047 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ca6f5-2660-40a1-a560-99d43264aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:27.825328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ca6f5-2660-40a1-a560-99d43264aff1 admin admin] PATH_INFO: `/v3/projects/198aaa62f8894d32b1afccfb1d10e723/users/7b48e8b879b14526a4a0c9c619dee37a/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:27.840799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ca6f5-2660-40a1-a560-99d43264aff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198aaa62f8894d32b1afccfb1d10e723, user_id=7b48e8b879b14526a4a0c9c619dee37a, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:27.846051 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ca6f5-2660-40a1-a560-99d43264aff1 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:27.916249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1269/2526] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:27 2022] PUT /identity/v3/projects/198aaa62f8894d32b1afccfb1d10e723/users/7b48e8b879b14526a4a0c9c619dee37a/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:27.926659 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d4c5c-e323-43cb-b6a1-71bd53358aee None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:27.926955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d4c5c-e323-43cb-b6a1-71bd53358aee None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:27.927238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d4c5c-e323-43cb-b6a1-71bd53358aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:27.962867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-7e1d4c5c-e323-43cb-b6a1-71bd53358aee None None] MFA Rules not processed for user `7b48e8b879b14526a4a0c9c619dee37a`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:27.964207 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7e1d4c5c-e323-43cb-b6a1-71bd53358aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:28.030244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:28.044124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1258/2527] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:28.046688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ca6f5-2660-40a1-a560-99d43264aff1 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:28.076370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:28.114626 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ca6f5-2660-40a1-a560-99d43264aff1 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:28.119572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f36e92-8a4b-434d-9ec0-6a16e09812bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:28.120192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f36e92-8a4b-434d-9ec0-6a16e09812bb admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:28.120478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f36e92-8a4b-434d-9ec0-6a16e09812bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:28.120755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f36e92-8a4b-434d-9ec0-6a16e09812bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:28.121423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f36e92-8a4b-434d-9ec0-6a16e09812bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:28.123418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f36e92-8a4b-434d-9ec0-6a16e09812bb admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:28.225405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1270/2528] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:28 2022] POST /identity/v3/projects => generated 393 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:28.229818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d4c5c-e323-43cb-b6a1-71bd53358aee None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:28.241516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d4c5c-e323-43cb-b6a1-71bd53358aee None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:28.298682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafe39a-8b04-4dc3-871b-05cb88688b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:28.299366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafe39a-8b04-4dc3-871b-05cb88688b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:28.299462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafe39a-8b04-4dc3-871b-05cb88688b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:28.299735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafe39a-8b04-4dc3-871b-05cb88688b32 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:28.300393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafe39a-8b04-4dc3-871b-05cb88688b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:28.302836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafe39a-8b04-4dc3-871b-05cb88688b32 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:28.377998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1259/2529] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:28 2022] POST /identity/v3/users => generated 303 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:28.382110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f36e92-8a4b-434d-9ec0-6a16e09812bb admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:28.392553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f36e92-8a4b-434d-9ec0-6a16e09812bb admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:28.397275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed34bb-b2d3-4d4d-909b-565b6bbe08b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:28.397933 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed34bb-b2d3-4d4d-909b-565b6bbe08b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:28.398221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed34bb-b2d3-4d4d-909b-565b6bbe08b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:28.398510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed34bb-b2d3-4d4d-909b-565b6bbe08b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:28.399221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed34bb-b2d3-4d4d-909b-565b6bbe08b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:28.400817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed34bb-b2d3-4d4d-909b-565b6bbe08b2 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:28.412168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1271/2530] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:28.417809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafe39a-8b04-4dc3-871b-05cb88688b32 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:28.428301 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafe39a-8b04-4dc3-871b-05cb88688b32 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:28.438119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aac9dc-f277-495e-a644-72bc0595e872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:28.438119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aac9dc-f277-495e-a644-72bc0595e872 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:28.438119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aac9dc-f277-495e-a644-72bc0595e872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:28.438119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aac9dc-f277-495e-a644-72bc0595e872 admin admin] PATH_INFO: `/v3/projects/99b565d67133415f9cfb2206e4278eb1/users/f2b218309c434bb18604bbfd157986d4/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:28.448693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aac9dc-f277-495e-a644-72bc0595e872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b565d67133415f9cfb2206e4278eb1, user_id=f2b218309c434bb18604bbfd157986d4, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:28.451416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aac9dc-f277-495e-a644-72bc0595e872 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:28.556137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1260/2531] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:28 2022] PUT /identity/v3/projects/99b565d67133415f9cfb2206e4278eb1/users/f2b218309c434bb18604bbfd157986d4/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:28.560013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed34bb-b2d3-4d4d-909b-565b6bbe08b2 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:28.569864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed34bb-b2d3-4d4d-909b-565b6bbe08b2 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:28.625705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea74cc-cc86-432e-b246-2893be34a1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:28.626323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea74cc-cc86-432e-b246-2893be34a1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:28.626778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea74cc-cc86-432e-b246-2893be34a1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:28.627055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea74cc-cc86-432e-b246-2893be34a1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:28.627748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea74cc-cc86-432e-b246-2893be34a1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:28.629413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea74cc-cc86-432e-b246-2893be34a1ab admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:28.639495 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1272/2532] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:28.643716 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aac9dc-f277-495e-a644-72bc0595e872 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:28.654358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aac9dc-f277-495e-a644-72bc0595e872 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:28.659595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afb6be-0eb5-4b8b-82e6-4719c96662d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:28.660259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afb6be-0eb5-4b8b-82e6-4719c96662d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:28.660541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afb6be-0eb5-4b8b-82e6-4719c96662d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:28.660816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afb6be-0eb5-4b8b-82e6-4719c96662d1 admin admin] PATH_INFO: `/v3/projects/99b565d67133415f9cfb2206e4278eb1/users/f2b218309c434bb18604bbfd157986d4/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:28.663316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afb6be-0eb5-4b8b-82e6-4719c96662d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b565d67133415f9cfb2206e4278eb1, user_id=f2b218309c434bb18604bbfd157986d4, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:28.666061 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afb6be-0eb5-4b8b-82e6-4719c96662d1 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:28.676329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1261/2533] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:28 2022] PUT /identity/v3/projects/99b565d67133415f9cfb2206e4278eb1/users/f2b218309c434bb18604bbfd157986d4/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:28.687003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6a9fe-a7b8-4617-8793-80d30b1690b6 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:28.687298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6a9fe-a7b8-4617-8793-80d30b1690b6 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:28.687581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6a9fe-a7b8-4617-8793-80d30b1690b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:28.716680 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-7fe6a9fe-a7b8-4617-8793-80d30b1690b6 None None] MFA Rules not processed for user `f2b218309c434bb18604bbfd157986d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:28.717894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-7fe6a9fe-a7b8-4617-8793-80d30b1690b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:28.758196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afb6be-0eb5-4b8b-82e6-4719c96662d1 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:28.760165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-17afb6be-0eb5-4b8b-82e6-4719c96662d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:28.790078 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1273/2534] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:28.802018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6a9fe-a7b8-4617-8793-80d30b1690b6 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:28.803646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-7fe6a9fe-a7b8-4617-8793-80d30b1690b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:28.821850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afb6be-0eb5-4b8b-82e6-4719c96662d1 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:28.825426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3ecab-9b45-4146-9dae-77145953ea75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:28.826047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3ecab-9b45-4146-9dae-77145953ea75 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:28.826205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:28.826322 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3ecab-9b45-4146-9dae-77145953ea75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:28.826621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3ecab-9b45-4146-9dae-77145953ea75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:28.828435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e1c3ecab-9b45-4146-9dae-77145953ea75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:28.864394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6a9fe-a7b8-4617-8793-80d30b1690b6 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:28.868457 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57819-d52f-493c-a19a-d82e6abc5176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:28.869080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57819-d52f-493c-a19a-d82e6abc5176 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:28.869365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57819-d52f-493c-a19a-d82e6abc5176 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:28.869644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57819-d52f-493c-a19a-d82e6abc5176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:28.879039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57819-d52f-493c-a19a-d82e6abc5176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:28.880684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57819-d52f-493c-a19a-d82e6abc5176 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:28.889531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:28.891135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1274/2535] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:41:28.905105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3ecab-9b45-4146-9dae-77145953ea75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:28.906577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3ecab-9b45-4146-9dae-77145953ea75 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:28.919199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1262/2536] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:41:28.938903 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57819-d52f-493c-a19a-d82e6abc5176 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:28.940302 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-bbe57819-d52f-493c-a19a-d82e6abc5176 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:28.951975 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57819-d52f-493c-a19a-d82e6abc5176 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:28.956471 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155c31b-4fe5-4ca3-b033-af11e51439d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:28.957076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155c31b-4fe5-4ca3-b033-af11e51439d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:28.957411 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155c31b-4fe5-4ca3-b033-af11e51439d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:28.958191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155c31b-4fe5-4ca3-b033-af11e51439d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:29.017356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155c31b-4fe5-4ca3-b033-af11e51439d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:29.018861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155c31b-4fe5-4ca3-b033-af11e51439d2 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:29.054729 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1275/2537] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:29.101497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3ecab-9b45-4146-9dae-77145953ea75 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:29.103023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e1c3ecab-9b45-4146-9dae-77145953ea75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:29.114359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3ecab-9b45-4146-9dae-77145953ea75 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:29.120312 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9cd1a-a80c-4fb9-97fe-09f37ab3ca41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:29.121186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9cd1a-a80c-4fb9-97fe-09f37ab3ca41 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:29.121484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9cd1a-a80c-4fb9-97fe-09f37ab3ca41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:29.121887 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9cd1a-a80c-4fb9-97fe-09f37ab3ca41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:29.124122 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-06b9cd1a-a80c-4fb9-97fe-09f37ab3ca41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:29.149340 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9cd1a-a80c-4fb9-97fe-09f37ab3ca41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:29.151073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9cd1a-a80c-4fb9-97fe-09f37ab3ca41 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:29.164233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1263/2538] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:41:32.535305 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155c31b-4fe5-4ca3-b033-af11e51439d2 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:32.545757 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155c31b-4fe5-4ca3-b033-af11e51439d2 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:32.549518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebcaaf-1b5c-4227-b67d-025423dbacda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:32.550121 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebcaaf-1b5c-4227-b67d-025423dbacda service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:32.550407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebcaaf-1b5c-4227-b67d-025423dbacda service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:32.550727 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebcaaf-1b5c-4227-b67d-025423dbacda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:32.552739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-19ebcaaf-1b5c-4227-b67d-025423dbacda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:32.616995 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebcaaf-1b5c-4227-b67d-025423dbacda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:32.618479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebcaaf-1b5c-4227-b67d-025423dbacda service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:32.628429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1276/2539] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:33.702928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9cd1a-a80c-4fb9-97fe-09f37ab3ca41 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:33.767062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9cd1a-a80c-4fb9-97fe-09f37ab3ca41 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:33.772802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:33.773561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:33.773923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:33.774199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] PATH_INFO: `/v3/users/7b48e8b879b14526a4a0c9c619dee37a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:33.775426 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b48e8b879b14526a4a0c9c619dee37a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:33.777436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:33.969847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b48e8b879b14526a4a0c9c619dee37a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:33.983192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b48e8b879b14526a4a0c9c619dee37a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:33.983907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b48e8b879b14526a4a0c9c619dee37a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:33.995341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b48e8b879b14526a4a0c9c619dee37a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:34.052604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b48e8b879b14526a4a0c9c619dee37a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:34.061055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1264/2540] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:33 2022] DELETE /identity/v3/users/7b48e8b879b14526a4a0c9c619dee37a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:34.065371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb3d0c-840b-4cfe-bc1b-2634161fdabf None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:34.065846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb3d0c-840b-4cfe-bc1b-2634161fdabf None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:34.066005 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb3d0c-840b-4cfe-bc1b-2634161fdabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:34.086087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9fbb3d0c-840b-4cfe-bc1b-2634161fdabf None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:34.087340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9fbb3d0c-840b-4cfe-bc1b-2634161fdabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:34.136485 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:34.148491 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1277/2541] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:34.158656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:34.160180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:34.221826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70fb30f-0855-4a5a-9774-3effed944746 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:34.226296 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72817c-ae0f-46de-b914-6b9a883cb0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:34.226962 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72817c-ae0f-46de-b914-6b9a883cb0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:34.227249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72817c-ae0f-46de-b914-6b9a883cb0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:34.227524 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72817c-ae0f-46de-b914-6b9a883cb0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:34.237801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72817c-ae0f-46de-b914-6b9a883cb0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:34.239401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72817c-ae0f-46de-b914-6b9a883cb0b6 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:34.243919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:34.250662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1265/2542] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:34.655683 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb3d0c-840b-4cfe-bc1b-2634161fdabf None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:34.657250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9fbb3d0c-840b-4cfe-bc1b-2634161fdabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:34.681113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb3d0c-840b-4cfe-bc1b-2634161fdabf None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:34.692360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:34.694817 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:34.695115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:34.695400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] PATH_INFO: `/v3/projects/198aaa62f8894d32b1afccfb1d10e723` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:34.696622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=198aaa62f8894d32b1afccfb1d10e723)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:34.698745 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:34.818719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198aaa62f8894d32b1afccfb1d10e723', 'request_id': 'req-0a89990e-4304-40da-bfe8-99f96b65a890'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:34.917169 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198aaa62f8894d32b1afccfb1d10e723', 'request_id': 'req-0a89990e-4304-40da-bfe8-99f96b65a890'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:34.928953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198aaa62f8894d32b1afccfb1d10e723', 'request_id': 'req-0a89990e-4304-40da-bfe8-99f96b65a890'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:34.947317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] The token cache is being invalidate because project 198aaa62f8894d32b1afccfb1d10e723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:34.949085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:34.949762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:34.952668 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1278/2543] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:34 2022] DELETE /identity/v3/projects/198aaa62f8894d32b1afccfb1d10e723 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:34.956479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72817c-ae0f-46de-b914-6b9a883cb0b6 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:34.967644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72817c-ae0f-46de-b914-6b9a883cb0b6 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:35.058466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3807a9-82b0-4bfa-8ab7-0d791f3a3f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:35.059476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3807a9-82b0-4bfa-8ab7-0d791f3a3f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:35.060478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3807a9-82b0-4bfa-8ab7-0d791f3a3f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:35.060478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3807a9-82b0-4bfa-8ab7-0d791f3a3f86 admin admin] PATH_INFO: `/v3/users/f2b218309c434bb18604bbfd157986d4` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:35.061712 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3807a9-82b0-4bfa-8ab7-0d791f3a3f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b218309c434bb18604bbfd157986d4)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:35.064305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3807a9-82b0-4bfa-8ab7-0d791f3a3f86 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:35.320677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cf3807a9-82b0-4bfa-8ab7-0d791f3a3f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b218309c434bb18604bbfd157986d4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:35.345498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cf3807a9-82b0-4bfa-8ab7-0d791f3a3f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b218309c434bb18604bbfd157986d4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:35.346269 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cf3807a9-82b0-4bfa-8ab7-0d791f3a3f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b218309c434bb18604bbfd157986d4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:35.355564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cf3807a9-82b0-4bfa-8ab7-0d791f3a3f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b218309c434bb18604bbfd157986d4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:35.470161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-cf3807a9-82b0-4bfa-8ab7-0d791f3a3f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b218309c434bb18604bbfd157986d4'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:35.480746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1266/2544] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:34 2022] DELETE /identity/v3/users/f2b218309c434bb18604bbfd157986d4 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:35.925432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:35.926936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:35.943200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89990e-4304-40da-bfe8-99f96b65a890 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:36.009694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcd8c2-f977-4c69-b31c-f9904c55724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:36.010429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcd8c2-f977-4c69-b31c-f9904c55724a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:36.011267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcd8c2-f977-4c69-b31c-f9904c55724a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:36.011267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcd8c2-f977-4c69-b31c-f9904c55724a admin admin] PATH_INFO: `/v3/projects/99b565d67133415f9cfb2206e4278eb1` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:36.012267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcd8c2-f977-4c69-b31c-f9904c55724a admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b565d67133415f9cfb2206e4278eb1)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:36.014215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcd8c2-f977-4c69-b31c-f9904c55724a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:36.098850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-2bdcd8c2-f977-4c69-b31c-f9904c55724a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b565d67133415f9cfb2206e4278eb1', 'request_id': 'req-2bdcd8c2-f977-4c69-b31c-f9904c55724a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:36.184421 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-2bdcd8c2-f977-4c69-b31c-f9904c55724a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b565d67133415f9cfb2206e4278eb1', 'request_id': 'req-2bdcd8c2-f977-4c69-b31c-f9904c55724a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:36.190537 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-2bdcd8c2-f977-4c69-b31c-f9904c55724a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b565d67133415f9cfb2206e4278eb1', 'request_id': 'req-2bdcd8c2-f977-4c69-b31c-f9904c55724a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:36.201914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-2bdcd8c2-f977-4c69-b31c-f9904c55724a admin admin] The token cache is being invalidate because project 99b565d67133415f9cfb2206e4278eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:36.202200 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-2bdcd8c2-f977-4c69-b31c-f9904c55724a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:36.202844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-2bdcd8c2-f977-4c69-b31c-f9904c55724a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:36.204378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1279/2545] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:35 2022] DELETE /identity/v3/projects/99b565d67133415f9cfb2206e4278eb1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:36.216490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cdff9-04fc-4a6a-a75c-6536a3cf6444 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:36.217015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cdff9-04fc-4a6a-a75c-6536a3cf6444 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:36.217124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cdff9-04fc-4a6a-a75c-6536a3cf6444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:36.237902 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-248cdff9-04fc-4a6a-a75c-6536a3cf6444 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:36.239137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-248cdff9-04fc-4a6a-a75c-6536a3cf6444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:36.299776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1267/2546] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:36.309054 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b801579-b387-42e0-97f9-bcd986e5cf74 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:36.309344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b801579-b387-42e0-97f9-bcd986e5cf74 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:36.309624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b801579-b387-42e0-97f9-bcd986e5cf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:36.329824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8b801579-b387-42e0-97f9-bcd986e5cf74 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:36.331061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8b801579-b387-42e0-97f9-bcd986e5cf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:36.339957 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1280/2547] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:36.344083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cdff9-04fc-4a6a-a75c-6536a3cf6444 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:36.354651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cdff9-04fc-4a6a-a75c-6536a3cf6444 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:36.359310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb738213-fcf5-4bd9-a046-bdcf543f6816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:36.359919 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb738213-fcf5-4bd9-a046-bdcf543f6816 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:36.360203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb738213-fcf5-4bd9-a046-bdcf543f6816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:36.360477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb738213-fcf5-4bd9-a046-bdcf543f6816 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:36.361172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb738213-fcf5-4bd9-a046-bdcf543f6816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:36.361478 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb738213-fcf5-4bd9-a046-bdcf543f6816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:36.363127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb738213-fcf5-4bd9-a046-bdcf543f6816 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:36.375853 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1268/2548] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:41:36.380335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b801579-b387-42e0-97f9-bcd986e5cf74 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:36.384969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:36.390397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b801579-b387-42e0-97f9-bcd986e5cf74 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:36.395269 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae118d8-ea60-4617-85e3-bb0e0a462cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:36.397518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae118d8-ea60-4617-85e3-bb0e0a462cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:36.397518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae118d8-ea60-4617-85e3-bb0e0a462cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:36.397518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae118d8-ea60-4617-85e3-bb0e0a462cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:36.397929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae118d8-ea60-4617-85e3-bb0e0a462cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:36.400302 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae118d8-ea60-4617-85e3-bb0e0a462cc9 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:36.506128 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1281/2549] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:36 2022] POST /identity/v3/projects => generated 407 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:41:36.510337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb738213-fcf5-4bd9-a046-bdcf543f6816 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:36.516733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:36.520752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb738213-fcf5-4bd9-a046-bdcf543f6816 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:36.580707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485bfc-449f-4971-889a-aa386b8950fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:36.581435 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485bfc-449f-4971-889a-aa386b8950fe admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:36.581722 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485bfc-449f-4971-889a-aa386b8950fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:36.581998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485bfc-449f-4971-889a-aa386b8950fe admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:36.582852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485bfc-449f-4971-889a-aa386b8950fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:36.585688 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485bfc-449f-4971-889a-aa386b8950fe admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:36.664127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1269/2550] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:36 2022] POST /identity/v3/users => generated 304 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:36.668488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae118d8-ea60-4617-85e3-bb0e0a462cc9 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:36.679033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae118d8-ea60-4617-85e3-bb0e0a462cc9 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:36.683741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c418f1d-aae8-4509-b3eb-805f3c0ce1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:36.684339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c418f1d-aae8-4509-b3eb-805f3c0ce1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:36.684628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c418f1d-aae8-4509-b3eb-805f3c0ce1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:36.684925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c418f1d-aae8-4509-b3eb-805f3c0ce1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:36.686970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c418f1d-aae8-4509-b3eb-805f3c0ce1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:36.688498 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c418f1d-aae8-4509-b3eb-805f3c0ce1c2 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:36.699545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1282/2551] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:36.703608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485bfc-449f-4971-889a-aa386b8950fe admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:36.716209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485bfc-449f-4971-889a-aa386b8950fe admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:36.721218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7305ce-9cca-48df-b1da-582bf41cfad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:36.721863 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7305ce-9cca-48df-b1da-582bf41cfad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:36.722147 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7305ce-9cca-48df-b1da-582bf41cfad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:36.722439 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7305ce-9cca-48df-b1da-582bf41cfad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:36.723196 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7305ce-9cca-48df-b1da-582bf41cfad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:36.724828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7305ce-9cca-48df-b1da-582bf41cfad9 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:36.737638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1270/2552] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:41:36.741708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c418f1d-aae8-4509-b3eb-805f3c0ce1c2 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:36.751913 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c418f1d-aae8-4509-b3eb-805f3c0ce1c2 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:36.757505 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a443fc8-093f-4c86-899f-84878ba9797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:36.758182 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443fc8-093f-4c86-899f-84878ba9797b admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:36.758463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443fc8-093f-4c86-899f-84878ba9797b admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:36.758770 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443fc8-093f-4c86-899f-84878ba9797b admin admin] PATH_INFO: `/v3/projects/198640fff5494e778486cb80148c5576/users/6b503910c0664ea69ac1f6c019f8d3c0/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:36.774803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a443fc8-093f-4c86-899f-84878ba9797b admin admin] RBAC: Authorizing `identity:create_grant(project_id=198640fff5494e778486cb80148c5576, user_id=6b503910c0664ea69ac1f6c019f8d3c0, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:36.777560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a443fc8-093f-4c86-899f-84878ba9797b admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:36.853467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1283/2553] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:36 2022] PUT /identity/v3/projects/198640fff5494e778486cb80148c5576/users/6b503910c0664ea69ac1f6c019f8d3c0/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:36.863670 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44ce00-0f08-45ef-8636-b5345b6cd7eb None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:36.863990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44ce00-0f08-45ef-8636-b5345b6cd7eb None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:36.864271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44ce00-0f08-45ef-8636-b5345b6cd7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:36.891934 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-af44ce00-0f08-45ef-8636-b5345b6cd7eb None None] MFA Rules not processed for user `6b503910c0664ea69ac1f6c019f8d3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:36.893148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-af44ce00-0f08-45ef-8636-b5345b6cd7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:36.958433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1271/2554] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:36 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:36.963726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a443fc8-093f-4c86-899f-84878ba9797b admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:37.026119 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a443fc8-093f-4c86-899f-84878ba9797b admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:37.031423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37eb55-2f36-486e-aeaf-8bf877de70de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:37.032048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37eb55-2f36-486e-aeaf-8bf877de70de admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:37.032327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37eb55-2f36-486e-aeaf-8bf877de70de admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:37.032599 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37eb55-2f36-486e-aeaf-8bf877de70de admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:37.033261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37eb55-2f36-486e-aeaf-8bf877de70de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:37.035396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37eb55-2f36-486e-aeaf-8bf877de70de admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:37.123567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1284/2555] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:36 2022] POST /identity/v3/projects => generated 409 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:37.127620 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44ce00-0f08-45ef-8636-b5345b6cd7eb None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:37.139331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44ce00-0f08-45ef-8636-b5345b6cd7eb None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:37.200955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28a33d-ee73-436f-8da4-8ed32ac96ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:37.201591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28a33d-ee73-436f-8da4-8ed32ac96ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:37.201881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28a33d-ee73-436f-8da4-8ed32ac96ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:37.202162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28a33d-ee73-436f-8da4-8ed32ac96ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:37.202876 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28a33d-ee73-436f-8da4-8ed32ac96ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:37.205773 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28a33d-ee73-436f-8da4-8ed32ac96ff5 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:37.322714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1272/2556] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:37 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:37.327139 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37eb55-2f36-486e-aeaf-8bf877de70de admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:37.340383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37eb55-2f36-486e-aeaf-8bf877de70de admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:37.345141 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64380309-fe78-4da3-9fb6-d5b81329df6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:37.345752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64380309-fe78-4da3-9fb6-d5b81329df6e admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:37.346038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64380309-fe78-4da3-9fb6-d5b81329df6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:37.346316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64380309-fe78-4da3-9fb6-d5b81329df6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:37.347056 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64380309-fe78-4da3-9fb6-d5b81329df6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:37.348718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64380309-fe78-4da3-9fb6-d5b81329df6e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:37.360709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1285/2557] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:37.365893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28a33d-ee73-436f-8da4-8ed32ac96ff5 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:37.371582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:37.377127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28a33d-ee73-436f-8da4-8ed32ac96ff5 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:37.382192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81e913-90ed-4e20-9fd3-63a12d194454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:37.383263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81e913-90ed-4e20-9fd3-63a12d194454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:37.383734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81e913-90ed-4e20-9fd3-63a12d194454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:37.384086 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81e913-90ed-4e20-9fd3-63a12d194454 admin admin] PATH_INFO: `/v3/projects/3242871979554cc1b17409cbe7212445/users/00fbfa316f5645f787ef7a4176d82162/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:37.401614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81e913-90ed-4e20-9fd3-63a12d194454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3242871979554cc1b17409cbe7212445, user_id=00fbfa316f5645f787ef7a4176d82162, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:37.404583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81e913-90ed-4e20-9fd3-63a12d194454 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:37.471090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1273/2558] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:37 2022] PUT /identity/v3/projects/3242871979554cc1b17409cbe7212445/users/00fbfa316f5645f787ef7a4176d82162/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:37.475367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64380309-fe78-4da3-9fb6-d5b81329df6e admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:37.485460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64380309-fe78-4da3-9fb6-d5b81329df6e admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:37.547068 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43ede6-a641-495d-a03b-f377dc476f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:37.547748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43ede6-a641-495d-a03b-f377dc476f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:37.548036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43ede6-a641-495d-a03b-f377dc476f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:37.548312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43ede6-a641-495d-a03b-f377dc476f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:37.549087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43ede6-a641-495d-a03b-f377dc476f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:37.550722 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43ede6-a641-495d-a03b-f377dc476f09 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:37.561572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1286/2559] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:37.566154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81e913-90ed-4e20-9fd3-63a12d194454 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:37.577245 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81e913-90ed-4e20-9fd3-63a12d194454 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:37.582263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193ca37-cedb-4fc2-abc1-bbe42c4a2c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:37.583023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193ca37-cedb-4fc2-abc1-bbe42c4a2c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:37.583309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193ca37-cedb-4fc2-abc1-bbe42c4a2c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:37.584175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193ca37-cedb-4fc2-abc1-bbe42c4a2c0b admin admin] PATH_INFO: `/v3/projects/3242871979554cc1b17409cbe7212445/users/00fbfa316f5645f787ef7a4176d82162/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:37.586243 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193ca37-cedb-4fc2-abc1-bbe42c4a2c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3242871979554cc1b17409cbe7212445, user_id=00fbfa316f5645f787ef7a4176d82162, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:37.589137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193ca37-cedb-4fc2-abc1-bbe42c4a2c0b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:37.600745 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1274/2560] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:37 2022] PUT /identity/v3/projects/3242871979554cc1b17409cbe7212445/users/00fbfa316f5645f787ef7a4176d82162/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:37.611968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4817971-24b0-4b03-b2fe-7cd42512bbb2 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:37.612267 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4817971-24b0-4b03-b2fe-7cd42512bbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:37.613904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4817971-24b0-4b03-b2fe-7cd42512bbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:37.643075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-d4817971-24b0-4b03-b2fe-7cd42512bbb2 None None] MFA Rules not processed for user `00fbfa316f5645f787ef7a4176d82162`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:37.644311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d4817971-24b0-4b03-b2fe-7cd42512bbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:37.649049 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:37.718553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1287/2561] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:37 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:37.729601 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193ca37-cedb-4fc2-abc1-bbe42c4a2c0b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:37.734003 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9193ca37-cedb-4fc2-abc1-bbe42c4a2c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:37.792217 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193ca37-cedb-4fc2-abc1-bbe42c4a2c0b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:37.795745 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b934a73-9740-4b4a-adcc-087dcfc1dba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:37.796357 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b934a73-9740-4b4a-adcc-087dcfc1dba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:37.796638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b934a73-9740-4b4a-adcc-087dcfc1dba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:37.796910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b934a73-9740-4b4a-adcc-087dcfc1dba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:37.806468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b934a73-9740-4b4a-adcc-087dcfc1dba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:37.808468 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b934a73-9740-4b4a-adcc-087dcfc1dba6 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:37.817547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1275/2562] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:37 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:38.154382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4817971-24b0-4b03-b2fe-7cd42512bbb2 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:38.164541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4817971-24b0-4b03-b2fe-7cd42512bbb2 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:38.168190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ea30e-8b46-4d12-ab2e-9953b540a776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:38.168856 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ea30e-8b46-4d12-ab2e-9953b540a776 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:38.169147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ea30e-8b46-4d12-ab2e-9953b540a776 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:38.169487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ea30e-8b46-4d12-ab2e-9953b540a776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:38.280003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ea30e-8b46-4d12-ab2e-9953b540a776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:38.281999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ea30e-8b46-4d12-ab2e-9953b540a776 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:38.295978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1288/2563] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:38 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:45.033880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b934a73-9740-4b4a-adcc-087dcfc1dba6 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:45.095523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b934a73-9740-4b4a-adcc-087dcfc1dba6 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:45.100512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:45.101248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:45.101536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:45.101810 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] PATH_INFO: `/v3/users/6b503910c0664ea69ac1f6c019f8d3c0` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:45.103036 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b503910c0664ea69ac1f6c019f8d3c0)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:45.104968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:45.324137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b503910c0664ea69ac1f6c019f8d3c0'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:45.336446 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b503910c0664ea69ac1f6c019f8d3c0'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:45.337137 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b503910c0664ea69ac1f6c019f8d3c0'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:45.341711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:45.344586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b503910c0664ea69ac1f6c019f8d3c0'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:45.440831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b503910c0664ea69ac1f6c019f8d3c0'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:45.447814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1276/2564] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:45 2022] DELETE /identity/v3/users/6b503910c0664ea69ac1f6c019f8d3c0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:45.452323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90551ad1-585e-46e8-b134-041e149bb096 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:45.452806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90551ad1-585e-46e8-b134-041e149bb096 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:45.452925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90551ad1-585e-46e8-b134-041e149bb096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:45.472573 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-90551ad1-585e-46e8-b134-041e149bb096 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:45.473772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-90551ad1-585e-46e8-b134-041e149bb096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:45.531560 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1289/2565] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:45.541814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:45.543238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:45.607443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88b021-2152-4c26-8a18-52fc1dde4d1e admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:45.611138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3bb71-0f34-46d0-af49-3af4e8807303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:45.611777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3bb71-0f34-46d0-af49-3af4e8807303 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:45.612052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3bb71-0f34-46d0-af49-3af4e8807303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:45.612332 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3bb71-0f34-46d0-af49-3af4e8807303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:45.622019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3bb71-0f34-46d0-af49-3af4e8807303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:45.623503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3bb71-0f34-46d0-af49-3af4e8807303 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:45.633040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1277/2566] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:46.008228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90551ad1-585e-46e8-b134-041e149bb096 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:46.009719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-90551ad1-585e-46e8-b134-041e149bb096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:46.022191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90551ad1-585e-46e8-b134-041e149bb096 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:46.027052 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:46.027693 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:46.027978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:46.028259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] PATH_INFO: `/v3/projects/198640fff5494e778486cb80148c5576` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:46.029687 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=198640fff5494e778486cb80148c5576)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:46.031631 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:46.123969 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:46.133749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198640fff5494e778486cb80148c5576', 'request_id': 'req-5dc42e58-0231-4969-8c9f-014922ad33cb'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:46.252619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198640fff5494e778486cb80148c5576', 'request_id': 'req-5dc42e58-0231-4969-8c9f-014922ad33cb'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:46.258798 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198640fff5494e778486cb80148c5576', 'request_id': 'req-5dc42e58-0231-4969-8c9f-014922ad33cb'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:46.270470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] The token cache is being invalidate because project 198640fff5494e778486cb80148c5576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:46.270794 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:46.271429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:46.273466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1290/2567] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:46 2022] DELETE /identity/v3/projects/198640fff5494e778486cb80148c5576 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:46.277708 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3bb71-0f34-46d0-af49-3af4e8807303 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:46.288547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3bb71-0f34-46d0-af49-3af4e8807303 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:46.345346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2584a-9917-4e31-a600-7871ae3ce3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:46.345985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2584a-9917-4e31-a600-7871ae3ce3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:46.346275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2584a-9917-4e31-a600-7871ae3ce3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:46.346595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2584a-9917-4e31-a600-7871ae3ce3fe admin admin] PATH_INFO: `/v3/users/00fbfa316f5645f787ef7a4176d82162` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:46.347766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2584a-9917-4e31-a600-7871ae3ce3fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=00fbfa316f5645f787ef7a4176d82162)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:46.349707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2584a-9917-4e31-a600-7871ae3ce3fe admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:46.512481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-2ac2584a-9917-4e31-a600-7871ae3ce3fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00fbfa316f5645f787ef7a4176d82162'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:46.524836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-2ac2584a-9917-4e31-a600-7871ae3ce3fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00fbfa316f5645f787ef7a4176d82162'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:46.525505 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-2ac2584a-9917-4e31-a600-7871ae3ce3fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00fbfa316f5645f787ef7a4176d82162'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:46.532867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-2ac2584a-9917-4e31-a600-7871ae3ce3fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00fbfa316f5645f787ef7a4176d82162'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:46.617898 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-2ac2584a-9917-4e31-a600-7871ae3ce3fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00fbfa316f5645f787ef7a4176d82162'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:46.624378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1278/2568] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:46 2022] DELETE /identity/v3/users/00fbfa316f5645f787ef7a4176d82162 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:47.043181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:47.044748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:47.060263 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc42e58-0231-4969-8c9f-014922ad33cb admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:47.119441 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012edae-a82c-44a8-857e-a6e680fa8477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:47.120088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012edae-a82c-44a8-857e-a6e680fa8477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:47.120375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012edae-a82c-44a8-857e-a6e680fa8477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:47.120649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012edae-a82c-44a8-857e-a6e680fa8477 admin admin] PATH_INFO: `/v3/projects/3242871979554cc1b17409cbe7212445` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:47.121826 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012edae-a82c-44a8-857e-a6e680fa8477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3242871979554cc1b17409cbe7212445)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:47.123766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012edae-a82c-44a8-857e-a6e680fa8477 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:47.252792 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7012edae-a82c-44a8-857e-a6e680fa8477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3242871979554cc1b17409cbe7212445', 'request_id': 'req-7012edae-a82c-44a8-857e-a6e680fa8477'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:47.338304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7012edae-a82c-44a8-857e-a6e680fa8477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3242871979554cc1b17409cbe7212445', 'request_id': 'req-7012edae-a82c-44a8-857e-a6e680fa8477'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:47.345728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7012edae-a82c-44a8-857e-a6e680fa8477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3242871979554cc1b17409cbe7212445', 'request_id': 'req-7012edae-a82c-44a8-857e-a6e680fa8477'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:47.358585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7012edae-a82c-44a8-857e-a6e680fa8477 admin admin] The token cache is being invalidate because project 3242871979554cc1b17409cbe7212445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:47.358970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7012edae-a82c-44a8-857e-a6e680fa8477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:47.359742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7012edae-a82c-44a8-857e-a6e680fa8477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:47.364837 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1291/2569] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:47 2022] DELETE /identity/v3/projects/3242871979554cc1b17409cbe7212445 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:47.366665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c30b-412b-40d2-89ad-c9ca17d12e4e None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:47.367123 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c30b-412b-40d2-89ad-c9ca17d12e4e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:47.367324 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3c30b-412b-40d2-89ad-c9ca17d12e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:47.388241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-6cf3c30b-412b-40d2-89ad-c9ca17d12e4e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:47.389597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-6cf3c30b-412b-40d2-89ad-c9ca17d12e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:47.394213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:47.457533 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1279/2570] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:47.473325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7abd8-e0d8-447b-97d5-532e7453b764 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:47.473325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7abd8-e0d8-447b-97d5-532e7453b764 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:47.473325 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7abd8-e0d8-447b-97d5-532e7453b764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:47.487197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-98d7abd8-e0d8-447b-97d5-532e7453b764 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:47.488484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-98d7abd8-e0d8-447b-97d5-532e7453b764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:47.498407 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1292/2571] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:47.504862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c30b-412b-40d2-89ad-c9ca17d12e4e None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:47.515222 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3c30b-412b-40d2-89ad-c9ca17d12e4e None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:47.519737 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76879855-ab65-4ac2-ad41-b3d14c0570df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:47.520565 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879855-ab65-4ac2-ad41-b3d14c0570df admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:47.521014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879855-ab65-4ac2-ad41-b3d14c0570df admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:47.521718 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879855-ab65-4ac2-ad41-b3d14c0570df admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:47.522533 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76879855-ab65-4ac2-ad41-b3d14c0570df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:47.522847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76879855-ab65-4ac2-ad41-b3d14c0570df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:47.524451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76879855-ab65-4ac2-ad41-b3d14c0570df admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:47.536197 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1280/2572] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:41:47.540578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7abd8-e0d8-447b-97d5-532e7453b764 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:47.549741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7abd8-e0d8-447b-97d5-532e7453b764 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:47.555170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bd6ab-5b90-48eb-b5e8-b0ca07554349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:47.555708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bd6ab-5b90-48eb-b5e8-b0ca07554349 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:47.555987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bd6ab-5b90-48eb-b5e8-b0ca07554349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:47.556258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bd6ab-5b90-48eb-b5e8-b0ca07554349 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:47.556914 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bd6ab-5b90-48eb-b5e8-b0ca07554349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:47.558850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bd6ab-5b90-48eb-b5e8-b0ca07554349 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:47.648434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1293/2573] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:47 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:47.652579 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76879855-ab65-4ac2-ad41-b3d14c0570df admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:47.663422 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76879855-ab65-4ac2-ad41-b3d14c0570df admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:47.719781 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79acbcf-7c7c-4207-a497-f96774017f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:47.720398 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79acbcf-7c7c-4207-a497-f96774017f2f admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:47.720685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79acbcf-7c7c-4207-a497-f96774017f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:47.720966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79acbcf-7c7c-4207-a497-f96774017f2f admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:47.721639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79acbcf-7c7c-4207-a497-f96774017f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:47.723612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79acbcf-7c7c-4207-a497-f96774017f2f admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:47.835121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1281/2574] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:47 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:41:47.839172 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bd6ab-5b90-48eb-b5e8-b0ca07554349 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:47.850126 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bd6ab-5b90-48eb-b5e8-b0ca07554349 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:47.855147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb1eb-8e9d-4d8e-8305-d782be7f935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:47.855750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb1eb-8e9d-4d8e-8305-d782be7f935e admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:47.856033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb1eb-8e9d-4d8e-8305-d782be7f935e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:47.856310 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb1eb-8e9d-4d8e-8305-d782be7f935e admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:47.857034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cb1eb-8e9d-4d8e-8305-d782be7f935e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:47.858673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cb1eb-8e9d-4d8e-8305-d782be7f935e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:47.869340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1294/2575] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:47.873665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79acbcf-7c7c-4207-a497-f96774017f2f admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:47.883857 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79acbcf-7c7c-4207-a497-f96774017f2f admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:47.888412 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec3316-7502-49ea-b13f-3612964acd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:47.889007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec3316-7502-49ea-b13f-3612964acd5e admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:47.889287 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec3316-7502-49ea-b13f-3612964acd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:47.889592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec3316-7502-49ea-b13f-3612964acd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:47.890278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec3316-7502-49ea-b13f-3612964acd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:47.891894 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec3316-7502-49ea-b13f-3612964acd5e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:47.902359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1282/2576] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:47.906655 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb1eb-8e9d-4d8e-8305-d782be7f935e admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:47.916924 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb1eb-8e9d-4d8e-8305-d782be7f935e admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:47.921455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dedab-0cb5-462b-83e2-e7ad7d876f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:47.922101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dedab-0cb5-462b-83e2-e7ad7d876f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:47.922386 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dedab-0cb5-462b-83e2-e7ad7d876f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:47.922699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dedab-0cb5-462b-83e2-e7ad7d876f10 admin admin] PATH_INFO: `/v3/projects/f9d97f16c3f34b9ba8ebeb3a586c48d8/users/62bddf5b95864a26a7c2912485e0ff51/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:47.936347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:47.940274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8dedab-0cb5-462b-83e2-e7ad7d876f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d97f16c3f34b9ba8ebeb3a586c48d8, user_id=62bddf5b95864a26a7c2912485e0ff51, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:47.943033 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8dedab-0cb5-462b-83e2-e7ad7d876f10 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:48.018051 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1295/2577] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:47 2022] PUT /identity/v3/projects/f9d97f16c3f34b9ba8ebeb3a586c48d8/users/62bddf5b95864a26a7c2912485e0ff51/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:48.028761 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a5fa6-261a-4b05-9b37-fff5a913439e None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:48.029055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a5fa6-261a-4b05-9b37-fff5a913439e None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:48.029333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a5fa6-261a-4b05-9b37-fff5a913439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:48.059022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-9b2a5fa6-261a-4b05-9b37-fff5a913439e None None] MFA Rules not processed for user `62bddf5b95864a26a7c2912485e0ff51`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:48.060227 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9b2a5fa6-261a-4b05-9b37-fff5a913439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:48.129990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1283/2578] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:48.143408 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dedab-0cb5-462b-83e2-e7ad7d876f10 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:48.145142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ec8dedab-0cb5-462b-83e2-e7ad7d876f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:48.201878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dedab-0cb5-462b-83e2-e7ad7d876f10 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:48.205540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0d9f2-90ac-4538-a5f3-f70efa8d3d48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:48.206151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0d9f2-90ac-4538-a5f3-f70efa8d3d48 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:48.206435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0d9f2-90ac-4538-a5f3-f70efa8d3d48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:48.206737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0d9f2-90ac-4538-a5f3-f70efa8d3d48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:48.215612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0d9f2-90ac-4538-a5f3-f70efa8d3d48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:48.217046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0d9f2-90ac-4538-a5f3-f70efa8d3d48 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:48.226410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1296/2579] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:48.245816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a5fa6-261a-4b05-9b37-fff5a913439e None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:48.251156 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:48.308108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a5fa6-261a-4b05-9b37-fff5a913439e None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:48.313252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:48.313883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:48.314168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:48.314450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] PATH_INFO: `/v3/users/62bddf5b95864a26a7c2912485e0ff51` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:48.315655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=62bddf5b95864a26a7c2912485e0ff51)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:48.317552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:48.483563 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62bddf5b95864a26a7c2912485e0ff51'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.495367 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62bddf5b95864a26a7c2912485e0ff51'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.496042 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62bddf5b95864a26a7c2912485e0ff51'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.503508 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62bddf5b95864a26a7c2912485e0ff51'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.572572 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62bddf5b95864a26a7c2912485e0ff51'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.579964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1284/2580] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:48 2022] DELETE /identity/v3/users/62bddf5b95864a26a7c2912485e0ff51 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:48.585130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e76aa5-1e37-4590-8241-8a57aef352d7 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:48.585426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e76aa5-1e37-4590-8241-8a57aef352d7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:48.585700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e76aa5-1e37-4590-8241-8a57aef352d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:48.605659 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-95e76aa5-1e37-4590-8241-8a57aef352d7 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:48.606944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-95e76aa5-1e37-4590-8241-8a57aef352d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:48.675442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1297/2581] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:48.685231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:48.686754 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:48.746177 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006dce0-d264-4548-bf0b-bd7db79ea72b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:48.749712 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc882a-e3b7-4c30-9dd1-7114b04a43fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:48.750359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc882a-e3b7-4c30-9dd1-7114b04a43fe service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:48.750679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc882a-e3b7-4c30-9dd1-7114b04a43fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:48.750958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc882a-e3b7-4c30-9dd1-7114b04a43fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:48.760511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc882a-e3b7-4c30-9dd1-7114b04a43fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:48.762344 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc882a-e3b7-4c30-9dd1-7114b04a43fe service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:48.772428 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1285/2582] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:49.449266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e76aa5-1e37-4590-8241-8a57aef352d7 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.452090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-95e76aa5-1e37-4590-8241-8a57aef352d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:49.464668 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e76aa5-1e37-4590-8241-8a57aef352d7 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.469413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.470059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.470875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.471323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d admin admin] PATH_INFO: `/v3/projects/f9d97f16c3f34b9ba8ebeb3a586c48d8` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.472622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d97f16c3f34b9ba8ebeb3a586c48d8)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.474528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.605811 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d97f16c3f34b9ba8ebeb3a586c48d8', 'request_id': 'req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:49.681243 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d97f16c3f34b9ba8ebeb3a586c48d8', 'request_id': 'req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:49.686673 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc882a-e3b7-4c30-9dd1-7114b04a43fe service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.694581 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d97f16c3f34b9ba8ebeb3a586c48d8', 'request_id': 'req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:49.694731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4fcc882a-e3b7-4c30-9dd1-7114b04a43fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:49.699935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d admin admin] The token cache is being invalidate because project f9d97f16c3f34b9ba8ebeb3a586c48d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:49.700271 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:49.700973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-9c2d29a3-7abd-49d4-bb30-9b34a6d1906d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:49.702635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1298/2583] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:49 2022] DELETE /identity/v3/projects/f9d97f16c3f34b9ba8ebeb3a586c48d8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:49.707257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e24d2f-f54a-4c8d-8800-afd372e3e8c9 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.707552 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e24d2f-f54a-4c8d-8800-afd372e3e8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.707840 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e24d2f-f54a-4c8d-8800-afd372e3e8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.720465 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:49.729854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-95e24d2f-f54a-4c8d-8800-afd372e3e8c9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:49.734852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-95e24d2f-f54a-4c8d-8800-afd372e3e8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:49.741921 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:49.765564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc882a-e3b7-4c30-9dd1-7114b04a43fe service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.792557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1299/2584] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:49.801277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca23ad0-081c-4368-a5e8-85ab1558f6e2 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.801568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca23ad0-081c-4368-a5e8-85ab1558f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.801843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca23ad0-081c-4368-a5e8-85ab1558f6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.821175 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-6ca23ad0-081c-4368-a5e8-85ab1558f6e2 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:49.822386 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6ca23ad0-081c-4368-a5e8-85ab1558f6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:49.829285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c890d-876c-4bf2-b19d-e0e994a2d436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.829996 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c890d-876c-4bf2-b19d-e0e994a2d436 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.830266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1300/2585] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:49.830417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c890d-876c-4bf2-b19d-e0e994a2d436 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.830651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c890d-876c-4bf2-b19d-e0e994a2d436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.832447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9c0c890d-876c-4bf2-b19d-e0e994a2d436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:49.835214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca23ad0-081c-4368-a5e8-85ab1558f6e2 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.844544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca23ad0-081c-4368-a5e8-85ab1558f6e2 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.849221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94812b-bc59-442e-9fb7-172c0b5946f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.850434 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94812b-bc59-442e-9fb7-172c0b5946f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.850758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94812b-bc59-442e-9fb7-172c0b5946f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.851075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94812b-bc59-442e-9fb7-172c0b5946f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.851730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94812b-bc59-442e-9fb7-172c0b5946f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:49.852039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94812b-bc59-442e-9fb7-172c0b5946f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.853651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94812b-bc59-442e-9fb7-172c0b5946f7 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.865087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1301/2586] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:41:49.869541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94812b-bc59-442e-9fb7-172c0b5946f7 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.879657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94812b-bc59-442e-9fb7-172c0b5946f7 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.884541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4395a3-f985-47be-95f2-a88553ac8db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.885238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4395a3-f985-47be-95f2-a88553ac8db0 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.885498 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4395a3-f985-47be-95f2-a88553ac8db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.885763 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4395a3-f985-47be-95f2-a88553ac8db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.886420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4395a3-f985-47be-95f2-a88553ac8db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.888342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4395a3-f985-47be-95f2-a88553ac8db0 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.894359 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c890d-876c-4bf2-b19d-e0e994a2d436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.896064 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c890d-876c-4bf2-b19d-e0e994a2d436 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.906836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1286/2587] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:41:49.951095 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1302/2588] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:49 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:49.955201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c890d-876c-4bf2-b19d-e0e994a2d436 service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.967685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c890d-876c-4bf2-b19d-e0e994a2d436 service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.026588 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b7822-223c-49fb-bcb0-f2abf2997957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.027206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b7822-223c-49fb-bcb0-f2abf2997957 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.027491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b7822-223c-49fb-bcb0-f2abf2997957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.028213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b7822-223c-49fb-bcb0-f2abf2997957 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.028436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b7822-223c-49fb-bcb0-f2abf2997957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.030621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b7822-223c-49fb-bcb0-f2abf2997957 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.042933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:50.115432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1287/2589] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:49 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:50.119769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4395a3-f985-47be-95f2-a88553ac8db0 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.130112 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4395a3-f985-47be-95f2-a88553ac8db0 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.137494 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef5bfd-18f1-41a0-b62f-3b4cf92244a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.138103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef5bfd-18f1-41a0-b62f-3b4cf92244a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.138386 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef5bfd-18f1-41a0-b62f-3b4cf92244a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.138707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef5bfd-18f1-41a0-b62f-3b4cf92244a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.139409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef5bfd-18f1-41a0-b62f-3b4cf92244a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.141170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef5bfd-18f1-41a0-b62f-3b4cf92244a1 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.151901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1303/2590] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:50.161190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b7822-223c-49fb-bcb0-f2abf2997957 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.171692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b7822-223c-49fb-bcb0-f2abf2997957 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.176450 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb151b-a88e-4306-85dc-b32086b83280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.177213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb151b-a88e-4306-85dc-b32086b83280 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.177752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb151b-a88e-4306-85dc-b32086b83280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.178093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb151b-a88e-4306-85dc-b32086b83280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.178998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb151b-a88e-4306-85dc-b32086b83280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.182727 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb151b-a88e-4306-85dc-b32086b83280 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.191100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1288/2591] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:50.195935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef5bfd-18f1-41a0-b62f-3b4cf92244a1 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.206101 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef5bfd-18f1-41a0-b62f-3b4cf92244a1 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.211707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bab87c-dfad-4a8c-8ba8-e77cc4867837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.212349 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bab87c-dfad-4a8c-8ba8-e77cc4867837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.212636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bab87c-dfad-4a8c-8ba8-e77cc4867837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.212917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bab87c-dfad-4a8c-8ba8-e77cc4867837 admin admin] PATH_INFO: `/v3/projects/4543c63370f0484c8d8820a35393d9a8/users/1fcef9c3da914e7eb1c88392b26413dc/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.227540 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bab87c-dfad-4a8c-8ba8-e77cc4867837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4543c63370f0484c8d8820a35393d9a8, user_id=1fcef9c3da914e7eb1c88392b26413dc, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.230344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bab87c-dfad-4a8c-8ba8-e77cc4867837 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.292446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1304/2592] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:50 2022] PUT /identity/v3/projects/4543c63370f0484c8d8820a35393d9a8/users/1fcef9c3da914e7eb1c88392b26413dc/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:50.302733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdab80-94d0-4232-b254-414d9ed01337 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.303030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdab80-94d0-4232-b254-414d9ed01337 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.303355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdab80-94d0-4232-b254-414d9ed01337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.331021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-cffdab80-94d0-4232-b254-414d9ed01337 None None] MFA Rules not processed for user `1fcef9c3da914e7eb1c88392b26413dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:50.332233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-cffdab80-94d0-4232-b254-414d9ed01337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:50.396055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1289/2593] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:50.403455 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bab87c-dfad-4a8c-8ba8-e77cc4867837 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.465264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bab87c-dfad-4a8c-8ba8-e77cc4867837 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.469809 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754395a-0e9f-4a45-8e9b-19e80b16ee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.470415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754395a-0e9f-4a45-8e9b-19e80b16ee6d admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.470799 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754395a-0e9f-4a45-8e9b-19e80b16ee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.471074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754395a-0e9f-4a45-8e9b-19e80b16ee6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.471772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754395a-0e9f-4a45-8e9b-19e80b16ee6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.473668 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754395a-0e9f-4a45-8e9b-19e80b16ee6d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.551131 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1305/2594] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:50 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:50.555835 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdab80-94d0-4232-b254-414d9ed01337 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.566632 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdab80-94d0-4232-b254-414d9ed01337 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.622650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db7e3e-b0fd-4627-a656-cdb8b32398e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.623266 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db7e3e-b0fd-4627-a656-cdb8b32398e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.623552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db7e3e-b0fd-4627-a656-cdb8b32398e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.623831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db7e3e-b0fd-4627-a656-cdb8b32398e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.624502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db7e3e-b0fd-4627-a656-cdb8b32398e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.626423 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db7e3e-b0fd-4627-a656-cdb8b32398e0 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.738844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1290/2595] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:50 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:50.743643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754395a-0e9f-4a45-8e9b-19e80b16ee6d admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.754042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754395a-0e9f-4a45-8e9b-19e80b16ee6d admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.759438 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288249c2-048a-4b80-8331-57ed1ccd0bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.760048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288249c2-048a-4b80-8331-57ed1ccd0bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.760377 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288249c2-048a-4b80-8331-57ed1ccd0bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.760665 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288249c2-048a-4b80-8331-57ed1ccd0bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.761360 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288249c2-048a-4b80-8331-57ed1ccd0bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.763013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288249c2-048a-4b80-8331-57ed1ccd0bf9 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.773895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1306/2596] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:41:50.780843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db7e3e-b0fd-4627-a656-cdb8b32398e0 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.791619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db7e3e-b0fd-4627-a656-cdb8b32398e0 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.796451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabe34d-d5e8-46f3-9553-c786ae011fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.797105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabe34d-d5e8-46f3-9553-c786ae011fed admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.797387 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabe34d-d5e8-46f3-9553-c786ae011fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.797668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabe34d-d5e8-46f3-9553-c786ae011fed admin admin] PATH_INFO: `/v3/projects/c730e5afcb7343d0a702adf48122986c/users/0401dfe328634da98b38f1311ab93fd3/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.813017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabe34d-d5e8-46f3-9553-c786ae011fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c730e5afcb7343d0a702adf48122986c, user_id=0401dfe328634da98b38f1311ab93fd3, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.815714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabe34d-d5e8-46f3-9553-c786ae011fed admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.887009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1291/2597] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:50 2022] PUT /identity/v3/projects/c730e5afcb7343d0a702adf48122986c/users/0401dfe328634da98b38f1311ab93fd3/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:50.890967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288249c2-048a-4b80-8331-57ed1ccd0bf9 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.901272 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288249c2-048a-4b80-8331-57ed1ccd0bf9 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.910332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:50.956945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd41ba-f3ef-4565-8a25-2bcec5d992cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.957592 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd41ba-f3ef-4565-8a25-2bcec5d992cb admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.957878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd41ba-f3ef-4565-8a25-2bcec5d992cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.958159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd41ba-f3ef-4565-8a25-2bcec5d992cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.958895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd41ba-f3ef-4565-8a25-2bcec5d992cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.960810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd41ba-f3ef-4565-8a25-2bcec5d992cb admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.970441 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1307/2598] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:50.975554 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabe34d-d5e8-46f3-9553-c786ae011fed admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.986067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabe34d-d5e8-46f3-9553-c786ae011fed admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.991635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8f866-6be7-44ca-a16b-5b75cac5162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.992230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8f866-6be7-44ca-a16b-5b75cac5162c admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.992519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8f866-6be7-44ca-a16b-5b75cac5162c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.992840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8f866-6be7-44ca-a16b-5b75cac5162c admin admin] PATH_INFO: `/v3/projects/c730e5afcb7343d0a702adf48122986c/users/0401dfe328634da98b38f1311ab93fd3/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.994985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8f866-6be7-44ca-a16b-5b75cac5162c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c730e5afcb7343d0a702adf48122986c, user_id=0401dfe328634da98b38f1311ab93fd3, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.997674 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8f866-6be7-44ca-a16b-5b75cac5162c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:51.008388 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1292/2599] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:50 2022] PUT /identity/v3/projects/c730e5afcb7343d0a702adf48122986c/users/0401dfe328634da98b38f1311ab93fd3/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:51.018629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdaef2-1a02-47c1-8c26-2c1d3b462af2 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:51.018927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdaef2-1a02-47c1-8c26-2c1d3b462af2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:51.019276 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdaef2-1a02-47c1-8c26-2c1d3b462af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:51.049358 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-1cbdaef2-1a02-47c1-8c26-2c1d3b462af2 None None] MFA Rules not processed for user `0401dfe328634da98b38f1311ab93fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:51.050608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1cbdaef2-1a02-47c1-8c26-2c1d3b462af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:51.120612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1308/2600] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:51.131669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8f866-6be7-44ca-a16b-5b75cac5162c admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:51.133535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3bd8f866-6be7-44ca-a16b-5b75cac5162c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:51.161003 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:51.192871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8f866-6be7-44ca-a16b-5b75cac5162c admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:51.197481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c22f20-6929-41cf-a25e-032f62dd39f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:51.198102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c22f20-6929-41cf-a25e-032f62dd39f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:51.198416 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c22f20-6929-41cf-a25e-032f62dd39f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:51.198726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c22f20-6929-41cf-a25e-032f62dd39f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:51.259788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c22f20-6929-41cf-a25e-032f62dd39f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:51.261352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c22f20-6929-41cf-a25e-032f62dd39f6 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:51.270433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1293/2601] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:54.342703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdaef2-1a02-47c1-8c26-2c1d3b462af2 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:54.404892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdaef2-1a02-47c1-8c26-2c1d3b462af2 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:54.409489 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:54.410120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:54.410404 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:54.410712 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] PATH_INFO: `/v3/users/1fcef9c3da914e7eb1c88392b26413dc` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:54.411875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fcef9c3da914e7eb1c88392b26413dc)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:54.413796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:54.612034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:54.621376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fcef9c3da914e7eb1c88392b26413dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:54.698410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fcef9c3da914e7eb1c88392b26413dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:54.706106 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fcef9c3da914e7eb1c88392b26413dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:54.706782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fcef9c3da914e7eb1c88392b26413dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:54.707394 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fcef9c3da914e7eb1c88392b26413dc'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:54.724755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1309/2602] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:54 2022] DELETE /identity/v3/users/1fcef9c3da914e7eb1c88392b26413dc => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:54.730127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a3e8f-3fab-4121-8fee-bea597bec268 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:54.730603 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a3e8f-3fab-4121-8fee-bea597bec268 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:54.730719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a3e8f-3fab-4121-8fee-bea597bec268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:54.750985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-e27a3e8f-3fab-4121-8fee-bea597bec268 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:54.752213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e27a3e8f-3fab-4121-8fee-bea597bec268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:54.814842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1294/2603] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:54.824554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:54.825959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:54.884433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3632dd-9081-4a44-8861-cbffb5d2c40e admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:54.888015 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01686945-4132-4f07-8fc6-c2e86dd22e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:54.888697 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01686945-4132-4f07-8fc6-c2e86dd22e45 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:54.888983 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01686945-4132-4f07-8fc6-c2e86dd22e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:54.889263 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01686945-4132-4f07-8fc6-c2e86dd22e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:54.898829 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01686945-4132-4f07-8fc6-c2e86dd22e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:54.900269 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01686945-4132-4f07-8fc6-c2e86dd22e45 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:54.909891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1310/2604] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:55.305618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a3e8f-3fab-4121-8fee-bea597bec268 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:55.310049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e27a3e8f-3fab-4121-8fee-bea597bec268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:55.321891 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a3e8f-3fab-4121-8fee-bea597bec268 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:55.326862 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:55.331575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:55.331575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:55.331575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] PATH_INFO: `/v3/projects/4543c63370f0484c8d8820a35393d9a8` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:55.331575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4543c63370f0484c8d8820a35393d9a8)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:55.331575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:55.459343 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4543c63370f0484c8d8820a35393d9a8', 'request_id': 'req-9c38b5fd-2dbf-4195-abe7-bed5270add30'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:55.465683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4543c63370f0484c8d8820a35393d9a8', 'request_id': 'req-9c38b5fd-2dbf-4195-abe7-bed5270add30'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:55.538267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4543c63370f0484c8d8820a35393d9a8', 'request_id': 'req-9c38b5fd-2dbf-4195-abe7-bed5270add30'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:55.546291 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:55.550052 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] The token cache is being invalidate because project 4543c63370f0484c8d8820a35393d9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:55.554926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:55.554926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:55.554926 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1295/2605] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:55 2022] DELETE /identity/v3/projects/4543c63370f0484c8d8820a35393d9a8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:55.556683 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01686945-4132-4f07-8fc6-c2e86dd22e45 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:55.566143 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01686945-4132-4f07-8fc6-c2e86dd22e45 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:55.622775 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3ebb3-2cdc-435c-853a-75d93fbcb344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:55.623414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3ebb3-2cdc-435c-853a-75d93fbcb344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:55.623742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3ebb3-2cdc-435c-853a-75d93fbcb344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:55.624022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3ebb3-2cdc-435c-853a-75d93fbcb344 admin admin] PATH_INFO: `/v3/users/0401dfe328634da98b38f1311ab93fd3` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:55.625284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3ebb3-2cdc-435c-853a-75d93fbcb344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0401dfe328634da98b38f1311ab93fd3)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:55.627255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3ebb3-2cdc-435c-853a-75d93fbcb344 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:55.803331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-fbf3ebb3-2cdc-435c-853a-75d93fbcb344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0401dfe328634da98b38f1311ab93fd3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:55.864297 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-fbf3ebb3-2cdc-435c-853a-75d93fbcb344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0401dfe328634da98b38f1311ab93fd3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:55.871153 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:55.874181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-fbf3ebb3-2cdc-435c-853a-75d93fbcb344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0401dfe328634da98b38f1311ab93fd3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:55.874950 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-fbf3ebb3-2cdc-435c-853a-75d93fbcb344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0401dfe328634da98b38f1311ab93fd3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:55.875551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-fbf3ebb3-2cdc-435c-853a-75d93fbcb344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0401dfe328634da98b38f1311ab93fd3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:55.894024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1311/2606] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:55 2022] DELETE /identity/v3/users/0401dfe328634da98b38f1311ab93fd3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:56.340014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:56.341526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:56.356608 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38b5fd-2dbf-4195-abe7-bed5270add30 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:56.415804 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:56.416498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:56.416787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:56.417066 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e admin admin] PATH_INFO: `/v3/projects/c730e5afcb7343d0a702adf48122986c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:56.418231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c730e5afcb7343d0a702adf48122986c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:56.420179 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:56.550613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c730e5afcb7343d0a702adf48122986c', 'request_id': 'req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:56.556278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c730e5afcb7343d0a702adf48122986c', 'request_id': 'req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:56.641168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c730e5afcb7343d0a702adf48122986c', 'request_id': 'req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:56.655436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e admin admin] The token cache is being invalidate because project c730e5afcb7343d0a702adf48122986c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:56.656575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:56.656575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-7f00db40-6e66-4954-ac9d-cf867b1c3f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:56.658018 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1296/2607] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:56 2022] DELETE /identity/v3/projects/c730e5afcb7343d0a702adf48122986c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:56.664508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362449a-a184-4a06-895b-4f98994ffc63 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:56.665009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362449a-a184-4a06-895b-4f98994ffc63 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:56.665113 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362449a-a184-4a06-895b-4f98994ffc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:56.684382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-1362449a-a184-4a06-895b-4f98994ffc63 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:56.685574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1362449a-a184-4a06-895b-4f98994ffc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:56.745180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1312/2608] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:56.809005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291c052-ef0a-4094-a88f-1bc27558c054 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:56.809298 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291c052-ef0a-4094-a88f-1bc27558c054 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:56.809637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291c052-ef0a-4094-a88f-1bc27558c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:56.829776 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-1291c052-ef0a-4094-a88f-1bc27558c054 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:56.831019 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1291c052-ef0a-4094-a88f-1bc27558c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:56.839933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1297/2609] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:56.844179 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362449a-a184-4a06-895b-4f98994ffc63 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:56.855329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362449a-a184-4a06-895b-4f98994ffc63 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:56.859827 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd261d87-bf9e-4d92-a4a1-f49fe0590f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:56.860427 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd261d87-bf9e-4d92-a4a1-f49fe0590f23 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:56.860708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd261d87-bf9e-4d92-a4a1-f49fe0590f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:56.860981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd261d87-bf9e-4d92-a4a1-f49fe0590f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:56.861669 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd261d87-bf9e-4d92-a4a1-f49fe0590f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:56.861973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd261d87-bf9e-4d92-a4a1-f49fe0590f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:56.863616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd261d87-bf9e-4d92-a4a1-f49fe0590f23 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:56.875138 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1313/2610] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:41:56.879331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291c052-ef0a-4094-a88f-1bc27558c054 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:56.889307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291c052-ef0a-4094-a88f-1bc27558c054 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:56.894044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd556f-ee1a-46e8-87e4-46493439c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:56.894621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd556f-ee1a-46e8-87e4-46493439c458 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:56.894903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd556f-ee1a-46e8-87e4-46493439c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:56.895174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd556f-ee1a-46e8-87e4-46493439c458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:56.895836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd556f-ee1a-46e8-87e4-46493439c458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:56.898400 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd556f-ee1a-46e8-87e4-46493439c458 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:56.968561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1298/2611] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:56 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:56.972822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd261d87-bf9e-4d92-a4a1-f49fe0590f23 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:56.983151 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd261d87-bf9e-4d92-a4a1-f49fe0590f23 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:57.044221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a28f9-829e-40af-85f0-afad31a6a132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:57.044861 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a28f9-829e-40af-85f0-afad31a6a132 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:57.045147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a28f9-829e-40af-85f0-afad31a6a132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:57.045422 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a28f9-829e-40af-85f0-afad31a6a132 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:57.046454 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a28f9-829e-40af-85f0-afad31a6a132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:57.048123 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a28f9-829e-40af-85f0-afad31a6a132 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:57.132527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1314/2612] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:56 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:57.137056 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd556f-ee1a-46e8-87e4-46493439c458 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:57.148781 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd556f-ee1a-46e8-87e4-46493439c458 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:57.153846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d970e-5ca1-47c7-97d8-578d27276b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:57.154464 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d970e-5ca1-47c7-97d8-578d27276b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:57.154826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d970e-5ca1-47c7-97d8-578d27276b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:57.155105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d970e-5ca1-47c7-97d8-578d27276b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:57.155923 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d970e-5ca1-47c7-97d8-578d27276b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:57.157522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d970e-5ca1-47c7-97d8-578d27276b17 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:57.180364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1299/2613] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:57.184350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a28f9-829e-40af-85f0-afad31a6a132 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:57.195124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a28f9-829e-40af-85f0-afad31a6a132 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:57.199797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3677776-e246-4de8-93a2-6163bacdab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:57.200402 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3677776-e246-4de8-93a2-6163bacdab58 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:57.200682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3677776-e246-4de8-93a2-6163bacdab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:57.200956 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3677776-e246-4de8-93a2-6163bacdab58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:57.201648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3677776-e246-4de8-93a2-6163bacdab58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:57.203286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3677776-e246-4de8-93a2-6163bacdab58 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:57.213909 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1315/2614] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:57.218106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d970e-5ca1-47c7-97d8-578d27276b17 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:57.228738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d970e-5ca1-47c7-97d8-578d27276b17 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:57.233393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da92098-c84e-4659-a02e-8b5e54520d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:57.234053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da92098-c84e-4659-a02e-8b5e54520d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:57.234337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da92098-c84e-4659-a02e-8b5e54520d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:57.234650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da92098-c84e-4659-a02e-8b5e54520d3d admin admin] PATH_INFO: `/v3/projects/a6e63a2daa4549c7ab0c0e8d56b55d23/users/e4f93bbfb5c14cf9a63dcc3214b54c69/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:57.249717 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da92098-c84e-4659-a02e-8b5e54520d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e63a2daa4549c7ab0c0e8d56b55d23, user_id=e4f93bbfb5c14cf9a63dcc3214b54c69, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:57.252420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da92098-c84e-4659-a02e-8b5e54520d3d admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:57.321721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1300/2615] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:57 2022] PUT /identity/v3/projects/a6e63a2daa4549c7ab0c0e8d56b55d23/users/e4f93bbfb5c14cf9a63dcc3214b54c69/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:57.331842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af018b9b-79b9-4174-8f4d-d51936f3714f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:57.332135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af018b9b-79b9-4174-8f4d-d51936f3714f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:57.332419 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af018b9b-79b9-4174-8f4d-d51936f3714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:57.361221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-af018b9b-79b9-4174-8f4d-d51936f3714f None None] MFA Rules not processed for user `e4f93bbfb5c14cf9a63dcc3214b54c69`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:57.362445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-af018b9b-79b9-4174-8f4d-d51936f3714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:57.394125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:57.428617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1316/2616] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:41:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:57.439877 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da92098-c84e-4659-a02e-8b5e54520d3d admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:57.441658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-8da92098-c84e-4659-a02e-8b5e54520d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:57.473332 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:57.499193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da92098-c84e-4659-a02e-8b5e54520d3d admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:57.502833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd284ba0-153c-4dc5-bd0c-18cc4c2ac762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:57.503444 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd284ba0-153c-4dc5-bd0c-18cc4c2ac762 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:57.503726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd284ba0-153c-4dc5-bd0c-18cc4c2ac762 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:57.504004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd284ba0-153c-4dc5-bd0c-18cc4c2ac762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:57.513614 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd284ba0-153c-4dc5-bd0c-18cc4c2ac762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:57.515102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd284ba0-153c-4dc5-bd0c-18cc4c2ac762 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:57.524244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1301/2617] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:01.551010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1cd70-20ee-4daa-929a-202276275d37 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:01.551473 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1cd70-20ee-4daa-929a-202276275d37 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:01.551758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1cd70-20ee-4daa-929a-202276275d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:01.572433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-afa1cd70-20ee-4daa-929a-202276275d37 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:01.573748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-afa1cd70-20ee-4daa-929a-202276275d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:01.632558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1317/2618] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:42:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:01.658032 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd284ba0-153c-4dc5-bd0c-18cc4c2ac762 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:01.659646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-bd284ba0-153c-4dc5-bd0c-18cc4c2ac762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:01.731498 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd284ba0-153c-4dc5-bd0c-18cc4c2ac762 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:01.736959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8d36d-c5f0-42f3-ab8b-c30c2e54ef8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:01.737502 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8d36d-c5f0-42f3-ab8b-c30c2e54ef8d service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:01.737790 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8d36d-c5f0-42f3-ab8b-c30c2e54ef8d service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:01.738069 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8d36d-c5f0-42f3-ab8b-c30c2e54ef8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:01.747367 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8d36d-c5f0-42f3-ab8b-c30c2e54ef8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:01.749011 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8d36d-c5f0-42f3-ab8b-c30c2e54ef8d service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:01.758628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1302/2619] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:42:09.332901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1cd70-20ee-4daa-929a-202276275d37 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:09.428752 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1cd70-20ee-4daa-929a-202276275d37 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:09.439632 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:09.440477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:09.440771 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:09.441054 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] PATH_INFO: `/v3/users/e4f93bbfb5c14cf9a63dcc3214b54c69` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:09.442282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f93bbfb5c14cf9a63dcc3214b54c69)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:09.444321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:09.644472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f93bbfb5c14cf9a63dcc3214b54c69'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:09.721586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f93bbfb5c14cf9a63dcc3214b54c69'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:09.730118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f93bbfb5c14cf9a63dcc3214b54c69'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:09.730784 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f93bbfb5c14cf9a63dcc3214b54c69'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:09.731443 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f93bbfb5c14cf9a63dcc3214b54c69'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:09.749740 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:09.757830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1318/2620] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:42:09 2022] DELETE /identity/v3/users/e4f93bbfb5c14cf9a63dcc3214b54c69 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:09.762183 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d100431-b1fe-4451-ad90-1e7d6a1bb68c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:09.762808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d100431-b1fe-4451-ad90-1e7d6a1bb68c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:09.762808 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d100431-b1fe-4451-ad90-1e7d6a1bb68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:09.783809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2d100431-b1fe-4451-ad90-1e7d6a1bb68c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:09.785003 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2d100431-b1fe-4451-ad90-1e7d6a1bb68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:09.865091 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1303/2621] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:09.874597 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:09.876116 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:09.945195 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d6dd6-7d56-4b3c-bc46-e6f58f975b3c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:09.949061 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e6a38-e88f-4bb9-922c-2484fc2d116d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:09.949767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e6a38-e88f-4bb9-922c-2484fc2d116d service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:09.950122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e6a38-e88f-4bb9-922c-2484fc2d116d service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:09.950461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e6a38-e88f-4bb9-922c-2484fc2d116d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:09.961354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e6a38-e88f-4bb9-922c-2484fc2d116d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:09.963086 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e6a38-e88f-4bb9-922c-2484fc2d116d service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:09.973689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1319/2622] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:10.456819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d100431-b1fe-4451-ad90-1e7d6a1bb68c None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:10.456819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2d100431-b1fe-4451-ad90-1e7d6a1bb68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:10.482913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d100431-b1fe-4451-ad90-1e7d6a1bb68c None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:10.489148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:10.490043 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:10.490381 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:10.490798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] PATH_INFO: `/v3/projects/a6e63a2daa4549c7ab0c0e8d56b55d23` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:10.492998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e63a2daa4549c7ab0c0e8d56b55d23)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:10.495399 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:10.627221 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e63a2daa4549c7ab0c0e8d56b55d23', 'request_id': 'req-baea6366-4491-4030-a9a7-2d6f01bd9f8f'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:10.634209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:10.637448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e63a2daa4549c7ab0c0e8d56b55d23', 'request_id': 'req-baea6366-4491-4030-a9a7-2d6f01bd9f8f'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:10.681869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e63a2daa4549c7ab0c0e8d56b55d23', 'request_id': 'req-baea6366-4491-4030-a9a7-2d6f01bd9f8f'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:10.699538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] The token cache is being invalidate because project a6e63a2daa4549c7ab0c0e8d56b55d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:42:10.699991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:10.700820 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:10.702635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1304/2623] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:42:10 2022] DELETE /identity/v3/projects/a6e63a2daa4549c7ab0c0e8d56b55d23 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:11.173705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e6a38-e88f-4bb9-922c-2484fc2d116d service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:11.175192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e44e6a38-e88f-4bb9-922c-2484fc2d116d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:11.187016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e6a38-e88f-4bb9-922c-2484fc2d116d service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:11.234916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034930e4-3b08-4758-9270-8fcf120682f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:11.235530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034930e4-3b08-4758-9270-8fcf120682f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:11.235814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034930e4-3b08-4758-9270-8fcf120682f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:11.236087 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034930e4-3b08-4758-9270-8fcf120682f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:11.237838 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-034930e4-3b08-4758-9270-8fcf120682f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:11.247643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034930e4-3b08-4758-9270-8fcf120682f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:11.249060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034930e4-3b08-4758-9270-8fcf120682f0 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:11.257085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1320/2624] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:14.231759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:14.233274 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:14.322417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea6366-4491-4030-a9a7-2d6f01bd9f8f admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:14.328173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d83361-3bf6-4fa3-bd5b-ec82e48412d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:14.328820 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d83361-3bf6-4fa3-bd5b-ec82e48412d5 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:14.329105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d83361-3bf6-4fa3-bd5b-ec82e48412d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:14.329384 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d83361-3bf6-4fa3-bd5b-ec82e48412d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:14.331229 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-93d83361-3bf6-4fa3-bd5b-ec82e48412d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:14.394225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d83361-3bf6-4fa3-bd5b-ec82e48412d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:14.395770 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d83361-3bf6-4fa3-bd5b-ec82e48412d5 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:14.406520 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1305/2625] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:15.774369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034930e4-3b08-4758-9270-8fcf120682f0 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:15.776057 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-034930e4-3b08-4758-9270-8fcf120682f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:15.786797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034930e4-3b08-4758-9270-8fcf120682f0 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:15.791028 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f5e19-fb12-43ec-8942-9e1847eccb3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:15.791640 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f5e19-fb12-43ec-8942-9e1847eccb3e service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:15.791925 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f5e19-fb12-43ec-8942-9e1847eccb3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:15.792205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f5e19-fb12-43ec-8942-9e1847eccb3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:15.793932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-346f5e19-fb12-43ec-8942-9e1847eccb3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:15.803568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f5e19-fb12-43ec-8942-9e1847eccb3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:15.805583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f5e19-fb12-43ec-8942-9e1847eccb3e service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:15.814518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1321/2626] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:16.300665 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d83361-3bf6-4fa3-bd5b-ec82e48412d5 service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:16.302224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-93d83361-3bf6-4fa3-bd5b-ec82e48412d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:16.374552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d83361-3bf6-4fa3-bd5b-ec82e48412d5 service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:16.379475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a34ec-9e5e-44bd-b390-7af1041481c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '423ac00601f84e3d9c6cc6ee20eee6ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:16.380092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a34ec-9e5e-44bd-b390-7af1041481c9 service placement] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:16.380371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a34ec-9e5e-44bd-b390-7af1041481c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:16.380642 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a34ec-9e5e-44bd-b390-7af1041481c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:16.382443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-018a34ec-9e5e-44bd-b390-7af1041481c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:16.394986 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a34ec-9e5e-44bd-b390-7af1041481c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:16.396574 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a34ec-9e5e-44bd-b390-7af1041481c9 service placement] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:16.408170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1306/2627] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:17.228179 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f5e19-fb12-43ec-8942-9e1847eccb3e service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:17.241401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f5e19-fb12-43ec-8942-9e1847eccb3e service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:17.247687 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3753-edb0-4ec2-afba-84df642c55c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:17.248296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3753-edb0-4ec2-afba-84df642c55c9 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:17.248594 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3753-edb0-4ec2-afba-84df642c55c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:17.248862 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3753-edb0-4ec2-afba-84df642c55c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:17.250642 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-7fab3753-edb0-4ec2-afba-84df642c55c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:17.264383 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3753-edb0-4ec2-afba-84df642c55c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:17.266090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3753-edb0-4ec2-afba-84df642c55c9 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:17.287122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1322/2628] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:20.255304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf807-1501-4f53-9573-1d2a0346d7ca None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:20.255819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf807-1501-4f53-9573-1d2a0346d7ca None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:20.255931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf807-1501-4f53-9573-1d2a0346d7ca None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:20.260328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1307/2629] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:42:20.263441 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a509e15-8cc2-4c23-b9c6-37bda1866ff7 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:20.263870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a509e15-8cc2-4c23-b9c6-37bda1866ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:20.263998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a509e15-8cc2-4c23-b9c6-37bda1866ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:20.285418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-7a509e15-8cc2-4c23-b9c6-37bda1866ff7 None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:20.286646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-7a509e15-8cc2-4c23-b9c6-37bda1866ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:20.302505 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1323/2630] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:42:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:42:20.314471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf807-1501-4f53-9573-1d2a0346d7ca None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:20.316332 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-895bf807-1501-4f53-9573-1d2a0346d7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:20.328818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:20.378600 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf807-1501-4f53-9573-1d2a0346d7ca None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:20.382909 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ea5fa-3f17-4a8f-aba0-e1921bb7d9d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bd2ed69b324e85b8166135f045b840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:20.384159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ea5fa-3f17-4a8f-aba0-e1921bb7d9d6 service glance] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:20.384519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ea5fa-3f17-4a8f-aba0-e1921bb7d9d6 service glance] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:20.384897 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ea5fa-3f17-4a8f-aba0-e1921bb7d9d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:20.395557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ea5fa-3f17-4a8f-aba0-e1921bb7d9d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:20.397010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ea5fa-3f17-4a8f-aba0-e1921bb7d9d6 service glance] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:20.408569 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1308/2631] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:20.609063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4080a-a7c9-4dcd-92a8-a68f67de7ec7 None None] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:20.609348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4080a-a7c9-4dcd-92a8-a68f67de7ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:20.609619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4080a-a7c9-4dcd-92a8-a68f67de7ec7 None None] PATH_INFO: `/` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:20.611959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1324/2632] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:42:20.617038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773c668-8a64-420e-93b6-62dc71123410 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:20.617908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773c668-8a64-420e-93b6-62dc71123410 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:20.618255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773c668-8a64-420e-93b6-62dc71123410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:20.638140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-d773c668-8a64-420e-93b6-62dc71123410 None None] MFA Rules not processed for user `1ac08ad57a8e442d89ba1881abf43cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:20.639375 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d773c668-8a64-420e-93b6-62dc71123410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:20.646021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1309/2633] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:42:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:20.658618 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4080a-a7c9-4dcd-92a8-a68f67de7ec7 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:20.660350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-bde4080a-a7c9-4dcd-92a8-a68f67de7ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:20.673575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4080a-a7c9-4dcd-92a8-a68f67de7ec7 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:20.677732 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b56e56-1d9b-4a93-b320-599002450bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:20.678353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56e56-1d9b-4a93-b320-599002450bbb service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:20.678685 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56e56-1d9b-4a93-b320-599002450bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:20.678965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56e56-1d9b-4a93-b320-599002450bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:20.687582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b56e56-1d9b-4a93-b320-599002450bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:20.689046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b56e56-1d9b-4a93-b320-599002450bbb service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:20.697780 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1325/2634] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:20.780651 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9ba4d-9ea7-4ea1-9609-3913df91e6e9 None None] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:20.780946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9ba4d-9ea7-4ea1-9609-3913df91e6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:20.781222 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9ba4d-9ea7-4ea1-9609-3913df91e6e9 None None] PATH_INFO: `/` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:20.782731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1310/2635] 10.222.0.60 () {54 vars in 921 bytes} [Thu Aug 4 02:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:42:20.787587 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3130822-9b99-49fc-b19b-75a3474f465f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:20.787867 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3130822-9b99-49fc-b19b-75a3474f465f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:20.788147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3130822-9b99-49fc-b19b-75a3474f465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:20.809072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c3130822-9b99-49fc-b19b-75a3474f465f None None] MFA Rules not processed for user `c6d95db1228f48669e1985eb74306a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:20.810370 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c3130822-9b99-49fc-b19b-75a3474f465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:20.820593 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1326/2636] 10.222.0.60 () {58 vars in 1018 bytes} [Thu Aug 4 02:42:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:20.831484 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9ba4d-9ea7-4ea1-9609-3913df91e6e9 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:20.842913 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9ba4d-9ea7-4ea1-9609-3913df91e6e9 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:20.846850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f244ad2-6849-4791-8ea1-97743d690022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:20.847460 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f244ad2-6849-4791-8ea1-97743d690022 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:20.847746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f244ad2-6849-4791-8ea1-97743d690022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:20.848027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f244ad2-6849-4791-8ea1-97743d690022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:20.858947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f244ad2-6849-4791-8ea1-97743d690022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:20.860385 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f244ad2-6849-4791-8ea1-97743d690022 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:20.872203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1311/2637] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:24.093703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34584634-5b24-49aa-9537-fcfa67c49120 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:24.094223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34584634-5b24-49aa-9537-fcfa67c49120 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:24.094320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34584634-5b24-49aa-9537-fcfa67c49120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:24.115614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-34584634-5b24-49aa-9537-fcfa67c49120 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:24.116838 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-34584634-5b24-49aa-9537-fcfa67c49120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:24.173625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:24.185843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1327/2638] 10.222.0.60 () {58 vars in 1009 bytes} [Thu Aug 4 02:42:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:24.200943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f244ad2-6849-4791-8ea1-97743d690022 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:24.206423 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-0f244ad2-6849-4791-8ea1-97743d690022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:24.281273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f244ad2-6849-4791-8ea1-97743d690022 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:24.288364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2131d6-a9aa-4037-833c-c25c359ecdde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:24.289093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2131d6-a9aa-4037-833c-c25c359ecdde service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:24.289472 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2131d6-a9aa-4037-833c-c25c359ecdde service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:24.289822 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2131d6-a9aa-4037-833c-c25c359ecdde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:24.302371 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2131d6-a9aa-4037-833c-c25c359ecdde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:24.304032 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2131d6-a9aa-4037-833c-c25c359ecdde service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:24.313193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1312/2639] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:42:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:42:34.229456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:34.309903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=63 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:38.821842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c58430-9057-4f58-845b-0e7e75a910b1 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:38.822344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c58430-9057-4f58-845b-0e7e75a910b1 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:38.822435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c58430-9057-4f58-845b-0e7e75a910b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:38.846284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c2c58430-9057-4f58-845b-0e7e75a910b1 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:38.847533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c2c58430-9057-4f58-845b-0e7e75a910b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:38.855387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1328/2640] 10.222.0.60 () {58 vars in 967 bytes} [Thu Aug 4 02:42:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:38.868630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2131d6-a9aa-4037-833c-c25c359ecdde service swift] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:38.879255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2131d6-a9aa-4037-833c-c25c359ecdde service swift] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:38.884352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5928cd-48eb-4f0d-8010-a42215f38f87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:38.884954 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5928cd-48eb-4f0d-8010-a42215f38f87 service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:38.885259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5928cd-48eb-4f0d-8010-a42215f38f87 service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:38.885560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5928cd-48eb-4f0d-8010-a42215f38f87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:38.893744 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5928cd-48eb-4f0d-8010-a42215f38f87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:38.895351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5928cd-48eb-4f0d-8010-a42215f38f87 service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:38.904044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1313/2641] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:42:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 02:42:42.486408 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c58430-9057-4f58-845b-0e7e75a910b1 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:42.487877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c2c58430-9057-4f58-845b-0e7e75a910b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:42.504585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c58430-9057-4f58-845b-0e7e75a910b1 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:42.512942 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3c787-28c2-4bae-9363-5c5af2ea82c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:42.513575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3c787-28c2-4bae-9363-5c5af2ea82c3 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:42.513879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3c787-28c2-4bae-9363-5c5af2ea82c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:42.514160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3c787-28c2-4bae-9363-5c5af2ea82c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:42.515978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-daa3c787-28c2-4bae-9363-5c5af2ea82c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:42.529190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3c787-28c2-4bae-9363-5c5af2ea82c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:42.544716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3c787-28c2-4bae-9363-5c5af2ea82c3 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:42.544716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1329/2642] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:42:48.473570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5928cd-48eb-4f0d-8010-a42215f38f87 service swift] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:48.483486 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5928cd-48eb-4f0d-8010-a42215f38f87 service swift] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:48.487115 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16affd1-6afd-4a55-b19e-351ad4014bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:48.487719 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16affd1-6afd-4a55-b19e-351ad4014bdb service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:48.488006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16affd1-6afd-4a55-b19e-351ad4014bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:48.488282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16affd1-6afd-4a55-b19e-351ad4014bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:48.490047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e16affd1-6afd-4a55-b19e-351ad4014bdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:48.552880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16affd1-6afd-4a55-b19e-351ad4014bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:48.554352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16affd1-6afd-4a55-b19e-351ad4014bdb service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:48.564803 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1314/2643] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:52.003547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3c787-28c2-4bae-9363-5c5af2ea82c3 service nova] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:52.005024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-daa3c787-28c2-4bae-9363-5c5af2ea82c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:52.019551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3c787-28c2-4bae-9363-5c5af2ea82c3 service nova] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:52.025006 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eff1f-a70a-46fd-bdc8-e2ac1e355a7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '423ac00601f84e3d9c6cc6ee20eee6ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:52.026213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eff1f-a70a-46fd-bdc8-e2ac1e355a7f service placement] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:52.026619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eff1f-a70a-46fd-bdc8-e2ac1e355a7f service placement] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:52.026943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eff1f-a70a-46fd-bdc8-e2ac1e355a7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:52.028981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a41eff1f-a70a-46fd-bdc8-e2ac1e355a7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:52.046333 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41eff1f-a70a-46fd-bdc8-e2ac1e355a7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:52.048226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41eff1f-a70a-46fd-bdc8-e2ac1e355a7f service placement] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:52.059467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1330/2644] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:52.133096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16affd1-6afd-4a55-b19e-351ad4014bdb service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:52.134612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-e16affd1-6afd-4a55-b19e-351ad4014bdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:52.147522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16affd1-6afd-4a55-b19e-351ad4014bdb service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:52.152819 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ee702-c434-4e8c-88f9-3f1f5ea00c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:52.153897 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ee702-c434-4e8c-88f9-3f1f5ea00c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:52.154212 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ee702-c434-4e8c-88f9-3f1f5ea00c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:52.154516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ee702-c434-4e8c-88f9-3f1f5ea00c75 admin admin] PATH_INFO: `/v3/users/99068d55e19e4b3cbf9197ca46d86fd3` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:52.155910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ee702-c434-4e8c-88f9-3f1f5ea00c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99068d55e19e4b3cbf9197ca46d86fd3)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:52.157839 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ee702-c434-4e8c-88f9-3f1f5ea00c75 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:52.317028 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-872ee702-c434-4e8c-88f9-3f1f5ea00c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99068d55e19e4b3cbf9197ca46d86fd3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:52.329697 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-872ee702-c434-4e8c-88f9-3f1f5ea00c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99068d55e19e4b3cbf9197ca46d86fd3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:52.330372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-872ee702-c434-4e8c-88f9-3f1f5ea00c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99068d55e19e4b3cbf9197ca46d86fd3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:52.337262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-872ee702-c434-4e8c-88f9-3f1f5ea00c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99068d55e19e4b3cbf9197ca46d86fd3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:52.423634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-872ee702-c434-4e8c-88f9-3f1f5ea00c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99068d55e19e4b3cbf9197ca46d86fd3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:52.430256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1315/2645] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:42:52 2022] DELETE /identity/v3/users/99068d55e19e4b3cbf9197ca46d86fd3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:52.677237 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eff1f-a70a-46fd-bdc8-e2ac1e355a7f service placement] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:52.690084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eff1f-a70a-46fd-bdc8-e2ac1e355a7f service placement] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:52.747761 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d25711-231a-4cf5-aed1-60dd54523c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:52.748420 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25711-231a-4cf5-aed1-60dd54523c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:52.748702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25711-231a-4cf5-aed1-60dd54523c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:52.748979 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25711-231a-4cf5-aed1-60dd54523c8d admin admin] PATH_INFO: `/v3/projects/a2c4c2e98c444c07b2919db3e65cedf2` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:52.750122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d25711-231a-4cf5-aed1-60dd54523c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c4c2e98c444c07b2919db3e65cedf2)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:52.752258 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d25711-231a-4cf5-aed1-60dd54523c8d admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:52.887503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-15d25711-231a-4cf5-aed1-60dd54523c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c4c2e98c444c07b2919db3e65cedf2', 'request_id': 'req-15d25711-231a-4cf5-aed1-60dd54523c8d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:52.971666 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-15d25711-231a-4cf5-aed1-60dd54523c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c4c2e98c444c07b2919db3e65cedf2', 'request_id': 'req-15d25711-231a-4cf5-aed1-60dd54523c8d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:52.977635 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-15d25711-231a-4cf5-aed1-60dd54523c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c4c2e98c444c07b2919db3e65cedf2', 'request_id': 'req-15d25711-231a-4cf5-aed1-60dd54523c8d'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:52.988971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-15d25711-231a-4cf5-aed1-60dd54523c8d admin admin] The token cache is being invalidate because project a2c4c2e98c444c07b2919db3e65cedf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:42:52.989266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-15d25711-231a-4cf5-aed1-60dd54523c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:52.989909 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-15d25711-231a-4cf5-aed1-60dd54523c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:52.991451 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1331/2646] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:42:52 2022] DELETE /identity/v3/projects/a2c4c2e98c444c07b2919db3e65cedf2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:52.997383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14549bf1-e3c4-4737-b9f3-e42f624723e0 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:52.997679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14549bf1-e3c4-4737-b9f3-e42f624723e0 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:52.997965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14549bf1-e3c4-4737-b9f3-e42f624723e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:53.018626 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-14549bf1-e3c4-4737-b9f3-e42f624723e0 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:53.019842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-14549bf1-e3c4-4737-b9f3-e42f624723e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:53.067522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:53.079872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1316/2647] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:53.088023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813187dc-a297-4b57-bc64-099cfda05c3a None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:53.088972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813187dc-a297-4b57-bc64-099cfda05c3a None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:53.089093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813187dc-a297-4b57-bc64-099cfda05c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:53.108716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-813187dc-a297-4b57-bc64-099cfda05c3a None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:53.109929 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-813187dc-a297-4b57-bc64-099cfda05c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:53.118016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1332/2648] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:53.122231 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14549bf1-e3c4-4737-b9f3-e42f624723e0 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:53.131878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14549bf1-e3c4-4737-b9f3-e42f624723e0 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:53.137487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c91d8-6577-4b9c-bbc6-83360a71cd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:53.138146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c91d8-6577-4b9c-bbc6-83360a71cd9c admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:53.153597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c91d8-6577-4b9c-bbc6-83360a71cd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:53.153597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c91d8-6577-4b9c-bbc6-83360a71cd9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:53.153597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c91d8-6577-4b9c-bbc6-83360a71cd9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:42:53.153597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c91d8-6577-4b9c-bbc6-83360a71cd9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:53.153597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c91d8-6577-4b9c-bbc6-83360a71cd9c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:53.154414 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1317/2649] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:42:53.158974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813187dc-a297-4b57-bc64-099cfda05c3a None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:53.169331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813187dc-a297-4b57-bc64-099cfda05c3a None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:53.174378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6c082-a641-429e-9c8d-a8a4dc26fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:53.175192 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6c082-a641-429e-9c8d-a8a4dc26fec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:53.177426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6c082-a641-429e-9c8d-a8a4dc26fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:53.177426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6c082-a641-429e-9c8d-a8a4dc26fec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:53.177426 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6c082-a641-429e-9c8d-a8a4dc26fec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:53.178695 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6c082-a641-429e-9c8d-a8a4dc26fec5 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:53.281115 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1333/2650] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:42:53 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:42:53.282218 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c91d8-6577-4b9c-bbc6-83360a71cd9c admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:53.292470 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c91d8-6577-4b9c-bbc6-83360a71cd9c admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:53.348022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a992-f658-4bda-b232-72e9670417ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:53.348623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a992-f658-4bda-b232-72e9670417ff admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:53.348905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a992-f658-4bda-b232-72e9670417ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:53.349181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a992-f658-4bda-b232-72e9670417ff admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:53.349826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913a992-f658-4bda-b232-72e9670417ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:53.351790 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913a992-f658-4bda-b232-72e9670417ff admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:53.423394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1318/2651] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:42:53 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:42:53.427547 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6c082-a641-429e-9c8d-a8a4dc26fec5 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:53.439007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6c082-a641-429e-9c8d-a8a4dc26fec5 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:53.443927 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafef799-3ab0-4410-8a0c-b56f9dff9d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:53.444561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafef799-3ab0-4410-8a0c-b56f9dff9d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:53.444961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafef799-3ab0-4410-8a0c-b56f9dff9d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:53.445243 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafef799-3ab0-4410-8a0c-b56f9dff9d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:53.445941 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafef799-3ab0-4410-8a0c-b56f9dff9d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:53.448286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafef799-3ab0-4410-8a0c-b56f9dff9d21 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:53.458643 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1334/2652] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:42:53.462831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a992-f658-4bda-b232-72e9670417ff admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:53.473164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a992-f658-4bda-b232-72e9670417ff admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:53.477756 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30752b0a-1262-4952-9aa5-24a2260c2cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:53.478364 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30752b0a-1262-4952-9aa5-24a2260c2cba admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:53.478690 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30752b0a-1262-4952-9aa5-24a2260c2cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:53.478970 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30752b0a-1262-4952-9aa5-24a2260c2cba admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:53.479669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30752b0a-1262-4952-9aa5-24a2260c2cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:53.481265 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30752b0a-1262-4952-9aa5-24a2260c2cba admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:53.492117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1319/2653] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:42:53.497280 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafef799-3ab0-4410-8a0c-b56f9dff9d21 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:53.507145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafef799-3ab0-4410-8a0c-b56f9dff9d21 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:53.512554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6a9d6-09cb-4d20-bcb5-f7328588b518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:53.513286 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6a9d6-09cb-4d20-bcb5-f7328588b518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:53.513639 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6a9d6-09cb-4d20-bcb5-f7328588b518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:53.514002 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6a9d6-09cb-4d20-bcb5-f7328588b518 admin admin] PATH_INFO: `/v3/projects/bf28b590ed3a4b4abcab22ad365d4cce/users/96237f6bc1e5414088b70e0316604172/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:53.532127 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6a9d6-09cb-4d20-bcb5-f7328588b518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf28b590ed3a4b4abcab22ad365d4cce, user_id=96237f6bc1e5414088b70e0316604172, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:53.534958 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6a9d6-09cb-4d20-bcb5-f7328588b518 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:53.537363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:53.578703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1335/2654] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:42:53 2022] PUT /identity/v3/projects/bf28b590ed3a4b4abcab22ad365d4cce/users/96237f6bc1e5414088b70e0316604172/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:53.589486 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9631698-fd7f-4070-bc46-1c8143c20083 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:53.589796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9631698-fd7f-4070-bc46-1c8143c20083 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:53.590093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9631698-fd7f-4070-bc46-1c8143c20083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:53.617235 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-c9631698-fd7f-4070-bc46-1c8143c20083 None None] MFA Rules not processed for user `96237f6bc1e5414088b70e0316604172`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:53.618634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c9631698-fd7f-4070-bc46-1c8143c20083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:53.683749 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1320/2655] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:42:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:53.688333 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6a9d6-09cb-4d20-bcb5-f7328588b518 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:53.750010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6a9d6-09cb-4d20-bcb5-f7328588b518 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:53.755320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0280d02-3b39-4731-b3e4-34bf42ca3360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:53.755934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0280d02-3b39-4731-b3e4-34bf42ca3360 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:53.756220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0280d02-3b39-4731-b3e4-34bf42ca3360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:53.756498 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0280d02-3b39-4731-b3e4-34bf42ca3360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:53.757203 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0280d02-3b39-4731-b3e4-34bf42ca3360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:53.759156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0280d02-3b39-4731-b3e4-34bf42ca3360 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:53.859042 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1336/2656] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:42:53 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:42:53.863251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9631698-fd7f-4070-bc46-1c8143c20083 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:53.874877 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9631698-fd7f-4070-bc46-1c8143c20083 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:53.920442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:53.932786 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a788bd-6722-4988-8474-ae26d55bfddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:53.933409 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a788bd-6722-4988-8474-ae26d55bfddc admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:53.933695 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a788bd-6722-4988-8474-ae26d55bfddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:53.933968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a788bd-6722-4988-8474-ae26d55bfddc admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:53.934668 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a788bd-6722-4988-8474-ae26d55bfddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:53.936694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a788bd-6722-4988-8474-ae26d55bfddc admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:54.024030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1321/2657] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:42:53 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:42:54.028930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0280d02-3b39-4731-b3e4-34bf42ca3360 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:54.039357 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0280d02-3b39-4731-b3e4-34bf42ca3360 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:54.044824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6990a6a-1007-4877-b5ec-d2be7c935829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:54.045456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6990a6a-1007-4877-b5ec-d2be7c935829 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:54.046110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6990a6a-1007-4877-b5ec-d2be7c935829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:54.046110 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6990a6a-1007-4877-b5ec-d2be7c935829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:54.046707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6990a6a-1007-4877-b5ec-d2be7c935829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:54.048306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6990a6a-1007-4877-b5ec-d2be7c935829 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:54.059491 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1337/2658] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:42:54.063676 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a788bd-6722-4988-8474-ae26d55bfddc admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:54.073746 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a788bd-6722-4988-8474-ae26d55bfddc admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:54.078433 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1861eb2-448f-470b-bbb6-c93ea31aecf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:54.079116 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1861eb2-448f-470b-bbb6-c93ea31aecf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:54.079395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1861eb2-448f-470b-bbb6-c93ea31aecf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:54.079669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1861eb2-448f-470b-bbb6-c93ea31aecf3 admin admin] PATH_INFO: `/v3/projects/8226ac582b664f42a99421fe6742ca83/users/7968aab13bcd42d6a496e9ebc3bbc656/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:54.098331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1861eb2-448f-470b-bbb6-c93ea31aecf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8226ac582b664f42a99421fe6742ca83, user_id=7968aab13bcd42d6a496e9ebc3bbc656, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:54.098331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1861eb2-448f-470b-bbb6-c93ea31aecf3 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:54.183462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1322/2659] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:42:54 2022] PUT /identity/v3/projects/8226ac582b664f42a99421fe6742ca83/users/7968aab13bcd42d6a496e9ebc3bbc656/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:54.187535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6990a6a-1007-4877-b5ec-d2be7c935829 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:54.197622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6990a6a-1007-4877-b5ec-d2be7c935829 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:54.253879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f62b66-cfa1-4973-b4ce-44c088043a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:54.254513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62b66-cfa1-4973-b4ce-44c088043a99 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:54.254818 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62b66-cfa1-4973-b4ce-44c088043a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:54.255099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62b66-cfa1-4973-b4ce-44c088043a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:54.255821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f62b66-cfa1-4973-b4ce-44c088043a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:54.257460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f62b66-cfa1-4973-b4ce-44c088043a99 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:54.267417 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1338/2660] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:42:54.271699 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1861eb2-448f-470b-bbb6-c93ea31aecf3 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:54.283252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1861eb2-448f-470b-bbb6-c93ea31aecf3 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:54.287833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a9295-bdce-4a47-a09b-02fb9b2cd47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:54.288490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a9295-bdce-4a47-a09b-02fb9b2cd47a admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:54.288766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a9295-bdce-4a47-a09b-02fb9b2cd47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:54.289032 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a9295-bdce-4a47-a09b-02fb9b2cd47a admin admin] PATH_INFO: `/v3/projects/8226ac582b664f42a99421fe6742ca83/users/7968aab13bcd42d6a496e9ebc3bbc656/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:54.291634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a9295-bdce-4a47-a09b-02fb9b2cd47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8226ac582b664f42a99421fe6742ca83, user_id=7968aab13bcd42d6a496e9ebc3bbc656, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:54.294386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a9295-bdce-4a47-a09b-02fb9b2cd47a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:54.304456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1323/2661] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:42:54 2022] PUT /identity/v3/projects/8226ac582b664f42a99421fe6742ca83/users/7968aab13bcd42d6a496e9ebc3bbc656/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:54.316104 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d61fb-653c-4bcf-8868-6f521d1babd0 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:54.316399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d61fb-653c-4bcf-8868-6f521d1babd0 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:54.316682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d61fb-653c-4bcf-8868-6f521d1babd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:54.344736 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-604d61fb-653c-4bcf-8868-6f521d1babd0 None None] MFA Rules not processed for user `7968aab13bcd42d6a496e9ebc3bbc656`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:54.345952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-604d61fb-653c-4bcf-8868-6f521d1babd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:54.394304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:54.412955 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1339/2662] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:42:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:54.424880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a9295-bdce-4a47-a09b-02fb9b2cd47a admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:54.426677 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b28a9295-bdce-4a47-a09b-02fb9b2cd47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:54.484787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a9295-bdce-4a47-a09b-02fb9b2cd47a admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:54.488519 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9355b8d-0a20-4f9b-b733-34f12ffbfc49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:54.489133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9355b8d-0a20-4f9b-b733-34f12ffbfc49 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:54.489449 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9355b8d-0a20-4f9b-b733-34f12ffbfc49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:54.489725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9355b8d-0a20-4f9b-b733-34f12ffbfc49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:54.546213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9355b8d-0a20-4f9b-b733-34f12ffbfc49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:54.547698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9355b8d-0a20-4f9b-b733-34f12ffbfc49 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:54.556811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1324/2663] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:56.440487 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d61fb-653c-4bcf-8868-6f521d1babd0 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:56.441888 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-604d61fb-653c-4bcf-8868-6f521d1babd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:56.453782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d61fb-653c-4bcf-8868-6f521d1babd0 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:56.457348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15123b73-52cf-4526-be39-53f8a2586216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:56.457952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15123b73-52cf-4526-be39-53f8a2586216 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:56.458234 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15123b73-52cf-4526-be39-53f8a2586216 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:56.458535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15123b73-52cf-4526-be39-53f8a2586216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:56.468409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15123b73-52cf-4526-be39-53f8a2586216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:56.469500 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15123b73-52cf-4526-be39-53f8a2586216 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:56.479504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1340/2664] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:00.761817 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9355b8d-0a20-4f9b-b733-34f12ffbfc49 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:00.819319 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:00.824521 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9355b8d-0a20-4f9b-b733-34f12ffbfc49 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:00.829649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:00.830281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:00.830589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:00.830865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] PATH_INFO: `/v3/users/96237f6bc1e5414088b70e0316604172` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:00.832016 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96237f6bc1e5414088b70e0316604172)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:00.834001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:01.048561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96237f6bc1e5414088b70e0316604172'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.060655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96237f6bc1e5414088b70e0316604172'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.061373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96237f6bc1e5414088b70e0316604172'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.068354 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96237f6bc1e5414088b70e0316604172'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.132157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96237f6bc1e5414088b70e0316604172'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.138912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1325/2665] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:43:00 2022] DELETE /identity/v3/users/96237f6bc1e5414088b70e0316604172 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:01.143476 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7b14f-83ea-4ae9-aff5-ba60e424acfc None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:01.143997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7b14f-83ea-4ae9-aff5-ba60e424acfc None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:01.144103 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7b14f-83ea-4ae9-aff5-ba60e424acfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:01.162939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-87d7b14f-83ea-4ae9-aff5-ba60e424acfc None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:01.164136 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-87d7b14f-83ea-4ae9-aff5-ba60e424acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:01.222448 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1341/2666] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:01.232380 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:01.233795 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:01.291384 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f022d-a22a-4d3c-b926-122ab9051840 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:01.295154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afa250-acf6-4f43-bc0a-91ecf3e895c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:01.295814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa250-acf6-4f43-bc0a-91ecf3e895c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:01.296046 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa250-acf6-4f43-bc0a-91ecf3e895c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:01.296323 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa250-acf6-4f43-bc0a-91ecf3e895c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:01.305129 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afa250-acf6-4f43-bc0a-91ecf3e895c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:01.306590 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afa250-acf6-4f43-bc0a-91ecf3e895c7 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:01.316527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1326/2667] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:01.711081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7b14f-83ea-4ae9-aff5-ba60e424acfc None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:01.712601 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-87d7b14f-83ea-4ae9-aff5-ba60e424acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:01.725919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7b14f-83ea-4ae9-aff5-ba60e424acfc None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:01.730753 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:01.731445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:01.732399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:01.732878 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] PATH_INFO: `/v3/projects/bf28b590ed3a4b4abcab22ad365d4cce` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:01.733891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf28b590ed3a4b4abcab22ad365d4cce)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:01.736656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:01.835233 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf28b590ed3a4b4abcab22ad365d4cce', 'request_id': 'req-708fb878-3b09-4c33-bee0-5c3df5d43b8f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.908316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf28b590ed3a4b4abcab22ad365d4cce', 'request_id': 'req-708fb878-3b09-4c33-bee0-5c3df5d43b8f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.914265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf28b590ed3a4b4abcab22ad365d4cce', 'request_id': 'req-708fb878-3b09-4c33-bee0-5c3df5d43b8f'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.929863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] The token cache is being invalidate because project bf28b590ed3a4b4abcab22ad365d4cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:43:01.930351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.931353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.933737 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1342/2668] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:43:01 2022] DELETE /identity/v3/projects/bf28b590ed3a4b4abcab22ad365d4cce => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:01.938301 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afa250-acf6-4f43-bc0a-91ecf3e895c7 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:01.947944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afa250-acf6-4f43-bc0a-91ecf3e895c7 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:02.004532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d20c6-3972-4a7e-b058-bb0fdcb0c227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:02.005094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d20c6-3972-4a7e-b058-bb0fdcb0c227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:02.005377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d20c6-3972-4a7e-b058-bb0fdcb0c227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:02.005650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d20c6-3972-4a7e-b058-bb0fdcb0c227 admin admin] PATH_INFO: `/v3/users/7968aab13bcd42d6a496e9ebc3bbc656` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:02.006833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d20c6-3972-4a7e-b058-bb0fdcb0c227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7968aab13bcd42d6a496e9ebc3bbc656)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:02.008744 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d20c6-3972-4a7e-b058-bb0fdcb0c227 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:02.030024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:02.175058 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-062d20c6-3972-4a7e-b058-bb0fdcb0c227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7968aab13bcd42d6a496e9ebc3bbc656'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.187146 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-062d20c6-3972-4a7e-b058-bb0fdcb0c227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7968aab13bcd42d6a496e9ebc3bbc656'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.187826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-062d20c6-3972-4a7e-b058-bb0fdcb0c227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7968aab13bcd42d6a496e9ebc3bbc656'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.194761 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-062d20c6-3972-4a7e-b058-bb0fdcb0c227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7968aab13bcd42d6a496e9ebc3bbc656'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.251180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-062d20c6-3972-4a7e-b058-bb0fdcb0c227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7968aab13bcd42d6a496e9ebc3bbc656'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.257328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1327/2669] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:43:01 2022] DELETE /identity/v3/users/7968aab13bcd42d6a496e9ebc3bbc656 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:02.653457 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:02.654962 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:02.670723 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fb878-3b09-4c33-bee0-5c3df5d43b8f admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:02.727074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ae762-8fd7-487e-9978-58bd34a1bd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:02.727682 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ae762-8fd7-487e-9978-58bd34a1bd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:02.727935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ae762-8fd7-487e-9978-58bd34a1bd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:02.728213 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ae762-8fd7-487e-9978-58bd34a1bd6a admin admin] PATH_INFO: `/v3/projects/8226ac582b664f42a99421fe6742ca83` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:02.729387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ae762-8fd7-487e-9978-58bd34a1bd6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8226ac582b664f42a99421fe6742ca83)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:02.731344 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ae762-8fd7-487e-9978-58bd34a1bd6a admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:02.732828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:02.858442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-af9ae762-8fd7-487e-9978-58bd34a1bd6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8226ac582b664f42a99421fe6742ca83', 'request_id': 'req-af9ae762-8fd7-487e-9978-58bd34a1bd6a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.921079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-af9ae762-8fd7-487e-9978-58bd34a1bd6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8226ac582b664f42a99421fe6742ca83', 'request_id': 'req-af9ae762-8fd7-487e-9978-58bd34a1bd6a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.927183 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-af9ae762-8fd7-487e-9978-58bd34a1bd6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8226ac582b664f42a99421fe6742ca83', 'request_id': 'req-af9ae762-8fd7-487e-9978-58bd34a1bd6a'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.939248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-af9ae762-8fd7-487e-9978-58bd34a1bd6a admin admin] The token cache is being invalidate because project 8226ac582b664f42a99421fe6742ca83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:43:02.939526 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-af9ae762-8fd7-487e-9978-58bd34a1bd6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.940190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-af9ae762-8fd7-487e-9978-58bd34a1bd6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.941748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1343/2670] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:43:02 2022] DELETE /identity/v3/projects/8226ac582b664f42a99421fe6742ca83 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:02.947613 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b39225-5629-4b22-a749-1f6b37b740d5 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:02.948140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b39225-5629-4b22-a749-1f6b37b740d5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:02.948407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b39225-5629-4b22-a749-1f6b37b740d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:02.970175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-44b39225-5629-4b22-a749-1f6b37b740d5 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:02.971493 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-44b39225-5629-4b22-a749-1f6b37b740d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:03.031522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1328/2671] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:03.039544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749ecd-be13-4273-bfd5-b351c48174fb None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:03.039835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749ecd-be13-4273-bfd5-b351c48174fb None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:03.040114 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4749ecd-be13-4273-bfd5-b351c48174fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:03.061504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f4749ecd-be13-4273-bfd5-b351c48174fb None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:03.062738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f4749ecd-be13-4273-bfd5-b351c48174fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:03.070701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1344/2672] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:03.075081 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b39225-5629-4b22-a749-1f6b37b740d5 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:03.084931 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b39225-5629-4b22-a749-1f6b37b740d5 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:03.089541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f440ff9-4407-4121-811f-cb9c027d503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:03.090149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f440ff9-4407-4121-811f-cb9c027d503c admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:03.090438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f440ff9-4407-4121-811f-cb9c027d503c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:03.090752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f440ff9-4407-4121-811f-cb9c027d503c admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:03.091766 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f440ff9-4407-4121-811f-cb9c027d503c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:43:03.092077 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f440ff9-4407-4121-811f-cb9c027d503c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:03.093704 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f440ff9-4407-4121-811f-cb9c027d503c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:03.105325 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1329/2673] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:43:03.110148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749ecd-be13-4273-bfd5-b351c48174fb None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:03.119522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4749ecd-be13-4273-bfd5-b351c48174fb None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:03.124913 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c26a6-a205-4aed-87c5-a974df05bd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:03.125514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c26a6-a205-4aed-87c5-a974df05bd70 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:03.125800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c26a6-a205-4aed-87c5-a974df05bd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:03.126107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c26a6-a205-4aed-87c5-a974df05bd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:03.126816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c26a6-a205-4aed-87c5-a974df05bd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:03.128740 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c26a6-a205-4aed-87c5-a974df05bd70 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:03.224716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1345/2674] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:43:03 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:43:03.228957 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f440ff9-4407-4121-811f-cb9c027d503c admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:03.239734 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f440ff9-4407-4121-811f-cb9c027d503c admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:03.297526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cd86b-419e-4226-bbd9-b943220caa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:03.298067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cd86b-419e-4226-bbd9-b943220caa4c admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:03.298353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cd86b-419e-4226-bbd9-b943220caa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:03.298661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cd86b-419e-4226-bbd9-b943220caa4c admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:03.299317 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cd86b-419e-4226-bbd9-b943220caa4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:03.301244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cd86b-419e-4226-bbd9-b943220caa4c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:03.388767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1330/2675] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:43:03 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:43:03.392764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c26a6-a205-4aed-87c5-a974df05bd70 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:03.403869 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c26a6-a205-4aed-87c5-a974df05bd70 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:03.408915 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9220ea-9a87-4eb9-a33d-9ed90ad41627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:03.409510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9220ea-9a87-4eb9-a33d-9ed90ad41627 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:03.409796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9220ea-9a87-4eb9-a33d-9ed90ad41627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:03.410074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9220ea-9a87-4eb9-a33d-9ed90ad41627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:03.410876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9220ea-9a87-4eb9-a33d-9ed90ad41627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:03.412491 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9220ea-9a87-4eb9-a33d-9ed90ad41627 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:03.423379 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1346/2676] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:43:03.427331 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cd86b-419e-4226-bbd9-b943220caa4c admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:03.437507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cd86b-419e-4226-bbd9-b943220caa4c admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:03.442540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59961fb6-9ef4-404d-984c-fb073670b1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:03.443187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59961fb6-9ef4-404d-984c-fb073670b1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:03.443476 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59961fb6-9ef4-404d-984c-fb073670b1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:03.443757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59961fb6-9ef4-404d-984c-fb073670b1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:03.444499 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59961fb6-9ef4-404d-984c-fb073670b1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:03.446110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59961fb6-9ef4-404d-984c-fb073670b1c0 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:03.457348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1331/2677] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:43:03.461446 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9220ea-9a87-4eb9-a33d-9ed90ad41627 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:03.472094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9220ea-9a87-4eb9-a33d-9ed90ad41627 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:03.476720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067f7e3-2cd0-4edd-bb72-7ca14da247c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:03.477403 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067f7e3-2cd0-4edd-bb72-7ca14da247c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:03.477690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067f7e3-2cd0-4edd-bb72-7ca14da247c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:03.477974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067f7e3-2cd0-4edd-bb72-7ca14da247c8 admin admin] PATH_INFO: `/v3/projects/b4d0aaccdf224724be31317fac3d5dac/users/0ef305c7ed644a6ebdd330d2ddc03201/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:03.493059 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067f7e3-2cd0-4edd-bb72-7ca14da247c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d0aaccdf224724be31317fac3d5dac, user_id=0ef305c7ed644a6ebdd330d2ddc03201, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:03.495854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067f7e3-2cd0-4edd-bb72-7ca14da247c8 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:03.561043 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1347/2678] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:43:03 2022] PUT /identity/v3/projects/b4d0aaccdf224724be31317fac3d5dac/users/0ef305c7ed644a6ebdd330d2ddc03201/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:03.572507 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e08bef-13e7-44bb-8fe6-1041c6332e5d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:03.572801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e08bef-13e7-44bb-8fe6-1041c6332e5d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:03.573106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e08bef-13e7-44bb-8fe6-1041c6332e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:03.581225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:03.601951 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-54e08bef-13e7-44bb-8fe6-1041c6332e5d None None] MFA Rules not processed for user `0ef305c7ed644a6ebdd330d2ddc03201`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:03.604788 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-54e08bef-13e7-44bb-8fe6-1041c6332e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:03.667003 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1332/2679] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:03.678548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067f7e3-2cd0-4edd-bb72-7ca14da247c8 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:03.680313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8067f7e3-2cd0-4edd-bb72-7ca14da247c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:03.737282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067f7e3-2cd0-4edd-bb72-7ca14da247c8 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:03.741125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfa295-11b3-4a58-b443-ead6c3bf59a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:03.741742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfa295-11b3-4a58-b443-ead6c3bf59a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:03.742026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfa295-11b3-4a58-b443-ead6c3bf59a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:03.742335 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfa295-11b3-4a58-b443-ead6c3bf59a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:03.751437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfa295-11b3-4a58-b443-ead6c3bf59a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:03.752887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfa295-11b3-4a58-b443-ead6c3bf59a8 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:03.761742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1348/2680] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:03.782854 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e08bef-13e7-44bb-8fe6-1041c6332e5d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:03.844259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e08bef-13e7-44bb-8fe6-1041c6332e5d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:03.848933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:03.849563 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:03.849847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:03.850124 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] PATH_INFO: `/v3/users/0ef305c7ed644a6ebdd330d2ddc03201` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:03.851318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef305c7ed644a6ebdd330d2ddc03201)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:03.853290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:04.037355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef305c7ed644a6ebdd330d2ddc03201'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:04.052096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef305c7ed644a6ebdd330d2ddc03201'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:04.052814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef305c7ed644a6ebdd330d2ddc03201'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:04.059535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef305c7ed644a6ebdd330d2ddc03201'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:04.149479 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef305c7ed644a6ebdd330d2ddc03201'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:04.156527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1333/2681] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:43:03 2022] DELETE /identity/v3/users/0ef305c7ed644a6ebdd330d2ddc03201 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:04.161133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11671b5-2415-4253-98a3-aaf2c69fb090 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:04.161423 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11671b5-2415-4253-98a3-aaf2c69fb090 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:04.165961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11671b5-2415-4253-98a3-aaf2c69fb090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:04.181681 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-c11671b5-2415-4253-98a3-aaf2c69fb090 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:04.182934 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c11671b5-2415-4253-98a3-aaf2c69fb090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:04.206293 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:04.240456 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1349/2682] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:04.250652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:04.252201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:04.265985 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:04.310355 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e0fbd-e591-40cb-9fd0-3792c18def3b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:04.314397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcdf10-1159-4d89-a1ac-cfdc14564bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:04.315065 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcdf10-1159-4d89-a1ac-cfdc14564bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:04.315353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcdf10-1159-4d89-a1ac-cfdc14564bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:04.315631 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcdf10-1159-4d89-a1ac-cfdc14564bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:04.324671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbcdf10-1159-4d89-a1ac-cfdc14564bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:04.326618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbcdf10-1159-4d89-a1ac-cfdc14564bc6 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:04.336145 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1334/2683] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:04.722805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11671b5-2415-4253-98a3-aaf2c69fb090 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:04.724309 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-c11671b5-2415-4253-98a3-aaf2c69fb090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:04.736538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11671b5-2415-4253-98a3-aaf2c69fb090 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:04.741389 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485d361-229e-4e3c-97ff-036222fd6f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:04.742034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485d361-229e-4e3c-97ff-036222fd6f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:04.742322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485d361-229e-4e3c-97ff-036222fd6f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:04.742638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485d361-229e-4e3c-97ff-036222fd6f3b admin admin] PATH_INFO: `/v3/projects/b4d0aaccdf224724be31317fac3d5dac` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:04.743814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485d361-229e-4e3c-97ff-036222fd6f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4d0aaccdf224724be31317fac3d5dac)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:04.745748 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485d361-229e-4e3c-97ff-036222fd6f3b admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:04.881416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b485d361-229e-4e3c-97ff-036222fd6f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d0aaccdf224724be31317fac3d5dac', 'request_id': 'req-b485d361-229e-4e3c-97ff-036222fd6f3b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:04.960694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b485d361-229e-4e3c-97ff-036222fd6f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d0aaccdf224724be31317fac3d5dac', 'request_id': 'req-b485d361-229e-4e3c-97ff-036222fd6f3b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:04.972452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b485d361-229e-4e3c-97ff-036222fd6f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d0aaccdf224724be31317fac3d5dac', 'request_id': 'req-b485d361-229e-4e3c-97ff-036222fd6f3b'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:04.977920 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b485d361-229e-4e3c-97ff-036222fd6f3b admin admin] The token cache is being invalidate because project b4d0aaccdf224724be31317fac3d5dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:43:04.978201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b485d361-229e-4e3c-97ff-036222fd6f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:04.978841 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-b485d361-229e-4e3c-97ff-036222fd6f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:04.980339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1350/2684] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:43:04 2022] DELETE /identity/v3/projects/b4d0aaccdf224724be31317fac3d5dac => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:04.985500 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a66e0c-e57f-4433-9dd7-49dccfbbee8d None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:04.985791 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a66e0c-e57f-4433-9dd7-49dccfbbee8d None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:04.986072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a66e0c-e57f-4433-9dd7-49dccfbbee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:05.006013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b8a66e0c-e57f-4433-9dd7-49dccfbbee8d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:05.007245 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b8a66e0c-e57f-4433-9dd7-49dccfbbee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:05.068456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1335/2685] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:05.076953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b941a-91e5-48c6-8a2c-acbe60952bfe None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:05.077248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b941a-91e5-48c6-8a2c-acbe60952bfe None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:05.077531 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b941a-91e5-48c6-8a2c-acbe60952bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:05.097265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-ef8b941a-91e5-48c6-8a2c-acbe60952bfe None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:05.098704 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-ef8b941a-91e5-48c6-8a2c-acbe60952bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:05.106867 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1351/2686] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:05.111213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a66e0c-e57f-4433-9dd7-49dccfbbee8d None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:05.120838 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a66e0c-e57f-4433-9dd7-49dccfbbee8d None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:05.126166 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef387a78-94de-4d9b-9888-2931b7325749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:05.126816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387a78-94de-4d9b-9888-2931b7325749 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:05.127095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387a78-94de-4d9b-9888-2931b7325749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:05.127368 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef387a78-94de-4d9b-9888-2931b7325749 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:05.128050 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef387a78-94de-4d9b-9888-2931b7325749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:43:05.128354 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef387a78-94de-4d9b-9888-2931b7325749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:05.129947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef387a78-94de-4d9b-9888-2931b7325749 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:05.142400 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1336/2687] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:43:05.146615 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b941a-91e5-48c6-8a2c-acbe60952bfe None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:05.156516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b941a-91e5-48c6-8a2c-acbe60952bfe None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:05.161409 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ba235-0045-436d-a1dd-3378fe9cacfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:05.165024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ba235-0045-436d-a1dd-3378fe9cacfc admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:05.165024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ba235-0045-436d-a1dd-3378fe9cacfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:05.165024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ba235-0045-436d-a1dd-3378fe9cacfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:05.165024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ba235-0045-436d-a1dd-3378fe9cacfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:05.165372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ba235-0045-436d-a1dd-3378fe9cacfc admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:05.259048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1352/2688] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:43:05 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:43:05.263383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef387a78-94de-4d9b-9888-2931b7325749 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:05.273905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef387a78-94de-4d9b-9888-2931b7325749 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:05.331755 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f17623-ee7e-4d88-a04e-350cdc183ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:05.332401 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f17623-ee7e-4d88-a04e-350cdc183ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:05.332687 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f17623-ee7e-4d88-a04e-350cdc183ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:05.332967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f17623-ee7e-4d88-a04e-350cdc183ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:05.333635 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f17623-ee7e-4d88-a04e-350cdc183ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:05.335628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f17623-ee7e-4d88-a04e-350cdc183ca9 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:05.407039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1337/2689] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:43:05 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:43:05.411440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ba235-0045-436d-a1dd-3378fe9cacfc admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:05.422425 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ba235-0045-436d-a1dd-3378fe9cacfc admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:05.427085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5122758-8fae-4d2e-a000-767dcc2e5367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:05.427687 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5122758-8fae-4d2e-a000-767dcc2e5367 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:05.427972 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5122758-8fae-4d2e-a000-767dcc2e5367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:05.428250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5122758-8fae-4d2e-a000-767dcc2e5367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:05.428964 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5122758-8fae-4d2e-a000-767dcc2e5367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:05.430907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5122758-8fae-4d2e-a000-767dcc2e5367 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:05.444450 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1353/2690] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:43:05.446337 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f17623-ee7e-4d88-a04e-350cdc183ca9 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:05.457097 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f17623-ee7e-4d88-a04e-350cdc183ca9 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:05.461772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1289f-4111-4508-bedd-7088cf5fdd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:05.462366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1289f-4111-4508-bedd-7088cf5fdd1f admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:05.462706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1289f-4111-4508-bedd-7088cf5fdd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:05.462983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1289f-4111-4508-bedd-7088cf5fdd1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:05.463671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1289f-4111-4508-bedd-7088cf5fdd1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:05.465259 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1289f-4111-4508-bedd-7088cf5fdd1f admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:05.475772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1338/2691] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:43:05.479758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5122758-8fae-4d2e-a000-767dcc2e5367 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:05.490641 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5122758-8fae-4d2e-a000-767dcc2e5367 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:05.495255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6526-2af5-4819-a8c0-9825854e2cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:05.495897 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6526-2af5-4819-a8c0-9825854e2cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:05.496178 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6526-2af5-4819-a8c0-9825854e2cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:05.496453 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6526-2af5-4819-a8c0-9825854e2cb0 admin admin] PATH_INFO: `/v3/projects/fdf918dc6c33420392a9b30c535482ef/users/4b30415497e74311a17aececa80a2049/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:05.511627 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6526-2af5-4819-a8c0-9825854e2cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf918dc6c33420392a9b30c535482ef, user_id=4b30415497e74311a17aececa80a2049, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:05.514660 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6526-2af5-4819-a8c0-9825854e2cb0 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:05.583760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1354/2692] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:43:05 2022] PUT /identity/v3/projects/fdf918dc6c33420392a9b30c535482ef/users/4b30415497e74311a17aececa80a2049/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:05.594116 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731f05-d833-41f4-a53c-baffaab33c2b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:05.594436 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731f05-d833-41f4-a53c-baffaab33c2b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:05.594751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731f05-d833-41f4-a53c-baffaab33c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:05.623487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-11731f05-d833-41f4-a53c-baffaab33c2b None None] MFA Rules not processed for user `4b30415497e74311a17aececa80a2049`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:05.624713 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-11731f05-d833-41f4-a53c-baffaab33c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:05.632798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:05.691345 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1339/2693] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:05.702946 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6526-2af5-4819-a8c0-9825854e2cb0 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:05.704651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1b6c6526-2af5-4819-a8c0-9825854e2cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:05.760142 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:05.764648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6526-2af5-4819-a8c0-9825854e2cb0 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:05.768391 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88427a29-3867-4a4d-a4af-4b5148570c97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:05.769010 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88427a29-3867-4a4d-a4af-4b5148570c97 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:05.769300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88427a29-3867-4a4d-a4af-4b5148570c97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:05.769578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88427a29-3867-4a4d-a4af-4b5148570c97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:05.779387 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88427a29-3867-4a4d-a4af-4b5148570c97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:05.780874 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88427a29-3867-4a4d-a4af-4b5148570c97 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:05.790453 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1355/2694] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:15.688473 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=23 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:15.857973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=4 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:20.514434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731f05-d833-41f4-a53c-baffaab33c2b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:20.586875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731f05-d833-41f4-a53c-baffaab33c2b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:20.593187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:20.594049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:20.594689 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:20.594944 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] PATH_INFO: `/v3/users/4b30415497e74311a17aececa80a2049` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:20.596249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b30415497e74311a17aececa80a2049)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:20.598372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:20.772441 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b30415497e74311a17aececa80a2049'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:20.791407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b30415497e74311a17aececa80a2049'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:20.792133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b30415497e74311a17aececa80a2049'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:20.800989 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b30415497e74311a17aececa80a2049'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:20.875513 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b30415497e74311a17aececa80a2049'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:20.882306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1340/2695] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:43:20 2022] DELETE /identity/v3/users/4b30415497e74311a17aececa80a2049 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:20.886855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed24d90-8b9a-4232-a6b0-0e789b70ab01 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:20.887351 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed24d90-8b9a-4232-a6b0-0e789b70ab01 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:20.887513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed24d90-8b9a-4232-a6b0-0e789b70ab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:20.908988 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-7ed24d90-8b9a-4232-a6b0-0e789b70ab01 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:20.910199 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-7ed24d90-8b9a-4232-a6b0-0e789b70ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:20.973230 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1356/2696] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:20.983730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:20.985447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:21.061168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08545e-8ef1-4d80-9cf9-62139589af7b admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:21.065762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44276a27-8fb7-42e2-be6c-66afad862cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:21.066475 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44276a27-8fb7-42e2-be6c-66afad862cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:21.066799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44276a27-8fb7-42e2-be6c-66afad862cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:21.067083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44276a27-8fb7-42e2-be6c-66afad862cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:21.078623 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44276a27-8fb7-42e2-be6c-66afad862cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:21.080096 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44276a27-8fb7-42e2-be6c-66afad862cd5 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:21.090531 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1341/2697] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:21.533916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed24d90-8b9a-4232-a6b0-0e789b70ab01 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:21.535365 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-7ed24d90-8b9a-4232-a6b0-0e789b70ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:21.551073 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed24d90-8b9a-4232-a6b0-0e789b70ab01 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:21.553433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dde67-11e7-47ec-a4d2-88ca1264f626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:21.554081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dde67-11e7-47ec-a4d2-88ca1264f626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:21.554628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dde67-11e7-47ec-a4d2-88ca1264f626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:21.555099 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dde67-11e7-47ec-a4d2-88ca1264f626 admin admin] PATH_INFO: `/v3/projects/fdf918dc6c33420392a9b30c535482ef` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:21.556304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dde67-11e7-47ec-a4d2-88ca1264f626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf918dc6c33420392a9b30c535482ef)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:21.558228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dde67-11e7-47ec-a4d2-88ca1264f626 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:21.717170 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-610dde67-11e7-47ec-a4d2-88ca1264f626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf918dc6c33420392a9b30c535482ef', 'request_id': 'req-610dde67-11e7-47ec-a4d2-88ca1264f626'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:21.806802 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-610dde67-11e7-47ec-a4d2-88ca1264f626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf918dc6c33420392a9b30c535482ef', 'request_id': 'req-610dde67-11e7-47ec-a4d2-88ca1264f626'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:21.807800 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d08b75-44ee-44fe-b2aa-31f114e65091 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:21.808261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d08b75-44ee-44fe-b2aa-31f114e65091 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:21.808440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d08b75-44ee-44fe-b2aa-31f114e65091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:21.814953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-610dde67-11e7-47ec-a4d2-88ca1264f626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf918dc6c33420392a9b30c535482ef', 'request_id': 'req-610dde67-11e7-47ec-a4d2-88ca1264f626'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:21.828875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-610dde67-11e7-47ec-a4d2-88ca1264f626 admin admin] The token cache is being invalidate because project fdf918dc6c33420392a9b30c535482ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:43:21.829172 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-610dde67-11e7-47ec-a4d2-88ca1264f626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:21.829822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-610dde67-11e7-47ec-a4d2-88ca1264f626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:21.830767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-89d08b75-44ee-44fe-b2aa-31f114e65091 None None] MFA Rules not processed for user `fb334753d1f34e41a450961dfb5f2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:21.831699 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1357/2698] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:43:21 2022] DELETE /identity/v3/projects/fdf918dc6c33420392a9b30c535482ef => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:21.831990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-89d08b75-44ee-44fe-b2aa-31f114e65091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:21.836185 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fc673-7b4f-41cd-b1f8-d93218577ec4 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:21.836479 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fc673-7b4f-41cd-b1f8-d93218577ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:21.836756 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fc673-7b4f-41cd-b1f8-d93218577ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:21.853172 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:21.856892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-fe1fc673-7b4f-41cd-b1f8-d93218577ec4 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:21.858109 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-fe1fc673-7b4f-41cd-b1f8-d93218577ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:21.897110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1342/2699] 10.222.0.60 () {58 vars in 967 bytes} [Thu Aug 4 02:43:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:43:21.925568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1358/2700] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:21.928797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d08b75-44ee-44fe-b2aa-31f114e65091 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:21.930607 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-89d08b75-44ee-44fe-b2aa-31f114e65091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:21.933965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce067b0-d8a5-4855-973b-4072db0176a0 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:21.934264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce067b0-d8a5-4855-973b-4072db0176a0 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:21.934566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce067b0-d8a5-4855-973b-4072db0176a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:21.954870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-4ce067b0-d8a5-4855-973b-4072db0176a0 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:21.956079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4ce067b0-d8a5-4855-973b-4072db0176a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:21.966952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1359/2701] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:21.969122 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce067b0-d8a5-4855-973b-4072db0176a0 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:21.980140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce067b0-d8a5-4855-973b-4072db0176a0 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:21.985906 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d88279-bee4-4d6c-af88-17ac790d6a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:21.986555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d88279-bee4-4d6c-af88-17ac790d6a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:21.986844 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d88279-bee4-4d6c-af88-17ac790d6a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:21.987124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d88279-bee4-4d6c-af88-17ac790d6a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:21.987822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d88279-bee4-4d6c-af88-17ac790d6a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:43:21.988130 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d88279-bee4-4d6c-af88-17ac790d6a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:21.989767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d88279-bee4-4d6c-af88-17ac790d6a36 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:22.003276 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1360/2702] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:43:22.007129 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d88279-bee4-4d6c-af88-17ac790d6a36 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:22.015815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:22.019541 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d88279-bee4-4d6c-af88-17ac790d6a36 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:22.020711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d08b75-44ee-44fe-b2aa-31f114e65091 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:22.024400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1439ce-a20d-4c37-9226-05f7dab919b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:22.025013 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1439ce-a20d-4c37-9226-05f7dab919b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:22.025298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1439ce-a20d-4c37-9226-05f7dab919b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:22.025609 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1439ce-a20d-4c37-9226-05f7dab919b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:22.026030 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cc22d-07ab-4316-b2db-67e7045523f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6414c895c6d642a2affb36013b71df34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:22.026275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1439ce-a20d-4c37-9226-05f7dab919b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:22.026726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cc22d-07ab-4316-b2db-67e7045523f6 service swift] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:22.027102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cc22d-07ab-4316-b2db-67e7045523f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:22.027386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cc22d-07ab-4316-b2db-67e7045523f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:22.028520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1439ce-a20d-4c37-9226-05f7dab919b9 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:22.037738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356cc22d-07ab-4316-b2db-67e7045523f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:22.039901 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356cc22d-07ab-4316-b2db-67e7045523f6 service swift] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:22.052583 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1343/2703] 10.222.0.60 () {60 vars in 1384 bytes} [Thu Aug 4 02:43:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:43:22.133853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1361/2704] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:43:22 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:43:22.137783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cc22d-07ab-4316-b2db-67e7045523f6 service swift] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:22.150249 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cc22d-07ab-4316-b2db-67e7045523f6 service swift] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:22.229559 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e80dc-e6db-4ded-ab17-3ecfb8e2c4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:22.230154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e80dc-e6db-4ded-ab17-3ecfb8e2c4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:22.230440 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e80dc-e6db-4ded-ab17-3ecfb8e2c4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:22.230750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e80dc-e6db-4ded-ab17-3ecfb8e2c4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:22.231417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e80dc-e6db-4ded-ab17-3ecfb8e2c4d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:22.233834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e80dc-e6db-4ded-ab17-3ecfb8e2c4d2 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:22.338548 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1344/2705] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:43:22 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:43:22.342694 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1439ce-a20d-4c37-9226-05f7dab919b9 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:22.352720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1439ce-a20d-4c37-9226-05f7dab919b9 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:22.357221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ebc7e-f81f-447f-81f1-4a09cc5ba099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:22.357824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ebc7e-f81f-447f-81f1-4a09cc5ba099 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:22.358107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ebc7e-f81f-447f-81f1-4a09cc5ba099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:22.358392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ebc7e-f81f-447f-81f1-4a09cc5ba099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:22.359133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ebc7e-f81f-447f-81f1-4a09cc5ba099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:22.360720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ebc7e-f81f-447f-81f1-4a09cc5ba099 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:22.372062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1362/2706] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:43:22.376434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e80dc-e6db-4ded-ab17-3ecfb8e2c4d2 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:22.386950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e80dc-e6db-4ded-ab17-3ecfb8e2c4d2 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:22.392551 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1905fa-2b35-4e2a-ac63-13a9c0ec7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:22.393232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1905fa-2b35-4e2a-ac63-13a9c0ec7606 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:22.393543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1905fa-2b35-4e2a-ac63-13a9c0ec7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:22.393816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1905fa-2b35-4e2a-ac63-13a9c0ec7606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:22.394538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1905fa-2b35-4e2a-ac63-13a9c0ec7606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:22.396132 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1905fa-2b35-4e2a-ac63-13a9c0ec7606 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:22.406759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1345/2707] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:43:22.411083 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ebc7e-f81f-447f-81f1-4a09cc5ba099 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:22.421133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ebc7e-f81f-447f-81f1-4a09cc5ba099 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:22.425664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3dece-874d-4031-9622-ba1a0642f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:22.426318 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3dece-874d-4031-9622-ba1a0642f755 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:22.426644 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3dece-874d-4031-9622-ba1a0642f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:22.426923 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3dece-874d-4031-9622-ba1a0642f755 admin admin] PATH_INFO: `/v3/projects/fd30c95fb0cd4de385e9f53834a2895b/users/077b2a9e9ea34806b7bfac4b30c5e17b/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:22.442014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3dece-874d-4031-9622-ba1a0642f755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd30c95fb0cd4de385e9f53834a2895b, user_id=077b2a9e9ea34806b7bfac4b30c5e17b, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:22.444633 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3dece-874d-4031-9622-ba1a0642f755 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:22.520786 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1363/2708] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:43:22 2022] PUT /identity/v3/projects/fd30c95fb0cd4de385e9f53834a2895b/users/077b2a9e9ea34806b7bfac4b30c5e17b/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:22.534152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2171e-be06-4f02-9f63-69acdb5cee47 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:22.534445 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2171e-be06-4f02-9f63-69acdb5cee47 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:22.534770 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2171e-be06-4f02-9f63-69acdb5cee47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:22.564255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-7cc2171e-be06-4f02-9f63-69acdb5cee47 None None] MFA Rules not processed for user `077b2a9e9ea34806b7bfac4b30c5e17b`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:22.565589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7cc2171e-be06-4f02-9f63-69acdb5cee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:22.594956 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:22.635921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1346/2709] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:22.647413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3dece-874d-4031-9622-ba1a0642f755 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:22.649236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d9e3dece-874d-4031-9622-ba1a0642f755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:22.708233 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3dece-874d-4031-9622-ba1a0642f755 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:22.712082 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af63381-5150-427a-b203-da8472304cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:22.712735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af63381-5150-427a-b203-da8472304cef service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:22.713018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af63381-5150-427a-b203-da8472304cef service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:22.713296 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af63381-5150-427a-b203-da8472304cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:22.722410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af63381-5150-427a-b203-da8472304cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:22.723905 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af63381-5150-427a-b203-da8472304cef service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:22.733568 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1364/2710] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:25.024867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2171e-be06-4f02-9f63-69acdb5cee47 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:25.026432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-7cc2171e-be06-4f02-9f63-69acdb5cee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:25.116605 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2171e-be06-4f02-9f63-69acdb5cee47 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:25.120990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6af9-2676-4922-906f-5c8353cee3b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:25.121773 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6af9-2676-4922-906f-5c8353cee3b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:25.122127 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6af9-2676-4922-906f-5c8353cee3b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:25.122529 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6af9-2676-4922-906f-5c8353cee3b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:25.124796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-330c6af9-2676-4922-906f-5c8353cee3b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:25.202777 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c6af9-2676-4922-906f-5c8353cee3b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:25.204250 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c6af9-2676-4922-906f-5c8353cee3b4 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:25.215960 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1347/2711] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:27.572020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af63381-5150-427a-b203-da8472304cef service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:27.572020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9af63381-5150-427a-b203-da8472304cef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:27.688038 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af63381-5150-427a-b203-da8472304cef service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:27.693326 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877e614-1326-44a3-b1e2-2a2d67e354e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '423ac00601f84e3d9c6cc6ee20eee6ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:27.694094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877e614-1326-44a3-b1e2-2a2d67e354e7 service placement] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:27.694382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877e614-1326-44a3-b1e2-2a2d67e354e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:27.694709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877e614-1326-44a3-b1e2-2a2d67e354e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:27.696698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6877e614-1326-44a3-b1e2-2a2d67e354e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:27.712742 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877e614-1326-44a3-b1e2-2a2d67e354e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:27.714530 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877e614-1326-44a3-b1e2-2a2d67e354e7 service placement] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:27.738238 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1365/2712] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:30.312988 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6af9-2676-4922-906f-5c8353cee3b4 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:30.314609 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-330c6af9-2676-4922-906f-5c8353cee3b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:30.327692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6af9-2676-4922-906f-5c8353cee3b4 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:30.332527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a661f4-a0d9-4522-93d3-f5d59978baa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:30.335039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a661f4-a0d9-4522-93d3-f5d59978baa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:30.335039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a661f4-a0d9-4522-93d3-f5d59978baa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:30.335039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a661f4-a0d9-4522-93d3-f5d59978baa8 admin admin] PATH_INFO: `/v3/users/64be537a50754c838554d1a2e0a4177a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:30.335039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a661f4-a0d9-4522-93d3-f5d59978baa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64be537a50754c838554d1a2e0a4177a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:30.336873 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a661f4-a0d9-4522-93d3-f5d59978baa8 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:30.477616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d2a661f4-a0d9-4522-93d3-f5d59978baa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64be537a50754c838554d1a2e0a4177a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:30.490455 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d2a661f4-a0d9-4522-93d3-f5d59978baa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64be537a50754c838554d1a2e0a4177a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:30.491352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d2a661f4-a0d9-4522-93d3-f5d59978baa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64be537a50754c838554d1a2e0a4177a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:30.496256 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:30.500187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d2a661f4-a0d9-4522-93d3-f5d59978baa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64be537a50754c838554d1a2e0a4177a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:30.562342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d2a661f4-a0d9-4522-93d3-f5d59978baa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64be537a50754c838554d1a2e0a4177a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:30.574947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1348/2713] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:43:30 2022] DELETE /identity/v3/users/64be537a50754c838554d1a2e0a4177a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:30.816201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877e614-1326-44a3-b1e2-2a2d67e354e7 service placement] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:30.828849 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877e614-1326-44a3-b1e2-2a2d67e354e7 service placement] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:30.877306 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:30.897001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76908b2b-d3fc-4706-96df-b466b27fc066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:30.899001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76908b2b-d3fc-4706-96df-b466b27fc066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:30.899001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76908b2b-d3fc-4706-96df-b466b27fc066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:30.899001 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76908b2b-d3fc-4706-96df-b466b27fc066 admin admin] PATH_INFO: `/v3/projects/16c45c4b6ccc40e3bdf304d9141d56ca` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:30.899405 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76908b2b-d3fc-4706-96df-b466b27fc066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c45c4b6ccc40e3bdf304d9141d56ca)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:30.901414 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76908b2b-d3fc-4706-96df-b466b27fc066 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:31.038990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-76908b2b-d3fc-4706-96df-b466b27fc066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c45c4b6ccc40e3bdf304d9141d56ca', 'request_id': 'req-76908b2b-d3fc-4706-96df-b466b27fc066'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:31.110589 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-76908b2b-d3fc-4706-96df-b466b27fc066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c45c4b6ccc40e3bdf304d9141d56ca', 'request_id': 'req-76908b2b-d3fc-4706-96df-b466b27fc066'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:31.117880 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-76908b2b-d3fc-4706-96df-b466b27fc066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c45c4b6ccc40e3bdf304d9141d56ca', 'request_id': 'req-76908b2b-d3fc-4706-96df-b466b27fc066'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:31.133096 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-76908b2b-d3fc-4706-96df-b466b27fc066 admin admin] The token cache is being invalidate because project 16c45c4b6ccc40e3bdf304d9141d56ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:43:31.135997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-76908b2b-d3fc-4706-96df-b466b27fc066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:31.135997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-76908b2b-d3fc-4706-96df-b466b27fc066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:31.142787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1366/2714] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:43:30 2022] DELETE /identity/v3/projects/16c45c4b6ccc40e3bdf304d9141d56ca => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:31.145152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91913e-9f02-4c24-9a7b-3f01d4a6a2e7 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:31.145442 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91913e-9f02-4c24-9a7b-3f01d4a6a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:31.145721 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91913e-9f02-4c24-9a7b-3f01d4a6a2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:31.167663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2b91913e-9f02-4c24-9a7b-3f01d4a6a2e7 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:31.169106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2b91913e-9f02-4c24-9a7b-3f01d4a6a2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:31.234660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1349/2715] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:43:31.243688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903f92a-97f8-4af5-8484-26d9e7c20158 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:31.243981 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903f92a-97f8-4af5-8484-26d9e7c20158 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:31.244265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903f92a-97f8-4af5-8484-26d9e7c20158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:31.265265 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-0903f92a-97f8-4af5-8484-26d9e7c20158 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:31.266413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0903f92a-97f8-4af5-8484-26d9e7c20158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:31.274716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1367/2716] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:31.279289 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91913e-9f02-4c24-9a7b-3f01d4a6a2e7 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:31.289101 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91913e-9f02-4c24-9a7b-3f01d4a6a2e7 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:31.293993 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e02791-04a6-4362-944f-103ed90dfc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:31.294465 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02791-04a6-4362-944f-103ed90dfc47 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:31.294633 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02791-04a6-4362-944f-103ed90dfc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:31.294866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02791-04a6-4362-944f-103ed90dfc47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:31.295589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e02791-04a6-4362-944f-103ed90dfc47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:43:31.295896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e02791-04a6-4362-944f-103ed90dfc47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:31.297500 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e02791-04a6-4362-944f-103ed90dfc47 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:31.310225 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1350/2717] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:43:31.314750 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903f92a-97f8-4af5-8484-26d9e7c20158 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:31.325137 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903f92a-97f8-4af5-8484-26d9e7c20158 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:31.330605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c7a4b-bcf0-4e69-85a3-a61864a06dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:31.331457 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c7a4b-bcf0-4e69-85a3-a61864a06dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:31.331744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c7a4b-bcf0-4e69-85a3-a61864a06dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:31.332026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c7a4b-bcf0-4e69-85a3-a61864a06dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:31.332751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c7a4b-bcf0-4e69-85a3-a61864a06dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:31.334816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c7a4b-bcf0-4e69-85a3-a61864a06dd5 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:31.453472 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1368/2718] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:43:31 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:43:31.455491 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e02791-04a6-4362-944f-103ed90dfc47 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:31.472389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e02791-04a6-4362-944f-103ed90dfc47 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:31.574946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ce09-7c0e-4d11-b708-8adf59333c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:31.576850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ce09-7c0e-4d11-b708-8adf59333c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:31.577149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ce09-7c0e-4d11-b708-8adf59333c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:31.577434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ce09-7c0e-4d11-b708-8adf59333c15 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:31.579411 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9ce09-7c0e-4d11-b708-8adf59333c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:31.585727 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9ce09-7c0e-4d11-b708-8adf59333c15 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:31.687219 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1351/2719] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:43:31 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:43:31.690866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c7a4b-bcf0-4e69-85a3-a61864a06dd5 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:31.704348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c7a4b-bcf0-4e69-85a3-a61864a06dd5 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:31.711447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa76481-701c-4e51-84db-4682052815f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:31.712303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa76481-701c-4e51-84db-4682052815f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:31.712891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa76481-701c-4e51-84db-4682052815f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:31.712891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa76481-701c-4e51-84db-4682052815f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:31.713749 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa76481-701c-4e51-84db-4682052815f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:31.715275 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa76481-701c-4e51-84db-4682052815f0 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:31.730093 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1369/2720] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:43:31.734768 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ce09-7c0e-4d11-b708-8adf59333c15 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:31.756154 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ce09-7c0e-4d11-b708-8adf59333c15 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:31.761684 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d698ea3-3dc7-4a4c-9e92-9908515f999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:31.763328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d698ea3-3dc7-4a4c-9e92-9908515f999f admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:31.763795 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d698ea3-3dc7-4a4c-9e92-9908515f999f admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:31.764263 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d698ea3-3dc7-4a4c-9e92-9908515f999f admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:31.765437 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d698ea3-3dc7-4a4c-9e92-9908515f999f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:31.767707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d698ea3-3dc7-4a4c-9e92-9908515f999f admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:31.783119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1352/2721] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:43:31.787602 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa76481-701c-4e51-84db-4682052815f0 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:31.800251 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa76481-701c-4e51-84db-4682052815f0 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:31.805663 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a1142-f071-4eb7-bc86-442c152c1ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:31.806661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a1142-f071-4eb7-bc86-442c152c1ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:31.807077 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a1142-f071-4eb7-bc86-442c152c1ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:31.807366 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a1142-f071-4eb7-bc86-442c152c1ba0 admin admin] PATH_INFO: `/v3/projects/64ca976f81ab4112b9fe4f24760862b9/users/3a20282bb5cf4561b60cab04acd0cab4/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:31.828180 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a1142-f071-4eb7-bc86-442c152c1ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ca976f81ab4112b9fe4f24760862b9, user_id=3a20282bb5cf4561b60cab04acd0cab4, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:31.832726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a1142-f071-4eb7-bc86-442c152c1ba0 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:31.951250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1370/2722] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:43:31 2022] PUT /identity/v3/projects/64ca976f81ab4112b9fe4f24760862b9/users/3a20282bb5cf4561b60cab04acd0cab4/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:43:31.956381 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4d11a-171f-499d-8c60-d4bf71234e72 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:31.956671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4d11a-171f-499d-8c60-d4bf71234e72 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:31.956947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4d11a-171f-499d-8c60-d4bf71234e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:31.977937 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-5bd4d11a-171f-499d-8c60-d4bf71234e72 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:31.978553 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5bd4d11a-171f-499d-8c60-d4bf71234e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:32.028148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:32.041045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1353/2723] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:32.050824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a1142-f071-4eb7-bc86-442c152c1ba0 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:32.052506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-192a1142-f071-4eb7-bc86-442c152c1ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:32.065501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4d11a-171f-499d-8c60-d4bf71234e72 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:32.067206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5bd4d11a-171f-499d-8c60-d4bf71234e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:32.086928 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4d11a-171f-499d-8c60-d4bf71234e72 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:32.087586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:32.088245 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:32.088532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:32.088805 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] PATH_INFO: `/v3/users/8a7246f0c1f44d968ca839d36ecae75e` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:32.090005 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a7246f0c1f44d968ca839d36ecae75e)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:32.092186 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:32.118831 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a1142-f071-4eb7-bc86-442c152c1ba0 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:32.123201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86bf83-a2f1-46a2-bbd4-12c25d63eade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:32.123830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86bf83-a2f1-46a2-bbd4-12c25d63eade service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:32.124111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86bf83-a2f1-46a2-bbd4-12c25d63eade service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:32.124382 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86bf83-a2f1-46a2-bbd4-12c25d63eade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:32.134435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86bf83-a2f1-46a2-bbd4-12c25d63eade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:32.135879 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86bf83-a2f1-46a2-bbd4-12c25d63eade service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:32.146702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1371/2724] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:32.285025 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a7246f0c1f44d968ca839d36ecae75e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:32.299187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a7246f0c1f44d968ca839d36ecae75e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:32.299961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a7246f0c1f44d968ca839d36ecae75e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:32.307094 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a7246f0c1f44d968ca839d36ecae75e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:32.371126 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a7246f0c1f44d968ca839d36ecae75e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:32.378532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1354/2725] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:43:32 2022] DELETE /identity/v3/users/8a7246f0c1f44d968ca839d36ecae75e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:43:32.647830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86bf83-a2f1-46a2-bbd4-12c25d63eade service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:32.658828 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86bf83-a2f1-46a2-bbd4-12c25d63eade service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:32.664262 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:32.731003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:32.731701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:32.731980 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:32.732413 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] PATH_INFO: `/v3/projects/b14b11a92ccb494ea480962861bac477` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:32.733586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14b11a92ccb494ea480962861bac477)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:32.735625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:32.860662 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14b11a92ccb494ea480962861bac477', 'request_id': 'req-61724aa9-8d36-4d92-812a-ee86319683e6'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:32.958515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14b11a92ccb494ea480962861bac477', 'request_id': 'req-61724aa9-8d36-4d92-812a-ee86319683e6'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:32.966677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14b11a92ccb494ea480962861bac477', 'request_id': 'req-61724aa9-8d36-4d92-812a-ee86319683e6'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:32.980896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] The token cache is being invalidate because project b14b11a92ccb494ea480962861bac477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:43:32.981206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:32.982824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:32.986319 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1372/2726] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:43:32 2022] DELETE /identity/v3/projects/b14b11a92ccb494ea480962861bac477 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:32.998090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:32.998090 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:33.010574 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d89111-4496-46cc-87a8-ff79b5906416 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:33.080469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f355f-15d6-4341-bc82-d99c0e38e6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:33.081215 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f355f-15d6-4341-bc82-d99c0e38e6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:33.081595 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f355f-15d6-4341-bc82-d99c0e38e6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:33.082062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f355f-15d6-4341-bc82-d99c0e38e6b1 admin admin] PATH_INFO: `/v3/users/27e4a4e58d744bac91683645307f127a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:33.089458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f355f-15d6-4341-bc82-d99c0e38e6b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e4a4e58d744bac91683645307f127a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:33.089458 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f355f-15d6-4341-bc82-d99c0e38e6b1 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:33.295516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-384f355f-15d6-4341-bc82-d99c0e38e6b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e4a4e58d744bac91683645307f127a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:33.307540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-384f355f-15d6-4341-bc82-d99c0e38e6b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e4a4e58d744bac91683645307f127a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:33.308233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-384f355f-15d6-4341-bc82-d99c0e38e6b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e4a4e58d744bac91683645307f127a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:33.310457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:33.315835 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-384f355f-15d6-4341-bc82-d99c0e38e6b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e4a4e58d744bac91683645307f127a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:33.384020 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-384f355f-15d6-4341-bc82-d99c0e38e6b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e4a4e58d744bac91683645307f127a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:33.391267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1355/2727] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:43:32 2022] DELETE /identity/v3/users/27e4a4e58d744bac91683645307f127a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:43:33.676842 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:33.677901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:33.692221 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61724aa9-8d36-4d92-812a-ee86319683e6 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:33.790596 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:33.791317 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:33.791651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:33.791893 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] PATH_INFO: `/v3/projects/330d77a7bd414a0dbc401c900a3ce688` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:33.793204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330d77a7bd414a0dbc401c900a3ce688)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:33.795985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:33.920027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:33.928835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330d77a7bd414a0dbc401c900a3ce688', 'request_id': 'req-8775c058-3ed6-43f3-b120-694330e2f4a4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:33.996806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330d77a7bd414a0dbc401c900a3ce688', 'request_id': 'req-8775c058-3ed6-43f3-b120-694330e2f4a4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:34.004274 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330d77a7bd414a0dbc401c900a3ce688', 'request_id': 'req-8775c058-3ed6-43f3-b120-694330e2f4a4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:34.016854 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] The token cache is being invalidate because project 330d77a7bd414a0dbc401c900a3ce688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:43:34.017154 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:34.019796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:34.019796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1373/2728] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:43:33 2022] DELETE /identity/v3/projects/330d77a7bd414a0dbc401c900a3ce688 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:37.670673 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66539538-e4af-4f01-b5c8-37987fe9743a None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:37.671492 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66539538-e4af-4f01-b5c8-37987fe9743a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:37.671943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66539538-e4af-4f01-b5c8-37987fe9743a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:37.728378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-66539538-e4af-4f01-b5c8-37987fe9743a None None] MFA Rules not processed for user `3a20282bb5cf4561b60cab04acd0cab4`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:37.730012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-66539538-e4af-4f01-b5c8-37987fe9743a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:37.834876 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1356/2729] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:37.852264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:37.854548 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:37.949144 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775c058-3ed6-43f3-b120-694330e2f4a4 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:37.955850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c43f-31ee-4283-8a39-bd4de2ec79c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:37.956259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c43f-31ee-4283-8a39-bd4de2ec79c1 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:37.956543 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c43f-31ee-4283-8a39-bd4de2ec79c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:37.956820 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c43f-31ee-4283-8a39-bd4de2ec79c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:37.965485 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3c43f-31ee-4283-8a39-bd4de2ec79c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:37.967415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3c43f-31ee-4283-8a39-bd4de2ec79c1 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:37.977261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1374/2730] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:40.609783 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259aac7-5416-42ae-991b-ef9495661c4a None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:40.610318 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259aac7-5416-42ae-991b-ef9495661c4a None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:40.610418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259aac7-5416-42ae-991b-ef9495661c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:40.629617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2259aac7-5416-42ae-991b-ef9495661c4a None None] MFA Rules not processed for user `3a20282bb5cf4561b60cab04acd0cab4`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:40.630934 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2259aac7-5416-42ae-991b-ef9495661c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:40.638438 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1357/2731] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:40.980987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c43f-31ee-4283-8a39-bd4de2ec79c1 service nova] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:40.982714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-55f3c43f-31ee-4283-8a39-bd4de2ec79c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:41.059285 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c43f-31ee-4283-8a39-bd4de2ec79c1 service nova] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:41.063985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992cee1-7d29-4d13-ac66-6cc9ac6ccd2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:41.064616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992cee1-7d29-4d13-ac66-6cc9ac6ccd2f service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:41.064904 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992cee1-7d29-4d13-ac66-6cc9ac6ccd2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:41.065184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992cee1-7d29-4d13-ac66-6cc9ac6ccd2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:41.066976 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e992cee1-7d29-4d13-ac66-6cc9ac6ccd2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:41.078554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992cee1-7d29-4d13-ac66-6cc9ac6ccd2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:41.082248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992cee1-7d29-4d13-ac66-6cc9ac6ccd2f service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:41.089342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1375/2732] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:50.624657 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=40,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:51.088621 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=69,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:59.133624 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259aac7-5416-42ae-991b-ef9495661c4a None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:59.137487 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2259aac7-5416-42ae-991b-ef9495661c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:59.217073 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259aac7-5416-42ae-991b-ef9495661c4a None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:59.222330 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:59.223112 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:59.223389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:59.223666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] PATH_INFO: `/v3/users/077b2a9e9ea34806b7bfac4b30c5e17b` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:59.224850 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=077b2a9e9ea34806b7bfac4b30c5e17b)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:59.226972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:59.432286 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077b2a9e9ea34806b7bfac4b30c5e17b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:59.444541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077b2a9e9ea34806b7bfac4b30c5e17b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:59.445252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077b2a9e9ea34806b7bfac4b30c5e17b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:59.453078 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077b2a9e9ea34806b7bfac4b30c5e17b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:59.520637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077b2a9e9ea34806b7bfac4b30c5e17b'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:59.527738 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1358/2733] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:43:59 2022] DELETE /identity/v3/users/077b2a9e9ea34806b7bfac4b30c5e17b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:43:59.534870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b61c32-caeb-401f-b9b5-e8a84c50388f None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:59.535782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b61c32-caeb-401f-b9b5-e8a84c50388f None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:59.536071 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b61c32-caeb-401f-b9b5-e8a84c50388f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:59.556168 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e5b61c32-caeb-401f-b9b5-e8a84c50388f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:59.557825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e5b61c32-caeb-401f-b9b5-e8a84c50388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:59.621218 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1376/2734] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:59.632075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:59.633497 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:59.693293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d37b80-b1bc-4995-b590-93a3f9b49d40 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:59.697752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385eaaa-38d4-4122-8e41-ba1a458d378d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:59.698369 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385eaaa-38d4-4122-8e41-ba1a458d378d service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:59.698687 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385eaaa-38d4-4122-8e41-ba1a458d378d service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:59.698968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385eaaa-38d4-4122-8e41-ba1a458d378d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:59.709806 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385eaaa-38d4-4122-8e41-ba1a458d378d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:59.710731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385eaaa-38d4-4122-8e41-ba1a458d378d service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:59.720922 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1359/2735] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:44:00.414691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b61c32-caeb-401f-b9b5-e8a84c50388f None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:00.419612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e5b61c32-caeb-401f-b9b5-e8a84c50388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:00.428307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b61c32-caeb-401f-b9b5-e8a84c50388f None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:00.433017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:00.433666 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:00.433951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:00.434228 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879 admin admin] PATH_INFO: `/v3/projects/fd30c95fb0cd4de385e9f53834a2895b` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:00.435435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd30c95fb0cd4de385e9f53834a2895b)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:00.437922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:00.544730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd30c95fb0cd4de385e9f53834a2895b', 'request_id': 'req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:00.646805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd30c95fb0cd4de385e9f53834a2895b', 'request_id': 'req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:00.653528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd30c95fb0cd4de385e9f53834a2895b', 'request_id': 'req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:00.665353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879 admin admin] The token cache is being invalidate because project fd30c95fb0cd4de385e9f53834a2895b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:44:00.665649 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:00.666331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-1eee5c92-6d65-4b2f-ba33-017b1a6d0879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:00.667895 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1377/2736] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:44:00 2022] DELETE /identity/v3/projects/fd30c95fb0cd4de385e9f53834a2895b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:44:00.673708 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa8455-1df3-4de4-a040-1f3cef3f7d4b None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:00.674328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa8455-1df3-4de4-a040-1f3cef3f7d4b None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:00.674328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa8455-1df3-4de4-a040-1f3cef3f7d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:00.695223 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-79fa8455-1df3-4de4-a040-1f3cef3f7d4b None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:00.696520 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-79fa8455-1df3-4de4-a040-1f3cef3f7d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:00.714080 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:00.759399 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1360/2737] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:44:00.769148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cc146-6f8c-4358-acb9-74f4f088aa60 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:00.769372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cc146-6f8c-4358-acb9-74f4f088aa60 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:00.769578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cc146-6f8c-4358-acb9-74f4f088aa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:00.789468 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-606cc146-6f8c-4358-acb9-74f4f088aa60 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:00.793658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-606cc146-6f8c-4358-acb9-74f4f088aa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:00.799224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1378/2738] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:44:00.803569 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa8455-1df3-4de4-a040-1f3cef3f7d4b None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:00.814143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa8455-1df3-4de4-a040-1f3cef3f7d4b None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:00.818940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e874f-ce64-48aa-979d-749038615271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:00.819560 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e874f-ce64-48aa-979d-749038615271 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:00.819846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e874f-ce64-48aa-979d-749038615271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:00.820126 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e874f-ce64-48aa-979d-749038615271 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:00.820851 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e874f-ce64-48aa-979d-749038615271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:44:00.821164 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e874f-ce64-48aa-979d-749038615271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:00.822876 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e874f-ce64-48aa-979d-749038615271 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:00.835979 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1361/2739] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:44:00.840512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cc146-6f8c-4358-acb9-74f4f088aa60 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:00.850162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cc146-6f8c-4358-acb9-74f4f088aa60 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:00.854896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a2636-ff03-491a-b993-d7c6b53729be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:00.855504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a2636-ff03-491a-b993-d7c6b53729be admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:00.855789 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a2636-ff03-491a-b993-d7c6b53729be admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:00.856064 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a2636-ff03-491a-b993-d7c6b53729be admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:00.856801 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a2636-ff03-491a-b993-d7c6b53729be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:00.862191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a2636-ff03-491a-b993-d7c6b53729be admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:00.991369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1379/2740] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:44:00 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:44:00.995775 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e874f-ce64-48aa-979d-749038615271 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:01.006825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e874f-ce64-48aa-979d-749038615271 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:01.066980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a533bdc-b304-4fe3-ae7d-c36f9d501b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:01.067604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a533bdc-b304-4fe3-ae7d-c36f9d501b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:01.067893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a533bdc-b304-4fe3-ae7d-c36f9d501b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:01.068171 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a533bdc-b304-4fe3-ae7d-c36f9d501b57 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:01.068861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a533bdc-b304-4fe3-ae7d-c36f9d501b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:01.070821 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a533bdc-b304-4fe3-ae7d-c36f9d501b57 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:01.148882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1362/2741] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:44:00 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:44:01.153222 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a2636-ff03-491a-b993-d7c6b53729be admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:01.165470 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a2636-ff03-491a-b993-d7c6b53729be admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:01.170319 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e846bd-e913-480c-b5f9-7b4ee6086cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:01.171148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e846bd-e913-480c-b5f9-7b4ee6086cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:01.175545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e846bd-e913-480c-b5f9-7b4ee6086cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:01.175545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e846bd-e913-480c-b5f9-7b4ee6086cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:01.175545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e846bd-e913-480c-b5f9-7b4ee6086cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:01.175545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e846bd-e913-480c-b5f9-7b4ee6086cdd admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:01.185393 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1380/2742] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:44:01.189577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a533bdc-b304-4fe3-ae7d-c36f9d501b57 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:01.199555 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a533bdc-b304-4fe3-ae7d-c36f9d501b57 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:01.204224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6de6d2-6ae3-4161-804a-16d357e5d08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:01.204826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6de6d2-6ae3-4161-804a-16d357e5d08b admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:01.205110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6de6d2-6ae3-4161-804a-16d357e5d08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:01.205389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6de6d2-6ae3-4161-804a-16d357e5d08b admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:01.206117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6de6d2-6ae3-4161-804a-16d357e5d08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:01.207836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6de6d2-6ae3-4161-804a-16d357e5d08b admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:01.218241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1363/2743] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:44:01.222917 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e846bd-e913-480c-b5f9-7b4ee6086cdd admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:01.232845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e846bd-e913-480c-b5f9-7b4ee6086cdd admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:01.238355 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48cc4-1749-4ed9-9778-77252c3a1439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:01.239036 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48cc4-1749-4ed9-9778-77252c3a1439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:01.239326 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48cc4-1749-4ed9-9778-77252c3a1439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:01.239605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48cc4-1749-4ed9-9778-77252c3a1439 admin admin] PATH_INFO: `/v3/projects/4c8e5c8f08a44e60aa29e84422acf26c/users/0b027a7cb06b49aa9f5ea95cf0603979/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:01.255140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba48cc4-1749-4ed9-9778-77252c3a1439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8e5c8f08a44e60aa29e84422acf26c, user_id=0b027a7cb06b49aa9f5ea95cf0603979, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:01.257905 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba48cc4-1749-4ed9-9778-77252c3a1439 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:01.386451 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1381/2744] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:44:01 2022] PUT /identity/v3/projects/4c8e5c8f08a44e60aa29e84422acf26c/users/0b027a7cb06b49aa9f5ea95cf0603979/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:44:01.400527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4aff4-dd3b-4923-9df8-fbba6f942a95 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:01.406273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4aff4-dd3b-4923-9df8-fbba6f942a95 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:01.406273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4aff4-dd3b-4923-9df8-fbba6f942a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:01.423350 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-3df4aff4-dd3b-4923-9df8-fbba6f942a95 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:01.425282 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-3df4aff4-dd3b-4923-9df8-fbba6f942a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:01.492012 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1364/2745] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:44:01.500452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48cc4-1749-4ed9-9778-77252c3a1439 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:01.502415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-cba48cc4-1749-4ed9-9778-77252c3a1439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:01.527067 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:01.562063 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48cc4-1749-4ed9-9778-77252c3a1439 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:01.566282 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf07cf-16a9-486c-a5c2-6c114ba3c9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:01.566999 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf07cf-16a9-486c-a5c2-6c114ba3c9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:01.567295 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf07cf-16a9-486c-a5c2-6c114ba3c9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:01.567573 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf07cf-16a9-486c-a5c2-6c114ba3c9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:01.577027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf07cf-16a9-486c-a5c2-6c114ba3c9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:01.578513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf07cf-16a9-486c-a5c2-6c114ba3c9e1 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:01.588866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1382/2746] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:44:02.796310 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf46dc-8747-4195-835f-356a0f0274ea None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:02.796881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf46dc-8747-4195-835f-356a0f0274ea None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:02.796987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf46dc-8747-4195-835f-356a0f0274ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:02.841216 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf07cf-16a9-486c-a5c2-6c114ba3c9e1 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:02.842829 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-52bf07cf-16a9-486c-a5c2-6c114ba3c9e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:02.843662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-08cf46dc-8747-4195-835f-356a0f0274ea None None] MFA Rules not processed for user `0b027a7cb06b49aa9f5ea95cf0603979`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:02.845745 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-08cf46dc-8747-4195-835f-356a0f0274ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:02.858846 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf07cf-16a9-486c-a5c2-6c114ba3c9e1 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:02.864805 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0b87f-ede3-41dd-baaf-73748070e849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:02.865899 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0b87f-ede3-41dd-baaf-73748070e849 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:02.866062 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0b87f-ede3-41dd-baaf-73748070e849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:02.866345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0b87f-ede3-41dd-baaf-73748070e849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:02.867216 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:02.868626 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-eeb0b87f-ede3-41dd-baaf-73748070e849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:02.882892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0b87f-ede3-41dd-baaf-73748070e849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:02.884537 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0b87f-ede3-41dd-baaf-73748070e849 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:02.896215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1383/2747] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:44:02.926820 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1365/2748] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:44:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:44:02.937381 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0b87f-ede3-41dd-baaf-73748070e849 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:02.938943 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-eeb0b87f-ede3-41dd-baaf-73748070e849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:02.999226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0b87f-ede3-41dd-baaf-73748070e849 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:03.002910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d472b-5e93-425e-9a1f-d6974cdf1876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:03.003529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d472b-5e93-425e-9a1f-d6974cdf1876 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:03.004023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d472b-5e93-425e-9a1f-d6974cdf1876 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:03.004156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d472b-5e93-425e-9a1f-d6974cdf1876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:03.012894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d472b-5e93-425e-9a1f-d6974cdf1876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:03.015190 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d472b-5e93-425e-9a1f-d6974cdf1876 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:03.024291 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1384/2749] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:44:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:44:04.758755 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b70de-9f34-4644-bcc8-1a31d26be8b2 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:04.759338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b70de-9f34-4644-bcc8-1a31d26be8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:04.759338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b70de-9f34-4644-bcc8-1a31d26be8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:04.781793 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-fb0b70de-9f34-4644-bcc8-1a31d26be8b2 None None] MFA Rules not processed for user `0b027a7cb06b49aa9f5ea95cf0603979`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:04.783119 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-fb0b70de-9f34-4644-bcc8-1a31d26be8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:04.790242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1366/2750] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:44:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:44:10.766535 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d472b-5e93-425e-9a1f-d6974cdf1876 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:10.768000 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-896d472b-5e93-425e-9a1f-d6974cdf1876 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:10.786060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d472b-5e93-425e-9a1f-d6974cdf1876 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:10.790863 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:10.791509 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:10.791794 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:10.792074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] PATH_INFO: `/v3/users/5091a0547e964c6d80b947191072e809` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:10.793279 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5091a0547e964c6d80b947191072e809)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:10.795284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:10.963027 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5091a0547e964c6d80b947191072e809'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.022916 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5091a0547e964c6d80b947191072e809'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.030256 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5091a0547e964c6d80b947191072e809'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.030912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5091a0547e964c6d80b947191072e809'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.031512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5091a0547e964c6d80b947191072e809'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.053319 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1385/2751] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:44:10 2022] DELETE /identity/v3/users/5091a0547e964c6d80b947191072e809 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:44:11.282022 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b70de-9f34-4644-bcc8-1a31d26be8b2 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:11.295118 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b70de-9f34-4644-bcc8-1a31d26be8b2 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:11.353417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:11.354055 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:11.354342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:11.354653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] PATH_INFO: `/v3/projects/a49dcb863cd24a3cab8162c18ddf78f0` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:11.355905 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49dcb863cd24a3cab8162c18ddf78f0)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:11.357809 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:11.487333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49dcb863cd24a3cab8162c18ddf78f0', 'request_id': 'req-95db786f-ccb1-461e-9ee9-24b09393adfd'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.497705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49dcb863cd24a3cab8162c18ddf78f0', 'request_id': 'req-95db786f-ccb1-461e-9ee9-24b09393adfd'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.583524 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49dcb863cd24a3cab8162c18ddf78f0', 'request_id': 'req-95db786f-ccb1-461e-9ee9-24b09393adfd'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.595209 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] The token cache is being invalidate because project a49dcb863cd24a3cab8162c18ddf78f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:44:11.595500 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.596133 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.598516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1367/2752] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:44:11 2022] DELETE /identity/v3/projects/a49dcb863cd24a3cab8162c18ddf78f0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:44:11.602406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:11.603911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:11.617890 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207313f-8f20-468c-b104-177c807f7247 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:11.637783 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:11.676032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe6af6-da84-48ff-8b16-3ced266f5c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:11.676673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe6af6-da84-48ff-8b16-3ced266f5c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:11.676956 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe6af6-da84-48ff-8b16-3ced266f5c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:11.677232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe6af6-da84-48ff-8b16-3ced266f5c70 admin admin] PATH_INFO: `/v3/users/856ee1ce4ac347118944e2267f122623` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:11.678410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe6af6-da84-48ff-8b16-3ced266f5c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=856ee1ce4ac347118944e2267f122623)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:11.680390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe6af6-da84-48ff-8b16-3ced266f5c70 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:11.877084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4fbe6af6-da84-48ff-8b16-3ced266f5c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856ee1ce4ac347118944e2267f122623'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.966225 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4fbe6af6-da84-48ff-8b16-3ced266f5c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856ee1ce4ac347118944e2267f122623'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.974184 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4fbe6af6-da84-48ff-8b16-3ced266f5c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856ee1ce4ac347118944e2267f122623'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.974887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4fbe6af6-da84-48ff-8b16-3ced266f5c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856ee1ce4ac347118944e2267f122623'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.975510 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-4fbe6af6-da84-48ff-8b16-3ced266f5c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856ee1ce4ac347118944e2267f122623'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:11.992830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1386/2753] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:44:11 2022] DELETE /identity/v3/users/856ee1ce4ac347118944e2267f122623 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:44:12.242327 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:12.243812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:12.259552 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db786f-ccb1-461e-9ee9-24b09393adfd admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:12.302238 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:12.318943 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:12.319592 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:12.319880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:12.320159 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] PATH_INFO: `/v3/projects/bd0b06bdf283429dbf62fa10abf29f6f` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:12.321335 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0b06bdf283429dbf62fa10abf29f6f)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:12.323311 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:12.417295 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0b06bdf283429dbf62fa10abf29f6f', 'request_id': 'req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:12.422875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0b06bdf283429dbf62fa10abf29f6f', 'request_id': 'req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:12.480241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0b06bdf283429dbf62fa10abf29f6f', 'request_id': 'req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:12.492342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] The token cache is being invalidate because project bd0b06bdf283429dbf62fa10abf29f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:44:12.492342 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:12.492832 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:44:12.494395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1368/2754] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:44:12 2022] DELETE /identity/v3/projects/bd0b06bdf283429dbf62fa10abf29f6f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:44:21.989345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:22.488562 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=32,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:36.144910 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff26968-581b-4920-862d-4223df763989 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:36.145505 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff26968-581b-4920-862d-4223df763989 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:36.145674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff26968-581b-4920-862d-4223df763989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:36.230235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-5ff26968-581b-4920-862d-4223df763989 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:36.231521 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-5ff26968-581b-4920-862d-4223df763989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:36.332830 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1387/2755] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 02:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:44:36.348955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:36.350604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:36.495108 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c5cf7-990a-42b5-b4c2-340d9cdbf6cb admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:36.502683 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94da001-a235-43f7-a3aa-1d76591f93cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:36.503339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94da001-a235-43f7-a3aa-1d76591f93cf service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:36.503757 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94da001-a235-43f7-a3aa-1d76591f93cf service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:36.504044 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94da001-a235-43f7-a3aa-1d76591f93cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:36.513714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94da001-a235-43f7-a3aa-1d76591f93cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:36.519339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94da001-a235-43f7-a3aa-1d76591f93cf service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:36.525745 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1369/2756] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:44:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:44:37.133346 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a899c3-8e58-4423-be5a-0c10b10c06ee None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:37.133796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a899c3-8e58-4423-be5a-0c10b10c06ee None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:37.134081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a899c3-8e58-4423-be5a-0c10b10c06ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:37.154951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e0a899c3-8e58-4423-be5a-0c10b10c06ee None None] MFA Rules not processed for user `3a20282bb5cf4561b60cab04acd0cab4`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:37.156155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e0a899c3-8e58-4423-be5a-0c10b10c06ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:37.211294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1388/2757] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:44:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:44:40.451549 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b525ae-cbba-4790-8400-25dc306379b5 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:40.452141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b525ae-cbba-4790-8400-25dc306379b5 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:40.452262 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b525ae-cbba-4790-8400-25dc306379b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:40.473907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-29b525ae-cbba-4790-8400-25dc306379b5 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:40.473907 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-29b525ae-cbba-4790-8400-25dc306379b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:40.482051 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1370/2758] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 02:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:44:40.504052 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a899c3-8e58-4423-be5a-0c10b10c06ee None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:40.505536 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e0a899c3-8e58-4423-be5a-0c10b10c06ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:40.521514 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a899c3-8e58-4423-be5a-0c10b10c06ee None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:40.527939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613b4ce-1a13-4ba9-92e0-5fd2cb8faf04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:40.528557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613b4ce-1a13-4ba9-92e0-5fd2cb8faf04 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:40.528845 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613b4ce-1a13-4ba9-92e0-5fd2cb8faf04 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:40.529126 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613b4ce-1a13-4ba9-92e0-5fd2cb8faf04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:40.537787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613b4ce-1a13-4ba9-92e0-5fd2cb8faf04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:40.542284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613b4ce-1a13-4ba9-92e0-5fd2cb8faf04 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:40.545907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=100 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:40.550944 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1389/2759] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:44:43.831448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948acd1-8cb2-4fd5-9d46-c9d2ab7d255c None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:43.831973 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948acd1-8cb2-4fd5-9d46-c9d2ab7d255c None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:43.832092 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948acd1-8cb2-4fd5-9d46-c9d2ab7d255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:43.851837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-b948acd1-8cb2-4fd5-9d46-c9d2ab7d255c None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:43.853037 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b948acd1-8cb2-4fd5-9d46-c9d2ab7d255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:43.860939 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1371/2760] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 02:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:44:43.878624 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613b4ce-1a13-4ba9-92e0-5fd2cb8faf04 service nova] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:43.890226 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613b4ce-1a13-4ba9-92e0-5fd2cb8faf04 service nova] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:43.895832 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ce4fd-b9bd-470c-aa1a-29d463e23867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:43.896466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ce4fd-b9bd-470c-aa1a-29d463e23867 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:43.896754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ce4fd-b9bd-470c-aa1a-29d463e23867 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:43.897034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ce4fd-b9bd-470c-aa1a-29d463e23867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:43.905945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ce4fd-b9bd-470c-aa1a-29d463e23867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:43.907574 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ce4fd-b9bd-470c-aa1a-29d463e23867 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:43.917504 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1390/2761] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:44:46.753589 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d958fb8-7835-468b-b8de-8c264fb07aae None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:46.754076 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d958fb8-7835-468b-b8de-8c264fb07aae None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:46.754194 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d958fb8-7835-468b-b8de-8c264fb07aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:46.773816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-2d958fb8-7835-468b-b8de-8c264fb07aae None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:46.775040 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-2d958fb8-7835-468b-b8de-8c264fb07aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:46.783251 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1372/2762] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 02:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:44:46.811380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ce4fd-b9bd-470c-aa1a-29d463e23867 service nova] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:46.822609 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ce4fd-b9bd-470c-aa1a-29d463e23867 service nova] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:46.828081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68a663-1c88-4bfc-8113-793f1308f298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:46.828709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68a663-1c88-4bfc-8113-793f1308f298 service nova] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:46.828995 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68a663-1c88-4bfc-8113-793f1308f298 service nova] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:46.829271 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68a663-1c88-4bfc-8113-793f1308f298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:46.837533 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68a663-1c88-4bfc-8113-793f1308f298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:46.839294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68a663-1c88-4bfc-8113-793f1308f298 service nova] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:46.848706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1391/2763] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:44:50.639602 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d958fb8-7835-468b-b8de-8c264fb07aae None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:50.652705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d958fb8-7835-468b-b8de-8c264fb07aae None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:50.658631 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1c599-b474-47fe-b67f-8c85cc2066d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:50.659252 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1c599-b474-47fe-b67f-8c85cc2066d6 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:50.659535 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1c599-b474-47fe-b67f-8c85cc2066d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:50.659812 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1c599-b474-47fe-b67f-8c85cc2066d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:50.661829 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-9bc1c599-b474-47fe-b67f-8c85cc2066d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:50.674763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1c599-b474-47fe-b67f-8c85cc2066d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:50.676353 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1c599-b474-47fe-b67f-8c85cc2066d6 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:50.688378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1373/2764] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:44:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:44:50.996022 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01b8d1-de32-4b36-a184-ed7675723c78 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:50.996932 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01b8d1-de32-4b36-a184-ed7675723c78 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:50.997406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01b8d1-de32-4b36-a184-ed7675723c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:51.018328 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-8c01b8d1-de32-4b36-a184-ed7675723c78 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:51.019853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8c01b8d1-de32-4b36-a184-ed7675723c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:51.029706 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1392/2765] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 02:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:44:51.057870 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1c599-b474-47fe-b67f-8c85cc2066d6 service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:51.070878 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1c599-b474-47fe-b67f-8c85cc2066d6 service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:51.077214 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267737e-dd61-445d-b1e0-ddcf19ed6ffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:51.077842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267737e-dd61-445d-b1e0-ddcf19ed6ffa service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:51.078131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267737e-dd61-445d-b1e0-ddcf19ed6ffa service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:51.078419 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267737e-dd61-445d-b1e0-ddcf19ed6ffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:51.088466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267737e-dd61-445d-b1e0-ddcf19ed6ffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:51.091655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267737e-dd61-445d-b1e0-ddcf19ed6ffa service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:51.102874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1374/2766] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:44:54.235569 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc75823-8198-4f7f-b5a9-3c1cdd31ee3e None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:54.236066 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc75823-8198-4f7f-b5a9-3c1cdd31ee3e None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:54.236204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc75823-8198-4f7f-b5a9-3c1cdd31ee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:54.255107 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-4cc75823-8198-4f7f-b5a9-3c1cdd31ee3e None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:54.256332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4cc75823-8198-4f7f-b5a9-3c1cdd31ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:54.264389 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1393/2767] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 02:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:44:54.279972 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267737e-dd61-445d-b1e0-ddcf19ed6ffa service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:54.292168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267737e-dd61-445d-b1e0-ddcf19ed6ffa service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:54.297765 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f077c7-4d18-4e0d-8f47-36ba61b466df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:54.298370 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f077c7-4d18-4e0d-8f47-36ba61b466df service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:54.298710 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f077c7-4d18-4e0d-8f47-36ba61b466df service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:54.298987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f077c7-4d18-4e0d-8f47-36ba61b466df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:54.307187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f077c7-4d18-4e0d-8f47-36ba61b466df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:54.308763 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f077c7-4d18-4e0d-8f47-36ba61b466df service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:54.318087 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1375/2768] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:45:04.250024 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=18 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:04.313978 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=91 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:05.128339 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc75823-8198-4f7f-b5a9-3c1cdd31ee3e None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:05.129754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4cc75823-8198-4f7f-b5a9-3c1cdd31ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:05.219673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc75823-8198-4f7f-b5a9-3c1cdd31ee3e None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:05.224691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56dfee0-6d46-4769-8567-c744b21f9e9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '423ac00601f84e3d9c6cc6ee20eee6ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:05.225304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56dfee0-6d46-4769-8567-c744b21f9e9a service placement] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:05.225592 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56dfee0-6d46-4769-8567-c744b21f9e9a service placement] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:05.225870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56dfee0-6d46-4769-8567-c744b21f9e9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:05.228163 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e56dfee0-6d46-4769-8567-c744b21f9e9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:05.239454 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56dfee0-6d46-4769-8567-c744b21f9e9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:05.241060 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56dfee0-6d46-4769-8567-c744b21f9e9a service placement] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:05.251555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1394/2769] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:45:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:45:10.204358 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540cae7-4948-4c9f-a802-4405512737dc None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:10.204825 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540cae7-4948-4c9f-a802-4405512737dc None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:10.204933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540cae7-4948-4c9f-a802-4405512737dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:10.224278 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-4540cae7-4948-4c9f-a802-4405512737dc None None] MFA Rules not processed for user `0b027a7cb06b49aa9f5ea95cf0603979`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:45:10.225477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4540cae7-4948-4c9f-a802-4405512737dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:10.279758 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1376/2770] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:45:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:45:15.247322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=41 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:20.272824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=25 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:26.097152 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390d05e-32ed-4103-9a99-0a7856630d5d None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:26.097677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390d05e-32ed-4103-9a99-0a7856630d5d None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:26.097787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390d05e-32ed-4103-9a99-0a7856630d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:26.118079 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9390d05e-32ed-4103-9a99-0a7856630d5d None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:45:26.119397 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9390d05e-32ed-4103-9a99-0a7856630d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:26.127889 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1395/2771] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 02:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:45:26.142175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540cae7-4948-4c9f-a802-4405512737dc None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:26.155451 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540cae7-4948-4c9f-a802-4405512737dc None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:26.160906 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6834b-2df2-43de-a04f-2772046fc686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:26.161855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6834b-2df2-43de-a04f-2772046fc686 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:26.161855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6834b-2df2-43de-a04f-2772046fc686 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:26.162152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6834b-2df2-43de-a04f-2772046fc686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:26.171280 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6834b-2df2-43de-a04f-2772046fc686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:26.172884 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6834b-2df2-43de-a04f-2772046fc686 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:26.182506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1377/2772] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:45:30.665415 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b476a4-5d9b-4e72-96fc-37703a15e2b2 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:30.665970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b476a4-5d9b-4e72-96fc-37703a15e2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:30.665970 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b476a4-5d9b-4e72-96fc-37703a15e2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:30.691629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-24b476a4-5d9b-4e72-96fc-37703a15e2b2 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:45:30.692924 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-24b476a4-5d9b-4e72-96fc-37703a15e2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:30.701661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1396/2773] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 02:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:45:30.723488 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6834b-2df2-43de-a04f-2772046fc686 service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:30.750203 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6834b-2df2-43de-a04f-2772046fc686 service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:30.756982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5873b-cb8e-458d-8178-65378d4a6ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:30.757647 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5873b-cb8e-458d-8178-65378d4a6ad4 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:30.759946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5873b-cb8e-458d-8178-65378d4a6ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:30.759946 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5873b-cb8e-458d-8178-65378d4a6ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:30.769798 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5873b-cb8e-458d-8178-65378d4a6ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:30.772000 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5873b-cb8e-458d-8178-65378d4a6ad4 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:30.797813 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1378/2774] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:45:33.584612 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777121-38e3-40fe-8241-31f04927fee1 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:33.588155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777121-38e3-40fe-8241-31f04927fee1 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:33.588155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4777121-38e3-40fe-8241-31f04927fee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:33.606331 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-d4777121-38e3-40fe-8241-31f04927fee1 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:45:33.607621 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d4777121-38e3-40fe-8241-31f04927fee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:33.615839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1397/2775] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 02:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:45:33.662173 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5873b-cb8e-458d-8178-65378d4a6ad4 service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:33.675621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5873b-cb8e-458d-8178-65378d4a6ad4 service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:33.681434 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e16a9-973b-4e45-834f-9c4c16ac1ab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:33.682056 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e16a9-973b-4e45-834f-9c4c16ac1ab3 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:33.682341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e16a9-973b-4e45-834f-9c4c16ac1ab3 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:33.682649 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e16a9-973b-4e45-834f-9c4c16ac1ab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:33.691377 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e16a9-973b-4e45-834f-9c4c16ac1ab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:33.692982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e16a9-973b-4e45-834f-9c4c16ac1ab3 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:33.703140 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1379/2776] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:45:36.789684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db637803-9280-4a6f-b06c-fd2cbd015748 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:36.793406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db637803-9280-4a6f-b06c-fd2cbd015748 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:36.793406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db637803-9280-4a6f-b06c-fd2cbd015748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:36.810557 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-db637803-9280-4a6f-b06c-fd2cbd015748 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:45:36.811764 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-db637803-9280-4a6f-b06c-fd2cbd015748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:36.819639 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1398/2777] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 02:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:45:36.834237 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e16a9-973b-4e45-834f-9c4c16ac1ab3 service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:36.846128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e16a9-973b-4e45-834f-9c4c16ac1ab3 service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:36.851646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb68cbc-5aff-4ef5-9785-071e3d974cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:36.852257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb68cbc-5aff-4ef5-9785-071e3d974cd1 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:36.852544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb68cbc-5aff-4ef5-9785-071e3d974cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:36.852842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb68cbc-5aff-4ef5-9785-071e3d974cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:36.861582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb68cbc-5aff-4ef5-9785-071e3d974cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:36.863228 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb68cbc-5aff-4ef5-9785-071e3d974cd1 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:36.872725 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1380/2778] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:45:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:45:41.083401 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f256a54-c451-4515-9161-7cfb4d4dd8da None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:41.083871 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f256a54-c451-4515-9161-7cfb4d4dd8da None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:41.083986 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f256a54-c451-4515-9161-7cfb4d4dd8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:41.104326 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-7f256a54-c451-4515-9161-7cfb4d4dd8da None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:45:41.105761 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-7f256a54-c451-4515-9161-7cfb4d4dd8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:41.114154 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1399/2779] 10.222.0.64 () {58 vars in 1016 bytes} [Thu Aug 4 02:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:45:41.128193 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb68cbc-5aff-4ef5-9785-071e3d974cd1 service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:41.140772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb68cbc-5aff-4ef5-9785-071e3d974cd1 service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:41.147028 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbc6f7-ae98-401a-99ba-26eb25cb06c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:41.147652 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbc6f7-ae98-401a-99ba-26eb25cb06c7 service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:41.147941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbc6f7-ae98-401a-99ba-26eb25cb06c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:41.148224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbc6f7-ae98-401a-99ba-26eb25cb06c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:41.158309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbc6f7-ae98-401a-99ba-26eb25cb06c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:41.160093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbc6f7-ae98-401a-99ba-26eb25cb06c7 service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:41.170844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1381/2780] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:45:43.936214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c3d88-067c-4275-aab2-0a8c0a86b5be None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:43.936743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c3d88-067c-4275-aab2-0a8c0a86b5be None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:43.936860 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c3d88-067c-4275-aab2-0a8c0a86b5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:43.956147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-a55c3d88-067c-4275-aab2-0a8c0a86b5be None None] MFA Rules not processed for user `3a20282bb5cf4561b60cab04acd0cab4`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:45:43.957347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a55c3d88-067c-4275-aab2-0a8c0a86b5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:43.964284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1400/2781] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:45:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:45:51.165782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=30 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:53.951307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=18 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:13.397305 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbc6f7-ae98-401a-99ba-26eb25cb06c7 service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:13.398767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a0cbc6f7-ae98-401a-99ba-26eb25cb06c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:13.414161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbc6f7-ae98-401a-99ba-26eb25cb06c7 service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:13.418773 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:13.420026 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:13.420307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:13.420585 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] PATH_INFO: `/v3/users/0b027a7cb06b49aa9f5ea95cf0603979` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:13.421752 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b027a7cb06b49aa9f5ea95cf0603979)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:13.423707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:13.596093 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b027a7cb06b49aa9f5ea95cf0603979'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:13.608767 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b027a7cb06b49aa9f5ea95cf0603979'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:13.609431 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b027a7cb06b49aa9f5ea95cf0603979'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:13.616373 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b027a7cb06b49aa9f5ea95cf0603979'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:13.678881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b027a7cb06b49aa9f5ea95cf0603979'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:13.685121 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1382/2782] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:46:13 2022] DELETE /identity/v3/users/0b027a7cb06b49aa9f5ea95cf0603979 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:13.929866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c3d88-067c-4275-aab2-0a8c0a86b5be None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:13.945824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c3d88-067c-4275-aab2-0a8c0a86b5be None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:14.003303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:14.003935 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:14.004215 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:14.004488 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] PATH_INFO: `/v3/projects/4c8e5c8f08a44e60aa29e84422acf26c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:14.005629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8e5c8f08a44e60aa29e84422acf26c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:14.007554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:14.123406 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8e5c8f08a44e60aa29e84422acf26c', 'request_id': 'req-af07f370-f0cf-40e5-83e0-358a3a419a13'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.219556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8e5c8f08a44e60aa29e84422acf26c', 'request_id': 'req-af07f370-f0cf-40e5-83e0-358a3a419a13'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.225580 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8e5c8f08a44e60aa29e84422acf26c', 'request_id': 'req-af07f370-f0cf-40e5-83e0-358a3a419a13'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.236833 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] The token cache is being invalidate because project 4c8e5c8f08a44e60aa29e84422acf26c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:14.237126 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.237787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.239347 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1401/2783] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:13 2022] DELETE /identity/v3/projects/4c8e5c8f08a44e60aa29e84422acf26c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:23.681408 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:24.233852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:38.574750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:38.577968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:38.657387 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16529a05-59dd-4b3c-84e2-7e11f3cac705 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:38.705176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ad0b4-24d4-483b-b9ab-afae3b1abc5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:38.705799 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ad0b4-24d4-483b-b9ab-afae3b1abc5e service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:38.706103 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ad0b4-24d4-483b-b9ab-afae3b1abc5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:38.706378 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ad0b4-24d4-483b-b9ab-afae3b1abc5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:38.708158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-408ad0b4-24d4-483b-b9ab-afae3b1abc5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:38.777454 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ad0b4-24d4-483b-b9ab-afae3b1abc5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:38.778859 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ad0b4-24d4-483b-b9ab-afae3b1abc5e service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:38.790543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1383/2784] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:41.724428 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:41.725864 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:41.738919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07f370-f0cf-40e5-83e0-358a3a419a13 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:41.743381 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c6928-cae4-4f78-8f58-34e511eb05e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:41.748585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c6928-cae4-4f78-8f58-34e511eb05e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:41.748585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c6928-cae4-4f78-8f58-34e511eb05e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:41.748585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c6928-cae4-4f78-8f58-34e511eb05e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:41.748585 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-849c6928-cae4-4f78-8f58-34e511eb05e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:41.762316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c6928-cae4-4f78-8f58-34e511eb05e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:41.764047 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c6928-cae4-4f78-8f58-34e511eb05e6 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:41.775529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1402/2785] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:48.785636 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=83 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:51.528959 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba85e3-cd8c-4bc5-a5e9-338cc9f5bde7 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:51.529514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba85e3-cd8c-4bc5-a5e9-338cc9f5bde7 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:51.529514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba85e3-cd8c-4bc5-a5e9-338cc9f5bde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:51.549045 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-84ba85e3-cd8c-4bc5-a5e9-338cc9f5bde7 None None] MFA Rules not processed for user `3a20282bb5cf4561b60cab04acd0cab4`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:51.550241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-84ba85e3-cd8c-4bc5-a5e9-338cc9f5bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:51.607351 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1384/2786] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:46:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:51.770269 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=6 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:47:01.600430 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=25 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:47:42.104501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c6928-cae4-4f78-8f58-34e511eb05e6 service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:47:42.104501 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-849c6928-cae4-4f78-8f58-34e511eb05e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:47:42.181352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c6928-cae4-4f78-8f58-34e511eb05e6 service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:47:42.184919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84bd5c-9b7c-4e58-ad86-f13f9a504fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:47:42.185528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84bd5c-9b7c-4e58-ad86-f13f9a504fbc service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:47:42.185811 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84bd5c-9b7c-4e58-ad86-f13f9a504fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:47:42.186085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84bd5c-9b7c-4e58-ad86-f13f9a504fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:47:42.187901 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4c84bd5c-9b7c-4e58-ad86-f13f9a504fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:47:42.197813 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84bd5c-9b7c-4e58-ad86-f13f9a504fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:47:42.199294 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84bd5c-9b7c-4e58-ad86-f13f9a504fbc service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:47:42.207373 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1403/2787] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:47:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:47:50.643846 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba85e3-cd8c-4bc5-a5e9-338cc9f5bde7 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:47:50.645526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-84ba85e3-cd8c-4bc5-a5e9-338cc9f5bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:47:50.662517 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba85e3-cd8c-4bc5-a5e9-338cc9f5bde7 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:47:50.668230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b013fb3-2301-45b6-aede-6c52a57f8b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d95db1228f48669e1985eb74306a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:47:50.668858 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b013fb3-2301-45b6-aede-6c52a57f8b3f service nova] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:47:50.669143 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b013fb3-2301-45b6-aede-6c52a57f8b3f service nova] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:47:50.669422 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b013fb3-2301-45b6-aede-6c52a57f8b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:47:50.671244 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5b013fb3-2301-45b6-aede-6c52a57f8b3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:47:50.685024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b013fb3-2301-45b6-aede-6c52a57f8b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:47:50.686759 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b013fb3-2301-45b6-aede-6c52a57f8b3f service nova] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:47:50.698800 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1385/2788] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:47:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:47:52.203684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=35 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:00.693869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=6 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:01.126990 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84bd5c-9b7c-4e58-ad86-f13f9a504fbc service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:01.128466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-4c84bd5c-9b7c-4e58-ad86-f13f9a504fbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:01.196865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84bd5c-9b7c-4e58-ad86-f13f9a504fbc service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:01.201396 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b7597-96eb-4e1b-b4ea-1e5d98f8a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:01.202041 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b7597-96eb-4e1b-b4ea-1e5d98f8a09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:01.202327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b7597-96eb-4e1b-b4ea-1e5d98f8a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:01.202639 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b7597-96eb-4e1b-b4ea-1e5d98f8a09f admin admin] PATH_INFO: `/v3/users/3a20282bb5cf4561b60cab04acd0cab4` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:01.203892 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b7597-96eb-4e1b-b4ea-1e5d98f8a09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a20282bb5cf4561b60cab04acd0cab4)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:01.205911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b7597-96eb-4e1b-b4ea-1e5d98f8a09f admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:01.411085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-de7b7597-96eb-4e1b-b4ea-1e5d98f8a09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a20282bb5cf4561b60cab04acd0cab4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:01.482691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-de7b7597-96eb-4e1b-b4ea-1e5d98f8a09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a20282bb5cf4561b60cab04acd0cab4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:01.489705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-de7b7597-96eb-4e1b-b4ea-1e5d98f8a09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a20282bb5cf4561b60cab04acd0cab4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:01.490327 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-de7b7597-96eb-4e1b-b4ea-1e5d98f8a09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a20282bb5cf4561b60cab04acd0cab4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:01.490971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-de7b7597-96eb-4e1b-b4ea-1e5d98f8a09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a20282bb5cf4561b60cab04acd0cab4'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:01.508911 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1404/2789] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:48:01 2022] DELETE /identity/v3/users/3a20282bb5cf4561b60cab04acd0cab4 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:01.762205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b013fb3-2301-45b6-aede-6c52a57f8b3f service nova] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:01.773511 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b013fb3-2301-45b6-aede-6c52a57f8b3f service nova] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:01.833048 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc449d-1f4f-443b-96a3-1d12e2e5963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:01.833726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc449d-1f4f-443b-96a3-1d12e2e5963a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:01.834015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc449d-1f4f-443b-96a3-1d12e2e5963a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:01.834392 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc449d-1f4f-443b-96a3-1d12e2e5963a admin admin] PATH_INFO: `/v3/projects/64ca976f81ab4112b9fe4f24760862b9` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:01.836276 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc449d-1f4f-443b-96a3-1d12e2e5963a admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ca976f81ab4112b9fe4f24760862b9)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:01.838242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc449d-1f4f-443b-96a3-1d12e2e5963a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:01.932514 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-25fc449d-1f4f-443b-96a3-1d12e2e5963a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ca976f81ab4112b9fe4f24760862b9', 'request_id': 'req-25fc449d-1f4f-443b-96a3-1d12e2e5963a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:01.938338 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-25fc449d-1f4f-443b-96a3-1d12e2e5963a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ca976f81ab4112b9fe4f24760862b9', 'request_id': 'req-25fc449d-1f4f-443b-96a3-1d12e2e5963a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:02.034316 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-25fc449d-1f4f-443b-96a3-1d12e2e5963a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ca976f81ab4112b9fe4f24760862b9', 'request_id': 'req-25fc449d-1f4f-443b-96a3-1d12e2e5963a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:02.047568 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-25fc449d-1f4f-443b-96a3-1d12e2e5963a admin admin] The token cache is being invalidate because project 64ca976f81ab4112b9fe4f24760862b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:48:02.047904 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-25fc449d-1f4f-443b-96a3-1d12e2e5963a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:02.048696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-25fc449d-1f4f-443b-96a3-1d12e2e5963a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:02.050273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1386/2790] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:48:01 2022] DELETE /identity/v3/projects/64ca976f81ab4112b9fe4f24760862b9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:02.056085 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c0dbd-7590-4e3c-a2af-8f5e883050b8 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:02.056378 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c0dbd-7590-4e3c-a2af-8f5e883050b8 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:02.056673 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c0dbd-7590-4e3c-a2af-8f5e883050b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:02.077039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-e62c0dbd-7590-4e3c-a2af-8f5e883050b8 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:02.078336 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e62c0dbd-7590-4e3c-a2af-8f5e883050b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:02.136506 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1405/2791] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:02.145205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861b933-f620-4ba8-92d5-1a5ff4637510 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:02.145530 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861b933-f620-4ba8-92d5-1a5ff4637510 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:02.145815 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861b933-f620-4ba8-92d5-1a5ff4637510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:02.165512 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-5861b933-f620-4ba8-92d5-1a5ff4637510 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:02.166753 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-5861b933-f620-4ba8-92d5-1a5ff4637510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:02.174984 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1387/2792] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:48:02.179754 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c0dbd-7590-4e3c-a2af-8f5e883050b8 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:02.189440 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c0dbd-7590-4e3c-a2af-8f5e883050b8 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:02.194004 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b698f0-d16b-4516-a57c-484420733a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:02.197554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b698f0-d16b-4516-a57c-484420733a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:02.197554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b698f0-d16b-4516-a57c-484420733a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:02.197554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b698f0-d16b-4516-a57c-484420733a1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:02.197554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b698f0-d16b-4516-a57c-484420733a1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:48:02.197554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b698f0-d16b-4516-a57c-484420733a1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:02.198503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b698f0-d16b-4516-a57c-484420733a1e admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:02.210043 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1406/2793] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:48:02.214328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861b933-f620-4ba8-92d5-1a5ff4637510 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:02.223694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861b933-f620-4ba8-92d5-1a5ff4637510 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:02.229136 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c50e3-85ba-4c7e-a062-49618f540026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:02.236742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c50e3-85ba-4c7e-a062-49618f540026 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:02.236742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c50e3-85ba-4c7e-a062-49618f540026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:02.236742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c50e3-85ba-4c7e-a062-49618f540026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:02.236742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c50e3-85ba-4c7e-a062-49618f540026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:02.236742 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c50e3-85ba-4c7e-a062-49618f540026 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:02.338729 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1388/2794] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:48:02 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:02.343054 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b698f0-d16b-4516-a57c-484420733a1e admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:02.353769 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b698f0-d16b-4516-a57c-484420733a1e admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:02.357356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:02.410338 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15818cd-8cde-4b1b-87f0-efdc671f1df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:02.410967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15818cd-8cde-4b1b-87f0-efdc671f1df6 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:02.411250 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15818cd-8cde-4b1b-87f0-efdc671f1df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:02.411527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15818cd-8cde-4b1b-87f0-efdc671f1df6 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:02.412197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15818cd-8cde-4b1b-87f0-efdc671f1df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:02.414714 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15818cd-8cde-4b1b-87f0-efdc671f1df6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:02.491755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1407/2795] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:48:02 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:02.496185 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c50e3-85ba-4c7e-a062-49618f540026 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:02.506356 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c50e3-85ba-4c7e-a062-49618f540026 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:02.511001 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93b785-942a-4e2e-8839-7d66ecddb4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:02.511612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93b785-942a-4e2e-8839-7d66ecddb4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:02.511903 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93b785-942a-4e2e-8839-7d66ecddb4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:02.512175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93b785-942a-4e2e-8839-7d66ecddb4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:02.512866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93b785-942a-4e2e-8839-7d66ecddb4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:02.514465 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93b785-942a-4e2e-8839-7d66ecddb4d8 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:02.524534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1389/2796] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:02.528528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15818cd-8cde-4b1b-87f0-efdc671f1df6 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:02.538930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15818cd-8cde-4b1b-87f0-efdc671f1df6 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:02.543599 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809ffc3-ef0a-4b18-84e3-3da279d685b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:02.544201 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809ffc3-ef0a-4b18-84e3-3da279d685b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:02.544481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809ffc3-ef0a-4b18-84e3-3da279d685b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:02.544755 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809ffc3-ef0a-4b18-84e3-3da279d685b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:02.545445 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809ffc3-ef0a-4b18-84e3-3da279d685b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:02.547191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809ffc3-ef0a-4b18-84e3-3da279d685b8 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:02.558550 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1408/2797] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:02.562658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93b785-942a-4e2e-8839-7d66ecddb4d8 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:02.572950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93b785-942a-4e2e-8839-7d66ecddb4d8 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:02.577790 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e2db3-a012-41b9-99e1-55e2cf4cdd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:02.578503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e2db3-a012-41b9-99e1-55e2cf4cdd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:02.578792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e2db3-a012-41b9-99e1-55e2cf4cdd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:02.579068 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e2db3-a012-41b9-99e1-55e2cf4cdd47 admin admin] PATH_INFO: `/v3/projects/be10f5ab993d4a3e9141b29c2ac390a3/users/cd3ea5a3b8cb4451969c5a648537c158/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:02.594811 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e2db3-a012-41b9-99e1-55e2cf4cdd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be10f5ab993d4a3e9141b29c2ac390a3, user_id=cd3ea5a3b8cb4451969c5a648537c158, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:02.597518 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e2db3-a012-41b9-99e1-55e2cf4cdd47 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:02.697271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1390/2798] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:02 2022] PUT /identity/v3/projects/be10f5ab993d4a3e9141b29c2ac390a3/users/cd3ea5a3b8cb4451969c5a648537c158/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:02.707561 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8426b2-b3bc-437b-84e1-544b7abe0ace None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:02.707853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8426b2-b3bc-437b-84e1-544b7abe0ace None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:02.708135 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8426b2-b3bc-437b-84e1-544b7abe0ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:02.736795 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-7e8426b2-b3bc-437b-84e1-544b7abe0ace None None] MFA Rules not processed for user `cd3ea5a3b8cb4451969c5a648537c158`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:02.738165 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-7e8426b2-b3bc-437b-84e1-544b7abe0ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:02.801478 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1409/2799] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:02.812157 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e2db3-a012-41b9-99e1-55e2cf4cdd47 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:02.813914 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-307e2db3-a012-41b9-99e1-55e2cf4cdd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:02.834053 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:02.871711 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e2db3-a012-41b9-99e1-55e2cf4cdd47 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:02.875554 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436c269-0c68-4317-8bfa-84c44e2283b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:02.880540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436c269-0c68-4317-8bfa-84c44e2283b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:02.880540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436c269-0c68-4317-8bfa-84c44e2283b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:02.880540 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436c269-0c68-4317-8bfa-84c44e2283b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:02.885300 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436c269-0c68-4317-8bfa-84c44e2283b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:02.886782 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436c269-0c68-4317-8bfa-84c44e2283b5 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:02.895517 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1391/2800] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:48:12.646611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8426b2-b3bc-437b-84e1-544b7abe0ace None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:12.709803 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8426b2-b3bc-437b-84e1-544b7abe0ace None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:12.715009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:12.715648 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:12.715931 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:12.716205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] PATH_INFO: `/v3/users/cd3ea5a3b8cb4451969c5a648537c158` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:12.717372 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3ea5a3b8cb4451969c5a648537c158)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:12.719329 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:12.735781 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:12.890912 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3ea5a3b8cb4451969c5a648537c158'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:12.928577 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=18 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:12.974152 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3ea5a3b8cb4451969c5a648537c158'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:12.981508 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3ea5a3b8cb4451969c5a648537c158'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:12.989782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3ea5a3b8cb4451969c5a648537c158'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:12.989782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3ea5a3b8cb4451969c5a648537c158'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:12.999884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1410/2801] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:48:12 2022] DELETE /identity/v3/users/cd3ea5a3b8cb4451969c5a648537c158 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:13.004509 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667c0d1-f32f-459e-b612-aa881e793768 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:13.004794 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667c0d1-f32f-459e-b612-aa881e793768 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:13.005075 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667c0d1-f32f-459e-b612-aa881e793768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:13.024523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-c667c0d1-f32f-459e-b612-aa881e793768 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:13.026202 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c667c0d1-f32f-459e-b612-aa881e793768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:13.085795 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1392/2802] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:48:13.095839 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:13.097235 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:13.154340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df083aa-1924-4904-afc3-bc8237bac0d2 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:13.157919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f8503-f02f-4d33-b465-1e5986600b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:13.158564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f8503-f02f-4d33-b465-1e5986600b73 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:13.158853 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f8503-f02f-4d33-b465-1e5986600b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:13.159127 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f8503-f02f-4d33-b465-1e5986600b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:13.168454 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f8503-f02f-4d33-b465-1e5986600b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:13.169926 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f8503-f02f-4d33-b465-1e5986600b73 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:13.179527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1411/2803] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:48:13.593009 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667c0d1-f32f-459e-b612-aa881e793768 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:13.597471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-c667c0d1-f32f-459e-b612-aa881e793768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:13.609205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667c0d1-f32f-459e-b612-aa881e793768 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:13.614273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a9581-5edb-4f63-a85d-262173020c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:13.614987 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a9581-5edb-4f63-a85d-262173020c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:13.615961 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a9581-5edb-4f63-a85d-262173020c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:13.616258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a9581-5edb-4f63-a85d-262173020c58 admin admin] PATH_INFO: `/v3/projects/be10f5ab993d4a3e9141b29c2ac390a3` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:13.617634 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a9581-5edb-4f63-a85d-262173020c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be10f5ab993d4a3e9141b29c2ac390a3)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:13.620292 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a9581-5edb-4f63-a85d-262173020c58 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:13.714302 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-988a9581-5edb-4f63-a85d-262173020c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be10f5ab993d4a3e9141b29c2ac390a3', 'request_id': 'req-988a9581-5edb-4f63-a85d-262173020c58'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:13.719817 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-988a9581-5edb-4f63-a85d-262173020c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be10f5ab993d4a3e9141b29c2ac390a3', 'request_id': 'req-988a9581-5edb-4f63-a85d-262173020c58'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:13.782456 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-988a9581-5edb-4f63-a85d-262173020c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be10f5ab993d4a3e9141b29c2ac390a3', 'request_id': 'req-988a9581-5edb-4f63-a85d-262173020c58'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:13.794532 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-988a9581-5edb-4f63-a85d-262173020c58 admin admin] The token cache is being invalidate because project be10f5ab993d4a3e9141b29c2ac390a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:48:13.794853 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-988a9581-5edb-4f63-a85d-262173020c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:13.795506 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-988a9581-5edb-4f63-a85d-262173020c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:13.797014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1393/2804] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:48:13 2022] DELETE /identity/v3/projects/be10f5ab993d4a3e9141b29c2ac390a3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:13.802046 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eeec6-4281-474e-ad44-457d9ecc7eb2 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:13.802525 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eeec6-4281-474e-ad44-457d9ecc7eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:13.802647 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eeec6-4281-474e-ad44-457d9ecc7eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:13.822572 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-a76eeec6-4281-474e-ad44-457d9ecc7eb2 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:13.823773 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a76eeec6-4281-474e-ad44-457d9ecc7eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:13.881486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1412/2805] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:13.890639 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae1a6-91ed-4fb2-a950-e42dfddb7c49 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:13.890933 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae1a6-91ed-4fb2-a950-e42dfddb7c49 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:13.891219 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae1a6-91ed-4fb2-a950-e42dfddb7c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:13.911618 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-4fdae1a6-91ed-4fb2-a950-e42dfddb7c49 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:13.912816 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4fdae1a6-91ed-4fb2-a950-e42dfddb7c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:13.921573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1394/2806] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:13.925758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eeec6-4281-474e-ad44-457d9ecc7eb2 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:13.935751 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eeec6-4281-474e-ad44-457d9ecc7eb2 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:13.940241 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a08df-e3b2-40b5-883d-f62cda808cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:13.940840 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a08df-e3b2-40b5-883d-f62cda808cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:13.941118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a08df-e3b2-40b5-883d-f62cda808cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:13.941392 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a08df-e3b2-40b5-883d-f62cda808cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:13.942080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a08df-e3b2-40b5-883d-f62cda808cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:48:13.942384 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a08df-e3b2-40b5-883d-f62cda808cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:13.944003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a08df-e3b2-40b5-883d-f62cda808cc4 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:13.955824 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1413/2807] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:48:13.960046 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdae1a6-91ed-4fb2-a950-e42dfddb7c49 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:13.970027 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdae1a6-91ed-4fb2-a950-e42dfddb7c49 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:13.974685 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc8915-60b8-4abb-8ae5-5f25e60dbb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:13.975290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc8915-60b8-4abb-8ae5-5f25e60dbb17 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:13.975573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc8915-60b8-4abb-8ae5-5f25e60dbb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:13.975852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc8915-60b8-4abb-8ae5-5f25e60dbb17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:13.976564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc8915-60b8-4abb-8ae5-5f25e60dbb17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:13.979151 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc8915-60b8-4abb-8ae5-5f25e60dbb17 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:14.064293 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1395/2808] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:48:13 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:14.068564 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a08df-e3b2-40b5-883d-f62cda808cc4 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:14.079084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a08df-e3b2-40b5-883d-f62cda808cc4 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:14.099639 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:14.135965 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8639c0e-ebac-4f08-8d42-8e8c82396b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:14.136583 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8639c0e-ebac-4f08-8d42-8e8c82396b82 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:14.136868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8639c0e-ebac-4f08-8d42-8e8c82396b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:14.137147 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8639c0e-ebac-4f08-8d42-8e8c82396b82 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:14.137877 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8639c0e-ebac-4f08-8d42-8e8c82396b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:14.139961 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8639c0e-ebac-4f08-8d42-8e8c82396b82 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:14.223020 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1414/2809] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:48:14 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:14.227773 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc8915-60b8-4abb-8ae5-5f25e60dbb17 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:14.238100 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc8915-60b8-4abb-8ae5-5f25e60dbb17 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:14.243415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26980e0a-69ec-4032-af04-aadc40a42c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:14.244023 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26980e0a-69ec-4032-af04-aadc40a42c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:14.244306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26980e0a-69ec-4032-af04-aadc40a42c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:14.244582 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26980e0a-69ec-4032-af04-aadc40a42c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:14.245275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26980e0a-69ec-4032-af04-aadc40a42c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:14.246909 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26980e0a-69ec-4032-af04-aadc40a42c0a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:14.256772 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1396/2810] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:14.260905 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8639c0e-ebac-4f08-8d42-8e8c82396b82 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:14.270862 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8639c0e-ebac-4f08-8d42-8e8c82396b82 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:14.276043 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbddbea-6f0f-40a0-9658-be16a8b912de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:14.278544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbddbea-6f0f-40a0-9658-be16a8b912de admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:14.278544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbddbea-6f0f-40a0-9658-be16a8b912de admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:14.278544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbddbea-6f0f-40a0-9658-be16a8b912de admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:14.278544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbddbea-6f0f-40a0-9658-be16a8b912de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:14.279542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbddbea-6f0f-40a0-9658-be16a8b912de admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:14.290048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1415/2811] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:14.294275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26980e0a-69ec-4032-af04-aadc40a42c0a admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:14.304131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26980e0a-69ec-4032-af04-aadc40a42c0a admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:14.309389 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ee147-383e-4a20-87c5-961db3b86eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:14.310039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ee147-383e-4a20-87c5-961db3b86eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:14.310324 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ee147-383e-4a20-87c5-961db3b86eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:14.310650 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ee147-383e-4a20-87c5-961db3b86eb9 admin admin] PATH_INFO: `/v3/projects/62f48f7c1a8a4f58a2692d9f08a20937/users/dad4827cda8448ab8a27cd87bee2f444/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:14.325006 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ee147-383e-4a20-87c5-961db3b86eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f48f7c1a8a4f58a2692d9f08a20937, user_id=dad4827cda8448ab8a27cd87bee2f444, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:14.327732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ee147-383e-4a20-87c5-961db3b86eb9 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:14.387265 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1397/2812] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:14 2022] PUT /identity/v3/projects/62f48f7c1a8a4f58a2692d9f08a20937/users/dad4827cda8448ab8a27cd87bee2f444/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:14.397768 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc56249-b4ba-4ad9-9c1b-b3a9297278bd None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:14.398111 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc56249-b4ba-4ad9-9c1b-b3a9297278bd None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:14.398460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc56249-b4ba-4ad9-9c1b-b3a9297278bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:14.426388 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9cc56249-b4ba-4ad9-9c1b-b3a9297278bd None None] MFA Rules not processed for user `dad4827cda8448ab8a27cd87bee2f444`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:14.427689 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9cc56249-b4ba-4ad9-9c1b-b3a9297278bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:14.490702 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1416/2813] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:14.495750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ee147-383e-4a20-87c5-961db3b86eb9 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:14.517523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:14.559004 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ee147-383e-4a20-87c5-961db3b86eb9 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:14.563661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894c271-0896-4808-886c-731b3aeaf849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:14.564277 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894c271-0896-4808-886c-731b3aeaf849 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:14.570616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894c271-0896-4808-886c-731b3aeaf849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:14.570616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894c271-0896-4808-886c-731b3aeaf849 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:14.570616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894c271-0896-4808-886c-731b3aeaf849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:14.570616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894c271-0896-4808-886c-731b3aeaf849 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:14.652883 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1398/2814] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:48:14 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:14.657167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc56249-b4ba-4ad9-9c1b-b3a9297278bd None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:14.668918 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc56249-b4ba-4ad9-9c1b-b3a9297278bd None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:14.724718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e03b2-158d-446e-aa1e-8293237b2180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:14.725334 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e03b2-158d-446e-aa1e-8293237b2180 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:14.725616 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e03b2-158d-446e-aa1e-8293237b2180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:14.725896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e03b2-158d-446e-aa1e-8293237b2180 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:14.726606 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e03b2-158d-446e-aa1e-8293237b2180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:14.728707 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e03b2-158d-446e-aa1e-8293237b2180 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:14.794227 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1417/2815] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:48:14 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:14.798230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894c271-0896-4808-886c-731b3aeaf849 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:14.809224 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894c271-0896-4808-886c-731b3aeaf849 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:14.813837 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618aca2-e503-4d23-9b10-b449b9e9ab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:14.814447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618aca2-e503-4d23-9b10-b449b9e9ab46 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:14.814761 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618aca2-e503-4d23-9b10-b449b9e9ab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:14.815043 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618aca2-e503-4d23-9b10-b449b9e9ab46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:14.815733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618aca2-e503-4d23-9b10-b449b9e9ab46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:14.817340 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618aca2-e503-4d23-9b10-b449b9e9ab46 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:14.828420 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1399/2816] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:14.832709 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e03b2-158d-446e-aa1e-8293237b2180 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:14.843216 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e03b2-158d-446e-aa1e-8293237b2180 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:14.847949 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9a73f-2f6b-4e3d-b855-6d33f096cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:14.848607 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9a73f-2f6b-4e3d-b855-6d33f096cb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:14.848894 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9a73f-2f6b-4e3d-b855-6d33f096cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:14.849177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9a73f-2f6b-4e3d-b855-6d33f096cb1b admin admin] PATH_INFO: `/v3/projects/1efaa20dc25c496ab0cf3ad0b1272be4/users/ee8ee7a7d10b4eafa6f2365f2acac24a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:14.863555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9a73f-2f6b-4e3d-b855-6d33f096cb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efaa20dc25c496ab0cf3ad0b1272be4, user_id=ee8ee7a7d10b4eafa6f2365f2acac24a, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:14.866214 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9a73f-2f6b-4e3d-b855-6d33f096cb1b admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:14.929140 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:14.935316 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1418/2817] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:14 2022] PUT /identity/v3/projects/1efaa20dc25c496ab0cf3ad0b1272be4/users/ee8ee7a7d10b4eafa6f2365f2acac24a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:14.939374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618aca2-e503-4d23-9b10-b449b9e9ab46 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:14.949213 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618aca2-e503-4d23-9b10-b449b9e9ab46 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:15.006696 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482dc9ad-89e7-4c36-be39-7f4d7c523cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:15.007762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dc9ad-89e7-4c36-be39-7f4d7c523cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:15.007762 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dc9ad-89e7-4c36-be39-7f4d7c523cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:15.008035 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dc9ad-89e7-4c36-be39-7f4d7c523cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:15.008663 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482dc9ad-89e7-4c36-be39-7f4d7c523cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:15.010290 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482dc9ad-89e7-4c36-be39-7f4d7c523cb6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:15.020828 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1400/2818] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:48:15.025684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9a73f-2f6b-4e3d-b855-6d33f096cb1b admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:15.035948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9a73f-2f6b-4e3d-b855-6d33f096cb1b admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:15.041367 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd3fae-2853-416f-8e97-628d19ffc799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:15.042049 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd3fae-2853-416f-8e97-628d19ffc799 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:15.042324 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd3fae-2853-416f-8e97-628d19ffc799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:15.042636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd3fae-2853-416f-8e97-628d19ffc799 admin admin] PATH_INFO: `/v3/projects/1efaa20dc25c496ab0cf3ad0b1272be4/users/ee8ee7a7d10b4eafa6f2365f2acac24a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:15.044705 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd3fae-2853-416f-8e97-628d19ffc799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efaa20dc25c496ab0cf3ad0b1272be4, user_id=ee8ee7a7d10b4eafa6f2365f2acac24a, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:15.047326 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd3fae-2853-416f-8e97-628d19ffc799 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:15.058516 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1419/2819] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:15 2022] PUT /identity/v3/projects/1efaa20dc25c496ab0cf3ad0b1272be4/users/ee8ee7a7d10b4eafa6f2365f2acac24a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:15.068671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297579c8-d693-4b5c-90f6-0b91e4df5333 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:15.068995 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297579c8-d693-4b5c-90f6-0b91e4df5333 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:15.069281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297579c8-d693-4b5c-90f6-0b91e4df5333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:15.097950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-297579c8-d693-4b5c-90f6-0b91e4df5333 None None] MFA Rules not processed for user `ee8ee7a7d10b4eafa6f2365f2acac24a`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:15.099204 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-297579c8-d693-4b5c-90f6-0b91e4df5333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:15.167662 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1401/2820] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:15.178858 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd3fae-2853-416f-8e97-628d19ffc799 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:15.180556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a3fd3fae-2853-416f-8e97-628d19ffc799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:15.239513 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd3fae-2853-416f-8e97-628d19ffc799 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:15.243273 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030f92e-61ff-412d-a7fa-d77210e64e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:15.244546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030f92e-61ff-412d-a7fa-d77210e64e6d service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:15.244938 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030f92e-61ff-412d-a7fa-d77210e64e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:15.245220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030f92e-61ff-412d-a7fa-d77210e64e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:15.254433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030f92e-61ff-412d-a7fa-d77210e64e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:15.255898 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030f92e-61ff-412d-a7fa-d77210e64e6d service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:15.265461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1420/2821] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:48:16.148395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297579c8-d693-4b5c-90f6-0b91e4df5333 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:16.166869 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:16.211849 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297579c8-d693-4b5c-90f6-0b91e4df5333 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:16.216469 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:16.217095 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:16.217374 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:16.217644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] PATH_INFO: `/v3/users/dad4827cda8448ab8a27cd87bee2f444` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:16.218826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad4827cda8448ab8a27cd87bee2f444)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:16.220797 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:16.384190 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad4827cda8448ab8a27cd87bee2f444'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:16.396874 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad4827cda8448ab8a27cd87bee2f444'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:16.397751 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad4827cda8448ab8a27cd87bee2f444'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:16.404796 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad4827cda8448ab8a27cd87bee2f444'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:16.456856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad4827cda8448ab8a27cd87bee2f444'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:16.463085 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1402/2822] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:48:16 2022] DELETE /identity/v3/users/dad4827cda8448ab8a27cd87bee2f444 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:16.467766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4c2bd-2a5a-4dc7-a6c5-90b91828e073 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:16.470907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4c2bd-2a5a-4dc7-a6c5-90b91828e073 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:16.470907 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4c2bd-2a5a-4dc7-a6c5-90b91828e073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:16.488870 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-2aa4c2bd-2a5a-4dc7-a6c5-90b91828e073 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:16.490084 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2aa4c2bd-2a5a-4dc7-a6c5-90b91828e073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:16.548546 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1421/2823] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:16.558448 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:16.559872 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:16.616297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a11de1-f9d3-4e0d-b490-8d3c3abc28bf admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:16.620049 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffcee8-f9ad-49c7-9f9d-c9a95057d524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:16.620661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffcee8-f9ad-49c7-9f9d-c9a95057d524 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:16.620950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffcee8-f9ad-49c7-9f9d-c9a95057d524 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:16.621232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffcee8-f9ad-49c7-9f9d-c9a95057d524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:16.630162 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffcee8-f9ad-49c7-9f9d-c9a95057d524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:16.631636 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffcee8-f9ad-49c7-9f9d-c9a95057d524 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:16.641537 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1403/2824] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:48:17.056698 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4c2bd-2a5a-4dc7-a6c5-90b91828e073 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:17.058758 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-2aa4c2bd-2a5a-4dc7-a6c5-90b91828e073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:17.071040 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4c2bd-2a5a-4dc7-a6c5-90b91828e073 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:17.076466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:17.077138 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:17.077441 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:17.077716 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] PATH_INFO: `/v3/projects/62f48f7c1a8a4f58a2692d9f08a20937` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:17.078913 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62f48f7c1a8a4f58a2692d9f08a20937)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:17.080812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:17.197887 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f48f7c1a8a4f58a2692d9f08a20937', 'request_id': 'req-d1fac245-8087-4280-96ac-c910e4f87c59'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:17.265608 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f48f7c1a8a4f58a2692d9f08a20937', 'request_id': 'req-d1fac245-8087-4280-96ac-c910e4f87c59'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:17.271527 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f48f7c1a8a4f58a2692d9f08a20937', 'request_id': 'req-d1fac245-8087-4280-96ac-c910e4f87c59'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:17.284032 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] The token cache is being invalidate because project 62f48f7c1a8a4f58a2692d9f08a20937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:48:17.284322 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:17.284952 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:17.286463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1422/2825] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:48:17 2022] DELETE /identity/v3/projects/62f48f7c1a8a4f58a2692d9f08a20937 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:17.291201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffcee8-f9ad-49c7-9f9d-c9a95057d524 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:17.301175 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffcee8-f9ad-49c7-9f9d-c9a95057d524 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:17.335407 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:17.358790 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353b8ec-74b4-42c6-bee8-a5e019c92cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:17.364966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353b8ec-74b4-42c6-bee8-a5e019c92cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:17.364966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353b8ec-74b4-42c6-bee8-a5e019c92cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:17.364966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353b8ec-74b4-42c6-bee8-a5e019c92cb4 admin admin] PATH_INFO: `/v3/users/ee8ee7a7d10b4eafa6f2365f2acac24a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:17.364966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353b8ec-74b4-42c6-bee8-a5e019c92cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8ee7a7d10b4eafa6f2365f2acac24a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:17.364966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353b8ec-74b4-42c6-bee8-a5e019c92cb4 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:17.558578 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b353b8ec-74b4-42c6-bee8-a5e019c92cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8ee7a7d10b4eafa6f2365f2acac24a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:17.569941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b353b8ec-74b4-42c6-bee8-a5e019c92cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8ee7a7d10b4eafa6f2365f2acac24a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:17.570646 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b353b8ec-74b4-42c6-bee8-a5e019c92cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8ee7a7d10b4eafa6f2365f2acac24a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:17.577528 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b353b8ec-74b4-42c6-bee8-a5e019c92cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8ee7a7d10b4eafa6f2365f2acac24a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:17.654067 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b353b8ec-74b4-42c6-bee8-a5e019c92cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8ee7a7d10b4eafa6f2365f2acac24a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:17.661135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1404/2826] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:48:17 2022] DELETE /identity/v3/users/ee8ee7a7d10b4eafa6f2365f2acac24a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:18.095847 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:18.097303 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:18.112551 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fac245-8087-4280-96ac-c910e4f87c59 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:18.122814 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:18.177090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350bd25-9a7f-48ef-a59a-df5e2f909173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:18.177739 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350bd25-9a7f-48ef-a59a-df5e2f909173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:18.178023 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350bd25-9a7f-48ef-a59a-df5e2f909173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:18.178323 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350bd25-9a7f-48ef-a59a-df5e2f909173 admin admin] PATH_INFO: `/v3/projects/1efaa20dc25c496ab0cf3ad0b1272be4` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:18.179621 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350bd25-9a7f-48ef-a59a-df5e2f909173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1efaa20dc25c496ab0cf3ad0b1272be4)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:18.183015 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350bd25-9a7f-48ef-a59a-df5e2f909173 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:18.282247 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e350bd25-9a7f-48ef-a59a-df5e2f909173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1efaa20dc25c496ab0cf3ad0b1272be4', 'request_id': 'req-e350bd25-9a7f-48ef-a59a-df5e2f909173'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:18.342885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e350bd25-9a7f-48ef-a59a-df5e2f909173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1efaa20dc25c496ab0cf3ad0b1272be4', 'request_id': 'req-e350bd25-9a7f-48ef-a59a-df5e2f909173'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:18.349726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e350bd25-9a7f-48ef-a59a-df5e2f909173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1efaa20dc25c496ab0cf3ad0b1272be4', 'request_id': 'req-e350bd25-9a7f-48ef-a59a-df5e2f909173'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:18.362719 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e350bd25-9a7f-48ef-a59a-df5e2f909173 admin admin] The token cache is being invalidate because project 1efaa20dc25c496ab0cf3ad0b1272be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:48:18.363014 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e350bd25-9a7f-48ef-a59a-df5e2f909173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:18.363667 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e350bd25-9a7f-48ef-a59a-df5e2f909173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:18.365191 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1423/2827] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:48:18 2022] DELETE /identity/v3/projects/1efaa20dc25c496ab0cf3ad0b1272be4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:18.370694 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874df414-17fb-4e8e-9b85-e74178664dde None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:18.371447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874df414-17fb-4e8e-9b85-e74178664dde None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:18.371447 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874df414-17fb-4e8e-9b85-e74178664dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:18.391393 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-874df414-17fb-4e8e-9b85-e74178664dde None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:18.392624 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-874df414-17fb-4e8e-9b85-e74178664dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:18.457117 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1405/2828] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:18.473016 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19627c3a-d5ec-4ce9-8b80-cb5473d1cd72 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:18.473352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19627c3a-d5ec-4ce9-8b80-cb5473d1cd72 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:18.473637 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19627c3a-d5ec-4ce9-8b80-cb5473d1cd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:18.494987 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-19627c3a-d5ec-4ce9-8b80-cb5473d1cd72 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:18.496220 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-19627c3a-d5ec-4ce9-8b80-cb5473d1cd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:18.504603 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1424/2829] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:18.508910 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874df414-17fb-4e8e-9b85-e74178664dde None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:18.520515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874df414-17fb-4e8e-9b85-e74178664dde None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:18.527226 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6446a06-d057-4fad-962e-a1bcd43782c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:18.527852 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6446a06-d057-4fad-962e-a1bcd43782c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:18.528135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6446a06-d057-4fad-962e-a1bcd43782c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:18.528415 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6446a06-d057-4fad-962e-a1bcd43782c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:18.529114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6446a06-d057-4fad-962e-a1bcd43782c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:48:18.529418 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6446a06-d057-4fad-962e-a1bcd43782c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:18.531170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6446a06-d057-4fad-962e-a1bcd43782c7 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:18.544457 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1406/2830] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:48:18.549039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19627c3a-d5ec-4ce9-8b80-cb5473d1cd72 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:18.558883 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19627c3a-d5ec-4ce9-8b80-cb5473d1cd72 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:18.564408 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431321d7-9844-4407-b3c6-8db1e4ba37be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:18.565026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431321d7-9844-4407-b3c6-8db1e4ba37be admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:18.565311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431321d7-9844-4407-b3c6-8db1e4ba37be admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:18.565592 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431321d7-9844-4407-b3c6-8db1e4ba37be admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:18.566266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431321d7-9844-4407-b3c6-8db1e4ba37be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:18.568512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431321d7-9844-4407-b3c6-8db1e4ba37be admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:18.647576 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1425/2831] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:48:18 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:18.652664 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6446a06-d057-4fad-962e-a1bcd43782c7 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:18.664107 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6446a06-d057-4fad-962e-a1bcd43782c7 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:18.710170 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:18.725671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3116e66-6a6b-4dfc-b037-ecfaac40f9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:18.726297 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3116e66-6a6b-4dfc-b037-ecfaac40f9ac admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:18.731329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3116e66-6a6b-4dfc-b037-ecfaac40f9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:18.731329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3116e66-6a6b-4dfc-b037-ecfaac40f9ac admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:18.731329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3116e66-6a6b-4dfc-b037-ecfaac40f9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:18.731329 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3116e66-6a6b-4dfc-b037-ecfaac40f9ac admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:18.807254 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1407/2832] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:48:18 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:18.812125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431321d7-9844-4407-b3c6-8db1e4ba37be admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:18.825311 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431321d7-9844-4407-b3c6-8db1e4ba37be admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:18.831076 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96846bd-736c-4dcc-9dcf-5b558fdf35ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:18.831687 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96846bd-736c-4dcc-9dcf-5b558fdf35ac admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:18.831978 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96846bd-736c-4dcc-9dcf-5b558fdf35ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:18.833930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96846bd-736c-4dcc-9dcf-5b558fdf35ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:18.834684 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96846bd-736c-4dcc-9dcf-5b558fdf35ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:18.838553 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96846bd-736c-4dcc-9dcf-5b558fdf35ac admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:18.850208 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1426/2833] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:18.855432 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3116e66-6a6b-4dfc-b037-ecfaac40f9ac admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:18.865841 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3116e66-6a6b-4dfc-b037-ecfaac40f9ac admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:18.872567 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69327b3c-b6db-48a3-8f53-21195924e585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:18.873375 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69327b3c-b6db-48a3-8f53-21195924e585 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:18.873658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69327b3c-b6db-48a3-8f53-21195924e585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:18.873940 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69327b3c-b6db-48a3-8f53-21195924e585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:18.874679 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69327b3c-b6db-48a3-8f53-21195924e585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:18.876471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69327b3c-b6db-48a3-8f53-21195924e585 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:18.892477 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1408/2834] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:18.896664 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96846bd-736c-4dcc-9dcf-5b558fdf35ac admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:18.908562 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96846bd-736c-4dcc-9dcf-5b558fdf35ac admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:18.913281 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04977d68-581e-40da-95e9-f8204c1de0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:18.916442 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04977d68-581e-40da-95e9-f8204c1de0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:18.916726 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04977d68-581e-40da-95e9-f8204c1de0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:18.917003 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04977d68-581e-40da-95e9-f8204c1de0a5 admin admin] PATH_INFO: `/v3/projects/cfa67651c5b0494aab680acdbe6342c9/users/686267752788442ab7d4dc4d8c8f0bd1/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:18.939772 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04977d68-581e-40da-95e9-f8204c1de0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa67651c5b0494aab680acdbe6342c9, user_id=686267752788442ab7d4dc4d8c8f0bd1, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:18.942606 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04977d68-581e-40da-95e9-f8204c1de0a5 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:19.008880 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1427/2835] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:18 2022] PUT /identity/v3/projects/cfa67651c5b0494aab680acdbe6342c9/users/686267752788442ab7d4dc4d8c8f0bd1/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:19.019427 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8defc3-956a-42f6-8bca-1c0c034045d1 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:19.019726 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8defc3-956a-42f6-8bca-1c0c034045d1 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:19.020010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8defc3-956a-42f6-8bca-1c0c034045d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:19.050875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-ce8defc3-956a-42f6-8bca-1c0c034045d1 None None] MFA Rules not processed for user `686267752788442ab7d4dc4d8c8f0bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:19.052102 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-ce8defc3-956a-42f6-8bca-1c0c034045d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:19.117630 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1409/2836] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:19.122366 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04977d68-581e-40da-95e9-f8204c1de0a5 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:19.163570 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:19.184782 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04977d68-581e-40da-95e9-f8204c1de0a5 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:19.189667 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c236f-315a-48e2-bc9e-4bc23263a6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:19.190300 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c236f-315a-48e2-bc9e-4bc23263a6ef admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:19.190835 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c236f-315a-48e2-bc9e-4bc23263a6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:19.191337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c236f-315a-48e2-bc9e-4bc23263a6ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:19.192100 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c236f-315a-48e2-bc9e-4bc23263a6ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:19.194466 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c236f-315a-48e2-bc9e-4bc23263a6ef admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:19.301850 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1428/2837] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:48:19 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:48:19.306824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8defc3-956a-42f6-8bca-1c0c034045d1 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:19.317517 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8defc3-956a-42f6-8bca-1c0c034045d1 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:19.374424 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd34d-5a2f-4715-9621-903073000900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:19.375271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd34d-5a2f-4715-9621-903073000900 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:19.375561 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd34d-5a2f-4715-9621-903073000900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:19.375842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd34d-5a2f-4715-9621-903073000900 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:19.376505 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd34d-5a2f-4715-9621-903073000900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:19.378466 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd34d-5a2f-4715-9621-903073000900 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:19.502901 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1410/2838] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:48:19 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:19.506959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c236f-315a-48e2-bc9e-4bc23263a6ef admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:19.517444 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c236f-315a-48e2-bc9e-4bc23263a6ef admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:19.522048 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180309-cfe4-4830-b542-f0efaf669777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:19.522945 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180309-cfe4-4830-b542-f0efaf669777 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:19.523255 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180309-cfe4-4830-b542-f0efaf669777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:19.523613 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180309-cfe4-4830-b542-f0efaf669777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:19.524342 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180309-cfe4-4830-b542-f0efaf669777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:19.526229 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180309-cfe4-4830-b542-f0efaf669777 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:19.536217 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1429/2839] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:19.540199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd34d-5a2f-4715-9621-903073000900 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:19.550888 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd34d-5a2f-4715-9621-903073000900 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:19.555503 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ee33d-4c77-40e2-b610-b55672b8e2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:19.556843 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ee33d-4c77-40e2-b610-b55672b8e2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:19.557174 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ee33d-4c77-40e2-b610-b55672b8e2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:19.557482 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ee33d-4c77-40e2-b610-b55672b8e2c4 admin admin] PATH_INFO: `/v3/projects/9b14e74010304ca2a9afe6deb0679b36/users/07166710bb664115bafe5e5802067b4a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:19.572404 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ee33d-4c77-40e2-b610-b55672b8e2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b14e74010304ca2a9afe6deb0679b36, user_id=07166710bb664115bafe5e5802067b4a, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:19.575129 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ee33d-4c77-40e2-b610-b55672b8e2c4 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:19.645612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1411/2840] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:19 2022] PUT /identity/v3/projects/9b14e74010304ca2a9afe6deb0679b36/users/07166710bb664115bafe5e5802067b4a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:19.649884 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180309-cfe4-4830-b542-f0efaf669777 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:19.659948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180309-cfe4-4830-b542-f0efaf669777 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:19.716822 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1440682-e493-4ec3-bb0d-0705da627422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:19.717439 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1440682-e493-4ec3-bb0d-0705da627422 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:19.717728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1440682-e493-4ec3-bb0d-0705da627422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:19.718007 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1440682-e493-4ec3-bb0d-0705da627422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:19.718738 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1440682-e493-4ec3-bb0d-0705da627422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:19.720363 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1440682-e493-4ec3-bb0d-0705da627422 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:19.730460 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1430/2841] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:19.734543 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ee33d-4c77-40e2-b610-b55672b8e2c4 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:19.745570 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ee33d-4c77-40e2-b610-b55672b8e2c4 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:19.750152 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a4e4c-4183-4eae-95ba-eedcb153974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:19.750842 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a4e4c-4183-4eae-95ba-eedcb153974d admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:19.751128 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a4e4c-4183-4eae-95ba-eedcb153974d admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:19.751405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a4e4c-4183-4eae-95ba-eedcb153974d admin admin] PATH_INFO: `/v3/projects/9b14e74010304ca2a9afe6deb0679b36/users/07166710bb664115bafe5e5802067b4a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:19.753417 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a4e4c-4183-4eae-95ba-eedcb153974d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b14e74010304ca2a9afe6deb0679b36, user_id=07166710bb664115bafe5e5802067b4a, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:19.756039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a4e4c-4183-4eae-95ba-eedcb153974d admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:19.766997 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1412/2842] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:19 2022] PUT /identity/v3/projects/9b14e74010304ca2a9afe6deb0679b36/users/07166710bb664115bafe5e5802067b4a/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:19.779223 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890b0fd-ba41-4bc9-ba11-15ae2efa2e37 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:19.779538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890b0fd-ba41-4bc9-ba11-15ae2efa2e37 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:19.779821 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890b0fd-ba41-4bc9-ba11-15ae2efa2e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:19.807956 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-a890b0fd-ba41-4bc9-ba11-15ae2efa2e37 None None] MFA Rules not processed for user `07166710bb664115bafe5e5802067b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:19.809174 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a890b0fd-ba41-4bc9-ba11-15ae2efa2e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:19.877674 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1431/2843] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:19.888770 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a4e4c-4183-4eae-95ba-eedcb153974d admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:19.890544 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4c1a4e4c-4183-4eae-95ba-eedcb153974d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:19.897015 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:19.948844 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a4e4c-4183-4eae-95ba-eedcb153974d admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:19.953007 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93193347-f0de-4781-a15e-434caa12263e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:19.953622 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93193347-f0de-4781-a15e-434caa12263e service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:19.953908 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93193347-f0de-4781-a15e-434caa12263e service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:19.954187 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93193347-f0de-4781-a15e-434caa12263e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:19.964060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93193347-f0de-4781-a15e-434caa12263e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:19.965564 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93193347-f0de-4781-a15e-434caa12263e service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:19.975366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1413/2844] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:48:20.118155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890b0fd-ba41-4bc9-ba11-15ae2efa2e37 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:20.119622 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-a890b0fd-ba41-4bc9-ba11-15ae2efa2e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:20.131634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890b0fd-ba41-4bc9-ba11-15ae2efa2e37 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:20.135259 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ebda1-9fd1-493d-8bfc-fa1d49774280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:20.135866 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ebda1-9fd1-493d-8bfc-fa1d49774280 service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:20.136152 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ebda1-9fd1-493d-8bfc-fa1d49774280 service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:20.136484 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ebda1-9fd1-493d-8bfc-fa1d49774280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:20.167193 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:20.192959 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ebda1-9fd1-493d-8bfc-fa1d49774280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:20.194432 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ebda1-9fd1-493d-8bfc-fa1d49774280 service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:20.203855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1432/2845] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:48:25.071483 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93193347-f0de-4781-a15e-434caa12263e service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:25.133341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93193347-f0de-4781-a15e-434caa12263e service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:25.138260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:25.138925 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:25.139206 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:25.139481 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] PATH_INFO: `/v3/users/686267752788442ab7d4dc4d8c8f0bd1` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:25.140705 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=686267752788442ab7d4dc4d8c8f0bd1)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:25.142593 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:25.344794 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686267752788442ab7d4dc4d8c8f0bd1'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:25.357038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686267752788442ab7d4dc4d8c8f0bd1'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:25.361666 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686267752788442ab7d4dc4d8c8f0bd1'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:25.364873 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686267752788442ab7d4dc4d8c8f0bd1'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:25.514002 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686267752788442ab7d4dc4d8c8f0bd1'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:25.520453 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1414/2846] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:48:25 2022] DELETE /identity/v3/users/686267752788442ab7d4dc4d8c8f0bd1 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:25.531284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe4c2-d337-4d33-99dd-e258d8239af9 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:25.531788 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe4c2-d337-4d33-99dd-e258d8239af9 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:25.531886 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe4c2-d337-4d33-99dd-e258d8239af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:25.551211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-23dbe4c2-d337-4d33-99dd-e258d8239af9 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:25.552463 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-23dbe4c2-d337-4d33-99dd-e258d8239af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:25.614656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1433/2847] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:25.625148 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:25.626597 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:25.657471 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:25.683708 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6fbf9-48ae-45e2-a1d3-9cf2cf2fcef3 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:25.687336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26198a2e-ae4a-4d44-9c6e-c16c56355c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:25.687988 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26198a2e-ae4a-4d44-9c6e-c16c56355c59 service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:25.688271 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26198a2e-ae4a-4d44-9c6e-c16c56355c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:25.688547 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26198a2e-ae4a-4d44-9c6e-c16c56355c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:25.697888 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26198a2e-ae4a-4d44-9c6e-c16c56355c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:25.699365 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26198a2e-ae4a-4d44-9c6e-c16c56355c59 service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:25.708691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1415/2848] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:48:26.081399 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbe4c2-d337-4d33-99dd-e258d8239af9 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:26.082997 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-23dbe4c2-d337-4d33-99dd-e258d8239af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:26.095951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbe4c2-d337-4d33-99dd-e258d8239af9 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:26.100815 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:26.101481 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:26.101765 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:26.102080 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] PATH_INFO: `/v3/projects/cfa67651c5b0494aab680acdbe6342c9` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:26.103224 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa67651c5b0494aab680acdbe6342c9)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:26.106026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:26.188461 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa67651c5b0494aab680acdbe6342c9', 'request_id': 'req-e41f52be-9299-4b48-8016-b3521ec83390'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:26.233796 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa67651c5b0494aab680acdbe6342c9', 'request_id': 'req-e41f52be-9299-4b48-8016-b3521ec83390'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:26.239429 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa67651c5b0494aab680acdbe6342c9', 'request_id': 'req-e41f52be-9299-4b48-8016-b3521ec83390'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:26.251125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] The token cache is being invalidate because project cfa67651c5b0494aab680acdbe6342c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:48:26.251410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:26.252160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:26.253652 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1434/2849] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:48:26 2022] DELETE /identity/v3/projects/cfa67651c5b0494aab680acdbe6342c9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:26.257656 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26198a2e-ae4a-4d44-9c6e-c16c56355c59 service neutron] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:26.268079 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26198a2e-ae4a-4d44-9c6e-c16c56355c59 service neutron] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:26.324234 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe23d6-22d1-4842-abc7-fdb827c4802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:26.324792 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe23d6-22d1-4842-abc7-fdb827c4802e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:26.325083 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe23d6-22d1-4842-abc7-fdb827c4802e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:26.325360 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe23d6-22d1-4842-abc7-fdb827c4802e admin admin] PATH_INFO: `/v3/users/07166710bb664115bafe5e5802067b4a` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:26.326539 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe23d6-22d1-4842-abc7-fdb827c4802e admin admin] RBAC: Authorizing `identity:delete_user(user_id=07166710bb664115bafe5e5802067b4a)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:26.328455 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe23d6-22d1-4842-abc7-fdb827c4802e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:26.493781 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-63fe23d6-22d1-4842-abc7-fdb827c4802e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07166710bb664115bafe5e5802067b4a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:26.506462 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-63fe23d6-22d1-4842-abc7-fdb827c4802e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07166710bb664115bafe5e5802067b4a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:26.507179 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-63fe23d6-22d1-4842-abc7-fdb827c4802e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07166710bb664115bafe5e5802067b4a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:26.514180 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-63fe23d6-22d1-4842-abc7-fdb827c4802e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07166710bb664115bafe5e5802067b4a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:26.579661 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-63fe23d6-22d1-4842-abc7-fdb827c4802e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07166710bb664115bafe5e5802067b4a'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:26.586031 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1416/2850] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:48:26 2022] DELETE /identity/v3/users/07166710bb664115bafe5e5802067b4a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:27.024150 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:27.025661 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:27.040630 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f52be-9299-4b48-8016-b3521ec83390 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:27.094891 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:27.101658 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:27.103321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:27.103321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:27.103321 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0 admin admin] PATH_INFO: `/v3/projects/9b14e74010304ca2a9afe6deb0679b36` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:27.104072 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b14e74010304ca2a9afe6deb0679b36)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:27.106270 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:27.219307 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b14e74010304ca2a9afe6deb0679b36', 'request_id': 'req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:27.305139 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b14e74010304ca2a9afe6deb0679b36', 'request_id': 'req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:27.311148 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b14e74010304ca2a9afe6deb0679b36', 'request_id': 'req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:27.322447 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0 admin admin] The token cache is being invalidate because project 9b14e74010304ca2a9afe6deb0679b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:48:27.322778 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:27.323512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-96ef6e11-1c8a-47d0-bec7-3455132d4fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:27.325018 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1435/2851] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:48:27 2022] DELETE /identity/v3/projects/9b14e74010304ca2a9afe6deb0679b36 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:27.329998 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a06af-f925-4632-a412-0d6880274416 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:27.330501 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a06af-f925-4632-a412-0d6880274416 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:27.330615 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a06af-f925-4632-a412-0d6880274416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:27.350298 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-863a06af-f925-4632-a412-0d6880274416 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:27.351523 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-863a06af-f925-4632-a412-0d6880274416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:27.395382 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:27.411135 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1417/2852] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:27.419304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be0b2e-3fb1-4bc8-a7eb-6e3441b35492 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:27.419629 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be0b2e-3fb1-4bc8-a7eb-6e3441b35492 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:27.419868 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be0b2e-3fb1-4bc8-a7eb-6e3441b35492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:27.439566 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f3be0b2e-3fb1-4bc8-a7eb-6e3441b35492 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:27.440753 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f3be0b2e-3fb1-4bc8-a7eb-6e3441b35492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:27.449120 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1436/2853] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:27.453192 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a06af-f925-4632-a412-0d6880274416 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:27.462861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a06af-f925-4632-a412-0d6880274416 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:27.468313 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb5f07-a475-4583-9fa8-f971b53897e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:27.468921 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb5f07-a475-4583-9fa8-f971b53897e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:27.469199 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb5f07-a475-4583-9fa8-f971b53897e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:27.469522 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb5f07-a475-4583-9fa8-f971b53897e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:27.470161 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb5f07-a475-4583-9fa8-f971b53897e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:48:27.470467 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb5f07-a475-4583-9fa8-f971b53897e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:27.472085 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb5f07-a475-4583-9fa8-f971b53897e9 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:27.484110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1418/2854] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:48:27.488452 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be0b2e-3fb1-4bc8-a7eb-6e3441b35492 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:27.497908 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be0b2e-3fb1-4bc8-a7eb-6e3441b35492 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:27.503806 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808760f1-5514-4c10-bf50-dd3dd4108feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:27.504433 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808760f1-5514-4c10-bf50-dd3dd4108feb admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:27.504696 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808760f1-5514-4c10-bf50-dd3dd4108feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:27.504973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808760f1-5514-4c10-bf50-dd3dd4108feb admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:27.505667 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808760f1-5514-4c10-bf50-dd3dd4108feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:27.507650 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808760f1-5514-4c10-bf50-dd3dd4108feb admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:27.589490 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1437/2855] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:48:27 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:27.593736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb5f07-a475-4583-9fa8-f971b53897e9 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:27.604017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb5f07-a475-4583-9fa8-f971b53897e9 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:27.664489 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17929698-f24f-487f-a69b-c76a585fdc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:27.665106 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17929698-f24f-487f-a69b-c76a585fdc3c admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:27.665414 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17929698-f24f-487f-a69b-c76a585fdc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:27.665714 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17929698-f24f-487f-a69b-c76a585fdc3c admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:27.666383 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17929698-f24f-487f-a69b-c76a585fdc3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:27.669104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17929698-f24f-487f-a69b-c76a585fdc3c admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:27.749230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1419/2856] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:48:27 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:48:27.753350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808760f1-5514-4c10-bf50-dd3dd4108feb admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:27.764034 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808760f1-5514-4c10-bf50-dd3dd4108feb admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:27.768728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ee849-8d76-4fa0-833e-761d91682273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:27.769332 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee849-8d76-4fa0-833e-761d91682273 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:27.769617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee849-8d76-4fa0-833e-761d91682273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:27.769896 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee849-8d76-4fa0-833e-761d91682273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:27.770636 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ee849-8d76-4fa0-833e-761d91682273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:27.772538 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ee849-8d76-4fa0-833e-761d91682273 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:27.782651 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1438/2857] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:27.786893 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17929698-f24f-487f-a69b-c76a585fdc3c admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:27.797260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17929698-f24f-487f-a69b-c76a585fdc3c admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:27.802201 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a0730-8606-46bc-a15b-14d345de095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:27.802840 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0730-8606-46bc-a15b-14d345de095d admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:27.803232 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0730-8606-46bc-a15b-14d345de095d admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:27.803515 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0730-8606-46bc-a15b-14d345de095d admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:27.804211 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a0730-8606-46bc-a15b-14d345de095d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:27.805896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a0730-8606-46bc-a15b-14d345de095d admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:27.817836 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1420/2858] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:27.821922 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ee849-8d76-4fa0-833e-761d91682273 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:27.832197 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ee849-8d76-4fa0-833e-761d91682273 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:27.836792 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500db9-8bb4-40ed-bb72-c6777b563037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:27.837524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500db9-8bb4-40ed-bb72-c6777b563037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:27.837810 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500db9-8bb4-40ed-bb72-c6777b563037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:27.838089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500db9-8bb4-40ed-bb72-c6777b563037 admin admin] PATH_INFO: `/v3/projects/fd0c41b72ad4444c94e41a9ecc0dc418/users/8ecfe1363c5f47ba8fb1bb0daf688314/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:27.852582 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500db9-8bb4-40ed-bb72-c6777b563037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0c41b72ad4444c94e41a9ecc0dc418, user_id=8ecfe1363c5f47ba8fb1bb0daf688314, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:27.855812 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500db9-8bb4-40ed-bb72-c6777b563037 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:27.913710 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1439/2859] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:27 2022] PUT /identity/v3/projects/fd0c41b72ad4444c94e41a9ecc0dc418/users/8ecfe1363c5f47ba8fb1bb0daf688314/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:27.924136 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd956b0-2c79-4357-8f4c-ec7f601d9728 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:27.924460 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd956b0-2c79-4357-8f4c-ec7f601d9728 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:27.924743 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd956b0-2c79-4357-8f4c-ec7f601d9728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:27.953386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-fdd956b0-2c79-4357-8f4c-ec7f601d9728 None None] MFA Rules not processed for user `8ecfe1363c5f47ba8fb1bb0daf688314`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:27.954660 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-fdd956b0-2c79-4357-8f4c-ec7f601d9728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:28.020088 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1421/2860] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:28.031639 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500db9-8bb4-40ed-bb72-c6777b563037 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:28.033314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-b1500db9-8bb4-40ed-bb72-c6777b563037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:28.091974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500db9-8bb4-40ed-bb72-c6777b563037 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:28.095786 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b511bda-17cf-4ce5-be93-bf0b08d2559e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:28.096408 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b511bda-17cf-4ce5-be93-bf0b08d2559e service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:28.096690 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b511bda-17cf-4ce5-be93-bf0b08d2559e service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:28.096964 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b511bda-17cf-4ce5-be93-bf0b08d2559e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:28.106089 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b511bda-17cf-4ce5-be93-bf0b08d2559e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:28.107571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b511bda-17cf-4ce5-be93-bf0b08d2559e service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:28.116177 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1440/2861] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:48:32.039789 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd956b0-2c79-4357-8f4c-ec7f601d9728 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:32.088230 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:32.105707 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd956b0-2c79-4357-8f4c-ec7f601d9728 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:32.110733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:32.111379 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:32.111667 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:32.111950 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] PATH_INFO: `/v3/users/8ecfe1363c5f47ba8fb1bb0daf688314` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:32.113168 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ecfe1363c5f47ba8fb1bb0daf688314)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:32.115678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:32.325158 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ecfe1363c5f47ba8fb1bb0daf688314'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:32.337354 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ecfe1363c5f47ba8fb1bb0daf688314'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:32.338014 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ecfe1363c5f47ba8fb1bb0daf688314'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:32.345604 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ecfe1363c5f47ba8fb1bb0daf688314'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:32.421875 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ecfe1363c5f47ba8fb1bb0daf688314'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:32.428260 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1422/2862] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:48:32 2022] DELETE /identity/v3/users/8ecfe1363c5f47ba8fb1bb0daf688314 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:32.432936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685491b5-473e-4273-8c33-c235d7f7e259 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:32.433390 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685491b5-473e-4273-8c33-c235d7f7e259 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:32.433503 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685491b5-473e-4273-8c33-c235d7f7e259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:32.453428 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-685491b5-473e-4273-8c33-c235d7f7e259 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:32.454735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-685491b5-473e-4273-8c33-c235d7f7e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:32.473555 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:32.513855 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1441/2863] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:32.523691 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:32.528366 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:32.583195 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113104c-2bd4-4936-bbab-513a36ec91ea admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:32.586728 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c524d7-add4-41f9-99df-50a68ac081bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:32.587346 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c524d7-add4-41f9-99df-50a68ac081bc service neutron] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:32.587633 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c524d7-add4-41f9-99df-50a68ac081bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:32.587912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c524d7-add4-41f9-99df-50a68ac081bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:32.597394 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c524d7-add4-41f9-99df-50a68ac081bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:32.598885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c524d7-add4-41f9-99df-50a68ac081bc service neutron] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:32.609126 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1423/2864] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:48:33.018257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685491b5-473e-4273-8c33-c235d7f7e259 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:33.023465 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-685491b5-473e-4273-8c33-c235d7f7e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:33.033412 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685491b5-473e-4273-8c33-c235d7f7e259 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:33.038955 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ef567-50f9-491e-be3a-d33153e71286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:33.039713 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ef567-50f9-491e-be3a-d33153e71286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:33.040065 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ef567-50f9-491e-be3a-d33153e71286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:33.040416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ef567-50f9-491e-be3a-d33153e71286 admin admin] PATH_INFO: `/v3/projects/fd0c41b72ad4444c94e41a9ecc0dc418` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:33.041724 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ef567-50f9-491e-be3a-d33153e71286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0c41b72ad4444c94e41a9ecc0dc418)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:33.044261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ef567-50f9-491e-be3a-d33153e71286 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:33.149556 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a34ef567-50f9-491e-be3a-d33153e71286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0c41b72ad4444c94e41a9ecc0dc418', 'request_id': 'req-a34ef567-50f9-491e-be3a-d33153e71286'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:33.239418 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a34ef567-50f9-491e-be3a-d33153e71286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0c41b72ad4444c94e41a9ecc0dc418', 'request_id': 'req-a34ef567-50f9-491e-be3a-d33153e71286'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:33.245808 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a34ef567-50f9-491e-be3a-d33153e71286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0c41b72ad4444c94e41a9ecc0dc418', 'request_id': 'req-a34ef567-50f9-491e-be3a-d33153e71286'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:33.258687 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a34ef567-50f9-491e-be3a-d33153e71286 admin admin] The token cache is being invalidate because project fd0c41b72ad4444c94e41a9ecc0dc418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80641) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:48:33.258980 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a34ef567-50f9-491e-be3a-d33153e71286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:33.259619 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-a34ef567-50f9-491e-be3a-d33153e71286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:33.261129 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1442/2865] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:48:33 2022] DELETE /identity/v3/projects/fd0c41b72ad4444c94e41a9ecc0dc418 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:33.267284 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b93a46-3e23-4061-aa3e-0f4345d9a22f None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:33.267773 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b93a46-3e23-4061-aa3e-0f4345d9a22f None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:33.267871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b93a46-3e23-4061-aa3e-0f4345d9a22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:33.287431 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-76b93a46-3e23-4061-aa3e-0f4345d9a22f None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:33.288638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-76b93a46-3e23-4061-aa3e-0f4345d9a22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:33.346307 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1424/2866] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:33.355232 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f9bc7-893e-4ffa-88ad-b2ffbe680432 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:33.355518 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f9bc7-893e-4ffa-88ad-b2ffbe680432 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:33.356605 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f9bc7-893e-4ffa-88ad-b2ffbe680432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:33.376071 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-110f9bc7-893e-4ffa-88ad-b2ffbe680432 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:33.377264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-110f9bc7-893e-4ffa-88ad-b2ffbe680432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:33.385081 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1443/2867] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:33.390043 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b93a46-3e23-4061-aa3e-0f4345d9a22f None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:33.400034 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b93a46-3e23-4061-aa3e-0f4345d9a22f None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:33.404682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88121327-a57d-4f36-a8a7-b40c81d939c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:33.405324 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88121327-a57d-4f36-a8a7-b40c81d939c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:33.405616 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88121327-a57d-4f36-a8a7-b40c81d939c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:33.405898 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88121327-a57d-4f36-a8a7-b40c81d939c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:33.406633 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88121327-a57d-4f36-a8a7-b40c81d939c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:48:33.406947 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88121327-a57d-4f36-a8a7-b40c81d939c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:33.408611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88121327-a57d-4f36-a8a7-b40c81d939c8 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:33.410114 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:33.420873 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1425/2868] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:48:33.425124 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f9bc7-893e-4ffa-88ad-b2ffbe680432 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:33.434245 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f9bc7-893e-4ffa-88ad-b2ffbe680432 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:33.439558 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b72bd0-837f-4cb0-a4a4-96737ad93a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:33.440164 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b72bd0-837f-4cb0-a4a4-96737ad93a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:33.440444 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b72bd0-837f-4cb0-a4a4-96737ad93a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:33.440718 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b72bd0-837f-4cb0-a4a4-96737ad93a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:33.441375 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b72bd0-837f-4cb0-a4a4-96737ad93a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:33.443350 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b72bd0-837f-4cb0-a4a4-96737ad93a03 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:33.535090 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1444/2869] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:48:33 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:33.539233 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88121327-a57d-4f36-a8a7-b40c81d939c8 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:33.550964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88121327-a57d-4f36-a8a7-b40c81d939c8 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:33.607692 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e161f62-2c32-4f29-84e0-3ee6352f5baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:33.608306 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e161f62-2c32-4f29-84e0-3ee6352f5baf admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:33.608591 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e161f62-2c32-4f29-84e0-3ee6352f5baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:33.608865 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e161f62-2c32-4f29-84e0-3ee6352f5baf admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:33.609534 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e161f62-2c32-4f29-84e0-3ee6352f5baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:33.611516 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e161f62-2c32-4f29-84e0-3ee6352f5baf admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:33.705693 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1426/2870] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:48:33 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:33.709939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b72bd0-837f-4cb0-a4a4-96737ad93a03 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:33.720416 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b72bd0-837f-4cb0-a4a4-96737ad93a03 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:33.725094 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a546703-f794-4678-af0f-405b7f1c32a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:33.725697 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a546703-f794-4678-af0f-405b7f1c32a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:33.725980 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a546703-f794-4678-af0f-405b7f1c32a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:33.726257 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a546703-f794-4678-af0f-405b7f1c32a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:33.727127 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a546703-f794-4678-af0f-405b7f1c32a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:33.728741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a546703-f794-4678-af0f-405b7f1c32a4 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:33.739270 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1445/2871] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:33.743285 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e161f62-2c32-4f29-84e0-3ee6352f5baf admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:33.753974 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e161f62-2c32-4f29-84e0-3ee6352f5baf admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:33.758643 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4a2bb-3ebc-42b7-8a46-8293c92efbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:33.759253 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4a2bb-3ebc-42b7-8a46-8293c92efbee admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:33.759541 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4a2bb-3ebc-42b7-8a46-8293c92efbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:33.759824 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4a2bb-3ebc-42b7-8a46-8293c92efbee admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:33.760536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4a2bb-3ebc-42b7-8a46-8293c92efbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:33.762138 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4a2bb-3ebc-42b7-8a46-8293c92efbee admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:33.772395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1427/2872] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:33.776295 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a546703-f794-4678-af0f-405b7f1c32a4 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:33.786312 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a546703-f794-4678-af0f-405b7f1c32a4 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:33.790998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aceac7-2489-4ddb-a6e3-2eab479d86dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:33.791646 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aceac7-2489-4ddb-a6e3-2eab479d86dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:33.791930 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aceac7-2489-4ddb-a6e3-2eab479d86dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:33.792206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aceac7-2489-4ddb-a6e3-2eab479d86dd admin admin] PATH_INFO: `/v3/projects/315fdba9c3bd4203bc7d36a3cd815bcd/users/f2585ba99c4448d3900f34bd7f0ccfc3/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:33.807134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aceac7-2489-4ddb-a6e3-2eab479d86dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=315fdba9c3bd4203bc7d36a3cd815bcd, user_id=f2585ba99c4448d3900f34bd7f0ccfc3, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:33.809775 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aceac7-2489-4ddb-a6e3-2eab479d86dd admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:33.906178 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1446/2873] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:33 2022] PUT /identity/v3/projects/315fdba9c3bd4203bc7d36a3cd815bcd/users/f2585ba99c4448d3900f34bd7f0ccfc3/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:33.916443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82a81e-6241-41d3-98c8-1dacaecda740 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:33.916735 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82a81e-6241-41d3-98c8-1dacaecda740 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:33.917013 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82a81e-6241-41d3-98c8-1dacaecda740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:33.944834 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-ab82a81e-6241-41d3-98c8-1dacaecda740 None None] MFA Rules not processed for user `f2585ba99c4448d3900f34bd7f0ccfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:33.946024 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-ab82a81e-6241-41d3-98c8-1dacaecda740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:34.010500 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1428/2874] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:34.015284 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aceac7-2489-4ddb-a6e3-2eab479d86dd admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:34.063206 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:34.078989 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aceac7-2489-4ddb-a6e3-2eab479d86dd admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:34.083811 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3680cd7-250f-4f02-a29b-f86513028032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:34.084459 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3680cd7-250f-4f02-a29b-f86513028032 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:34.084744 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3680cd7-250f-4f02-a29b-f86513028032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:34.085026 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3680cd7-250f-4f02-a29b-f86513028032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:34.085700 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3680cd7-250f-4f02-a29b-f86513028032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:34.087657 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3680cd7-250f-4f02-a29b-f86513028032 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:34.167542 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1447/2875] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:48:34 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:34.172390 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82a81e-6241-41d3-98c8-1dacaecda740 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:34.183395 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82a81e-6241-41d3-98c8-1dacaecda740 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:34.243587 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18c837-5ffa-4ac4-a489-d99d6bbbd7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:34.244267 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18c837-5ffa-4ac4-a489-d99d6bbbd7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:34.244550 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18c837-5ffa-4ac4-a489-d99d6bbbd7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:34.244827 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18c837-5ffa-4ac4-a489-d99d6bbbd7d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:34.245489 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18c837-5ffa-4ac4-a489-d99d6bbbd7d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:34.247573 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18c837-5ffa-4ac4-a489-d99d6bbbd7d3 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:34.256619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:34.375379 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1429/2876] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:48:34 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:48:34.376631 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3680cd7-250f-4f02-a29b-f86513028032 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:34.387266 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3680cd7-250f-4f02-a29b-f86513028032 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:34.392951 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc860bc9-09ff-4628-b54b-5a71cdc9957c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:34.393741 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc860bc9-09ff-4628-b54b-5a71cdc9957c admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:34.394025 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc860bc9-09ff-4628-b54b-5a71cdc9957c admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:34.394298 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc860bc9-09ff-4628-b54b-5a71cdc9957c admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:34.395039 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc860bc9-09ff-4628-b54b-5a71cdc9957c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:34.396676 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc860bc9-09ff-4628-b54b-5a71cdc9957c admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:34.408337 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1448/2877] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:34.412586 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18c837-5ffa-4ac4-a489-d99d6bbbd7d3 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:34.422732 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18c837-5ffa-4ac4-a489-d99d6bbbd7d3 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:34.427414 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375db97-d138-4c39-aa25-e062ce461d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:34.428025 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375db97-d138-4c39-aa25-e062ce461d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:34.428314 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375db97-d138-4c39-aa25-e062ce461d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:34.428598 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375db97-d138-4c39-aa25-e062ce461d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:34.429328 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375db97-d138-4c39-aa25-e062ce461d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:34.430975 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375db97-d138-4c39-aa25-e062ce461d2a admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:34.441129 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1430/2878] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:34.445074 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc860bc9-09ff-4628-b54b-5a71cdc9957c admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:34.455586 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc860bc9-09ff-4628-b54b-5a71cdc9957c admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:34.460118 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c36b5-cd87-4ccc-9f89-a11d1333e767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:34.460767 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c36b5-cd87-4ccc-9f89-a11d1333e767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:34.461054 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c36b5-cd87-4ccc-9f89-a11d1333e767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:34.461333 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c36b5-cd87-4ccc-9f89-a11d1333e767 admin admin] PATH_INFO: `/v3/projects/dacee4d774ba4a4d9ce8e08e24b2cda1/users/c3f755cfced14eb09097b5cf5b5b5822/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:34.476467 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c36b5-cd87-4ccc-9f89-a11d1333e767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dacee4d774ba4a4d9ce8e08e24b2cda1, user_id=c3f755cfced14eb09097b5cf5b5b5822, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:34.479166 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c36b5-cd87-4ccc-9f89-a11d1333e767 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:34.550983 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1449/2879] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:34 2022] PUT /identity/v3/projects/dacee4d774ba4a4d9ce8e08e24b2cda1/users/c3f755cfced14eb09097b5cf5b5b5822/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:34.561273 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05788a-936a-46e9-a54c-255a812d6005 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:34.561581 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05788a-936a-46e9-a54c-255a812d6005 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:34.561855 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05788a-936a-46e9-a54c-255a812d6005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:34.589938 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-6b05788a-936a-46e9-a54c-255a812d6005 None None] MFA Rules not processed for user `c3f755cfced14eb09097b5cf5b5b5822`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:34.591234 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-6b05788a-936a-46e9-a54c-255a812d6005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:34.657275 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1431/2880] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:34.661720 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c36b5-cd87-4ccc-9f89-a11d1333e767 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:34.724348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c36b5-cd87-4ccc-9f89-a11d1333e767 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:34.729162 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99d561-0d4a-4a6d-b3c9-b515be8edcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:34.729783 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99d561-0d4a-4a6d-b3c9-b515be8edcf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:34.730075 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99d561-0d4a-4a6d-b3c9-b515be8edcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:34.730352 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99d561-0d4a-4a6d-b3c9-b515be8edcf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:34.731082 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99d561-0d4a-4a6d-b3c9-b515be8edcf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:34.733156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99d561-0d4a-4a6d-b3c9-b515be8edcf3 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:34.829341 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1450/2881] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:48:34 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:34.833461 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05788a-936a-46e9-a54c-255a812d6005 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:34.844669 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05788a-936a-46e9-a54c-255a812d6005 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:34.901072 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbad75-9db2-4bc6-922b-a3f84ef6fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:34.901682 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbad75-9db2-4bc6-922b-a3f84ef6fd39 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:34.901968 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbad75-9db2-4bc6-922b-a3f84ef6fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:34.902246 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbad75-9db2-4bc6-922b-a3f84ef6fd39 admin admin] PATH_INFO: `/v3/users` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:34.902942 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbad75-9db2-4bc6-922b-a3f84ef6fd39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:34.905021 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbad75-9db2-4bc6-922b-a3f84ef6fd39 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:34.999882 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1432/2882] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:48:34 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:35.003800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99d561-0d4a-4a6d-b3c9-b515be8edcf3 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:35.014787 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99d561-0d4a-4a6d-b3c9-b515be8edcf3 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:35.019379 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0386a-9a5e-4a78-96da-5411e3076b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:35.019973 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0386a-9a5e-4a78-96da-5411e3076b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:35.020253 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0386a-9a5e-4a78-96da-5411e3076b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:35.020528 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0386a-9a5e-4a78-96da-5411e3076b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:35.021248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0386a-9a5e-4a78-96da-5411e3076b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:35.023132 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0386a-9a5e-4a78-96da-5411e3076b58 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:35.033603 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1451/2883] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:35.037918 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbad75-9db2-4bc6-922b-a3f84ef6fd39 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:35.049617 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbad75-9db2-4bc6-922b-a3f84ef6fd39 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:35.054341 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8794f-b6b3-4614-aa3e-ebe4de30d7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:35.055047 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8794f-b6b3-4614-aa3e-ebe4de30d7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:35.055336 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8794f-b6b3-4614-aa3e-ebe4de30d7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:35.055619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8794f-b6b3-4614-aa3e-ebe4de30d7cf admin admin] PATH_INFO: `/v3/projects/1f8aacf6828d4f54bf144f0323805c36/users/177944e028b04a1aafa49f46c1d5fe15/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:35.071611 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8794f-b6b3-4614-aa3e-ebe4de30d7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8aacf6828d4f54bf144f0323805c36, user_id=177944e028b04a1aafa49f46c1d5fe15, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:35.074289 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8794f-b6b3-4614-aa3e-ebe4de30d7cf admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:35.163178 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1433/2884] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:35 2022] PUT /identity/v3/projects/1f8aacf6828d4f54bf144f0323805c36/users/177944e028b04a1aafa49f46c1d5fe15/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:35.167304 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0386a-9a5e-4a78-96da-5411e3076b58 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:35.177939 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0386a-9a5e-4a78-96da-5411e3076b58 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:35.232800 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e796b-5b7d-4f4b-a80f-55447da47381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:35.233410 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e796b-5b7d-4f4b-a80f-55447da47381 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:35.233691 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e796b-5b7d-4f4b-a80f-55447da47381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:35.233967 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e796b-5b7d-4f4b-a80f-55447da47381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:35.234688 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e796b-5b7d-4f4b-a80f-55447da47381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:35.236287 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e796b-5b7d-4f4b-a80f-55447da47381 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:35.245909 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1452/2885] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:35.250774 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8794f-b6b3-4614-aa3e-ebe4de30d7cf admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:35.260818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8794f-b6b3-4614-aa3e-ebe4de30d7cf admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:35.265653 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b725b45-18c8-4588-82c6-ac931abfd4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:35.266309 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b725b45-18c8-4588-82c6-ac931abfd4ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:35.266619 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b725b45-18c8-4588-82c6-ac931abfd4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:35.266896 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b725b45-18c8-4588-82c6-ac931abfd4ac admin admin] PATH_INFO: `/v3/projects/1f8aacf6828d4f54bf144f0323805c36/users/177944e028b04a1aafa49f46c1d5fe15/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:35.268833 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b725b45-18c8-4588-82c6-ac931abfd4ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8aacf6828d4f54bf144f0323805c36, user_id=177944e028b04a1aafa49f46c1d5fe15, role_id=3d32d99f52364e0a9b8d8dbd93b9fa7c)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:35.271576 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b725b45-18c8-4588-82c6-ac931abfd4ac admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:35.281967 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1434/2886] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:35 2022] PUT /identity/v3/projects/1f8aacf6828d4f54bf144f0323805c36/users/177944e028b04a1aafa49f46c1d5fe15/roles/3d32d99f52364e0a9b8d8dbd93b9fa7c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:35.293348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e998a-4ac0-40c3-b06a-cf5eae5b8276 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:35.293638 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e998a-4ac0-40c3-b06a-cf5eae5b8276 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:35.293919 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e998a-4ac0-40c3-b06a-cf5eae5b8276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:35.302477 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:35.323159 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-9e7e998a-4ac0-40c3-b06a-cf5eae5b8276 None None] MFA Rules not processed for user `177944e028b04a1aafa49f46c1d5fe15`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:35.324359 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9e7e998a-4ac0-40c3-b06a-cf5eae5b8276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:35.394522 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1453/2887] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:35.406733 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b725b45-18c8-4588-82c6-ac931abfd4ac admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:35.408526 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-4b725b45-18c8-4588-82c6-ac931abfd4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:35.435304 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:35.465861 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b725b45-18c8-4588-82c6-ac931abfd4ac admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:35.470060 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e8005-6595-4ed4-aea2-9da0eaab0f87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:35.470702 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e8005-6595-4ed4-aea2-9da0eaab0f87 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:35.470983 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e8005-6595-4ed4-aea2-9da0eaab0f87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:35.471258 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e8005-6595-4ed4-aea2-9da0eaab0f87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:35.527116 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e8005-6595-4ed4-aea2-9da0eaab0f87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:35.528490 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e8005-6595-4ed4-aea2-9da0eaab0f87 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:35.537964 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1435/2888] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:48:37.492353 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e998a-4ac0-40c3-b06a-cf5eae5b8276 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:37.493834 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-9e7e998a-4ac0-40c3-b06a-cf5eae5b8276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:37.506194 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e998a-4ac0-40c3-b06a-cf5eae5b8276 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:37.509791 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c00d3-a081-4fc7-9f07-a05bed67cf3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:37.510400 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c00d3-a081-4fc7-9f07-a05bed67cf3c service cinder] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:37.510728 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c00d3-a081-4fc7-9f07-a05bed67cf3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:37.511009 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c00d3-a081-4fc7-9f07-a05bed67cf3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:37.568324 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c00d3-a081-4fc7-9f07-a05bed67cf3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:37.569797 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c00d3-a081-4fc7-9f07-a05bed67cf3c service cinder] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:37.580380 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1454/2889] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:48:38.965268 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e8005-6595-4ed4-aea2-9da0eaab0f87 service cinder] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:38.974818 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e8005-6595-4ed4-aea2-9da0eaab0f87 service cinder] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:38.978348 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771496c2-8f7e-4ca8-a04a-f29d8fe1c7a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ffc2cd3c6a84eef894edae6e9b38210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:38.978994 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771496c2-8f7e-4ca8-a04a-f29d8fe1c7a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:38.979281 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771496c2-8f7e-4ca8-a04a-f29d8fe1c7a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:38.979558 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771496c2-8f7e-4ca8-a04a-f29d8fe1c7a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:38.988357 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771496c2-8f7e-4ca8-a04a-f29d8fe1c7a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:38.989780 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771496c2-8f7e-4ca8-a04a-f29d8fe1c7a7 service cinder] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:38.999141 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1436/2890] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:48:43.550153 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c00d3-a081-4fc7-9f07-a05bed67cf3c service cinder] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:43.610936 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c00d3-a081-4fc7-9f07-a05bed67cf3c service cinder] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:43.615435 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:43.616058 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:43.616345 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:43.616617 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] PATH_INFO: `/v3/users/f2585ba99c4448d3900f34bd7f0ccfc3` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:43.617766 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2585ba99c4448d3900f34bd7f0ccfc3)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:43.619703 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:43.819816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:43.832953 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2585ba99c4448d3900f34bd7f0ccfc3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:43.905320 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2585ba99c4448d3900f34bd7f0ccfc3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:43.912645 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2585ba99c4448d3900f34bd7f0ccfc3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:43.915521 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2585ba99c4448d3900f34bd7f0ccfc3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:43.915521 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2585ba99c4448d3900f34bd7f0ccfc3'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:43.931743 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1455/2891] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:48:43 2022] DELETE /identity/v3/users/f2585ba99c4448d3900f34bd7f0ccfc3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:43.936671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61892ac9-76b3-4c1b-8dcf-463e8d8558ad None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:43.937149 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61892ac9-76b3-4c1b-8dcf-463e8d8558ad None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:43.937257 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61892ac9-76b3-4c1b-8dcf-463e8d8558ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:43.956033 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-61892ac9-76b3-4c1b-8dcf-463e8d8558ad None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:43.957236 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-61892ac9-76b3-4c1b-8dcf-463e8d8558ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:44.015730 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1437/2892] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:44.025598 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:44.027044 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:44.084371 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999e350-da90-49e9-84ac-65d36b44d0ac admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:44.087998 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97053ce4-6b48-4bf9-80e0-139274534cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:44.088607 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97053ce4-6b48-4bf9-80e0-139274534cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:44.088885 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97053ce4-6b48-4bf9-80e0-139274534cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:44.089155 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97053ce4-6b48-4bf9-80e0-139274534cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:44.098625 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97053ce4-6b48-4bf9-80e0-139274534cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:44.100055 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97053ce4-6b48-4bf9-80e0-139274534cc9 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:44.109369 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1456/2893] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:48:44.477966 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61892ac9-76b3-4c1b-8dcf-463e8d8558ad None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:44.479423 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-61892ac9-76b3-4c1b-8dcf-463e8d8558ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:44.491958 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61892ac9-76b3-4c1b-8dcf-463e8d8558ad None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:44.496658 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:44.497851 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:44.498255 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:44.498557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] PATH_INFO: `/v3/projects/315fdba9c3bd4203bc7d36a3cd815bcd` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:44.499736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=315fdba9c3bd4203bc7d36a3cd815bcd)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:44.501641 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:44.628638 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315fdba9c3bd4203bc7d36a3cd815bcd', 'request_id': 'req-b86bdb62-7178-4108-984c-50abca548f65'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:44.634204 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315fdba9c3bd4203bc7d36a3cd815bcd', 'request_id': 'req-b86bdb62-7178-4108-984c-50abca548f65'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:44.636010 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:44.689953 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315fdba9c3bd4203bc7d36a3cd815bcd', 'request_id': 'req-b86bdb62-7178-4108-984c-50abca548f65'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:44.701955 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] The token cache is being invalidate because project 315fdba9c3bd4203bc7d36a3cd815bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:48:44.702241 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:44.702884 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:44.704391 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1438/2894] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:48:44 2022] DELETE /identity/v3/projects/315fdba9c3bd4203bc7d36a3cd815bcd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:44.708524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97053ce4-6b48-4bf9-80e0-139274534cc9 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:44.718529 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97053ce4-6b48-4bf9-80e0-139274534cc9 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:44.775876 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:44.776524 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:44.776816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:44.777088 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] PATH_INFO: `/v3/users/c3f755cfced14eb09097b5cf5b5b5822` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:44.778249 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f755cfced14eb09097b5cf5b5b5822)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:44.780261 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:44.976963 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f755cfced14eb09097b5cf5b5b5822'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:44.980515 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:45.042340 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f755cfced14eb09097b5cf5b5b5822'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:45.051544 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f755cfced14eb09097b5cf5b5b5822'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:45.052288 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f755cfced14eb09097b5cf5b5b5822'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:45.053171 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f755cfced14eb09097b5cf5b5b5822'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:45.071236 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1457/2895] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:48:44 2022] DELETE /identity/v3/users/c3f755cfced14eb09097b5cf5b5b5822 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:45.470131 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:45.471628 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:45.485636 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bdb62-7178-4108-984c-50abca548f65 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:45.545130 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:45.545773 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:45.546076 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:45.546575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] PATH_INFO: `/v3/projects/dacee4d774ba4a4d9ce8e08e24b2cda1` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:45.547871 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dacee4d774ba4a4d9ce8e08e24b2cda1)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:45.549831 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:45.632612 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dacee4d774ba4a4d9ce8e08e24b2cda1', 'request_id': 'req-271e0bb0-c289-464a-87b9-cef8dfd18fa5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:45.638039 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dacee4d774ba4a4d9ce8e08e24b2cda1', 'request_id': 'req-271e0bb0-c289-464a-87b9-cef8dfd18fa5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:45.733465 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dacee4d774ba4a4d9ce8e08e24b2cda1', 'request_id': 'req-271e0bb0-c289-464a-87b9-cef8dfd18fa5'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:45.744621 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] The token cache is being invalidate because project dacee4d774ba4a4d9ce8e08e24b2cda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:48:45.744912 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:45.745538 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:45.747176 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1439/2896] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:48:45 2022] DELETE /identity/v3/projects/dacee4d774ba4a4d9ce8e08e24b2cda1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:45.751362 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:45.752852 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:45.766219 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa62c8-81e0-4132-8d94-754a3ed66df3 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:45.820980 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e229c3-a856-492b-866c-9e1428aff04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:45.821614 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e229c3-a856-492b-866c-9e1428aff04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:45.821902 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e229c3-a856-492b-866c-9e1428aff04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:45.822181 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e229c3-a856-492b-866c-9e1428aff04b admin admin] PATH_INFO: `/v3/users/177944e028b04a1aafa49f46c1d5fe15` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:45.823356 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e229c3-a856-492b-866c-9e1428aff04b admin admin] RBAC: Authorizing `identity:delete_user(user_id=177944e028b04a1aafa49f46c1d5fe15)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:45.825277 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e229c3-a856-492b-866c-9e1428aff04b admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:46.035983 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-58e229c3-a856-492b-866c-9e1428aff04b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177944e028b04a1aafa49f46c1d5fe15'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:46.124520 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-58e229c3-a856-492b-866c-9e1428aff04b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177944e028b04a1aafa49f46c1d5fe15'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:46.132948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-58e229c3-a856-492b-866c-9e1428aff04b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177944e028b04a1aafa49f46c1d5fe15'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:46.133571 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-58e229c3-a856-492b-866c-9e1428aff04b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177944e028b04a1aafa49f46c1d5fe15'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:46.134156 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-58e229c3-a856-492b-866c-9e1428aff04b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177944e028b04a1aafa49f46c1d5fe15'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:46.152134 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1458/2897] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:48:45 2022] DELETE /identity/v3/users/177944e028b04a1aafa49f46c1d5fe15 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:46.570474 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:46.573041 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:46.585731 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e0bb0-c289-464a-87b9-cef8dfd18fa5 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:46.642505 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92271292-7270-4730-9e04-31c7d391a07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:46.643167 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271292-7270-4730-9e04-31c7d391a07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:46.643455 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271292-7270-4730-9e04-31c7d391a07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:46.643736 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271292-7270-4730-9e04-31c7d391a07e admin admin] PATH_INFO: `/v3/projects/1f8aacf6828d4f54bf144f0323805c36` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:46.644898 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92271292-7270-4730-9e04-31c7d391a07e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8aacf6828d4f54bf144f0323805c36)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:46.647104 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92271292-7270-4730-9e04-31c7d391a07e admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:46.667980 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:46.758991 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-92271292-7270-4730-9e04-31c7d391a07e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8aacf6828d4f54bf144f0323805c36', 'request_id': 'req-92271292-7270-4730-9e04-31c7d391a07e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:46.764387 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-92271292-7270-4730-9e04-31c7d391a07e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8aacf6828d4f54bf144f0323805c36', 'request_id': 'req-92271292-7270-4730-9e04-31c7d391a07e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:46.839038 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-92271292-7270-4730-9e04-31c7d391a07e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8aacf6828d4f54bf144f0323805c36', 'request_id': 'req-92271292-7270-4730-9e04-31c7d391a07e'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:46.851384 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-92271292-7270-4730-9e04-31c7d391a07e admin admin] The token cache is being invalidate because project 1f8aacf6828d4f54bf144f0323805c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:48:46.851698 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-92271292-7270-4730-9e04-31c7d391a07e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:46.852333 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-92271292-7270-4730-9e04-31c7d391a07e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:48:46.853847 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1440/2898] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:48:46 2022] DELETE /identity/v3/projects/1f8aacf6828d4f54bf144f0323805c36 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:48:46.858882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955c0e2-4198-4065-b810-7b4ffaf42faa None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:46.860125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955c0e2-4198-4065-b810-7b4ffaf42faa None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:46.860125 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955c0e2-4198-4065-b810-7b4ffaf42faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:46.879313 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-f955c0e2-4198-4065-b810-7b4ffaf42faa None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:46.880521 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-f955c0e2-4198-4065-b810-7b4ffaf42faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:46.924575 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:46.939545 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1459/2899] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:46.947414 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d63cce-add8-455f-9d88-41b9e2bed672 None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:46.947710 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d63cce-add8-455f-9d88-41b9e2bed672 None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:46.947990 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d63cce-add8-455f-9d88-41b9e2bed672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:46.968208 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-31d63cce-add8-455f-9d88-41b9e2bed672 None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:46.970245 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-31d63cce-add8-455f-9d88-41b9e2bed672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:46.978334 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1441/2900] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:46.982610 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955c0e2-4198-4065-b810-7b4ffaf42faa None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:46.992762 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955c0e2-4198-4065-b810-7b4ffaf42faa None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:46.997760 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdea2f-3c04-41cf-984c-7c1202470a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:46.998376 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdea2f-3c04-41cf-984c-7c1202470a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:46.998701 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdea2f-3c04-41cf-984c-7c1202470a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:46.998985 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdea2f-3c04-41cf-984c-7c1202470a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:46.999708 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdea2f-3c04-41cf-984c-7c1202470a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80641) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:48:47.000017 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdea2f-3c04-41cf-984c-7c1202470a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:47.001628 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdea2f-3c04-41cf-984c-7c1202470a80 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:47.012974 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1460/2901] 10.222.0.60 () {58 vars in 1153 bytes} [Thu Aug 4 02:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:48:47.017741 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d63cce-add8-455f-9d88-41b9e2bed672 None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:47.027397 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d63cce-add8-455f-9d88-41b9e2bed672 None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:47.032644 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27338d53-6448-4893-8852-62551af50bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:47.033242 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27338d53-6448-4893-8852-62551af50bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:47.033527 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27338d53-6448-4893-8852-62551af50bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:47.033802 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27338d53-6448-4893-8852-62551af50bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:47.034655 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27338d53-6448-4893-8852-62551af50bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:47.036559 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27338d53-6448-4893-8852-62551af50bd6 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:47.102826 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1442/2902] 10.222.0.60 () {60 vars in 1153 bytes} [Thu Aug 4 02:48:47 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:47.107211 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdea2f-3c04-41cf-984c-7c1202470a80 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:47.117623 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdea2f-3c04-41cf-984c-7c1202470a80 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:47.175348 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447de620-c748-4f92-8bf1-46f27e126722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:47.175963 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447de620-c748-4f92-8bf1-46f27e126722 admin admin] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:47.176248 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447de620-c748-4f92-8bf1-46f27e126722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:47.176525 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447de620-c748-4f92-8bf1-46f27e126722 admin admin] PATH_INFO: `/v3/users` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:47.177205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447de620-c748-4f92-8bf1-46f27e126722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:47.179205 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447de620-c748-4f92-8bf1-46f27e126722 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:47.282611 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1461/2903] 10.222.0.60 () {60 vars in 1144 bytes} [Thu Aug 4 02:48:47 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:48:47.286856 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27338d53-6448-4893-8852-62551af50bd6 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:47.297787 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27338d53-6448-4893-8852-62551af50bd6 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:47.302443 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd4a92-6426-4f04-a111-a9c12c2517aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:47.303089 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd4a92-6426-4f04-a111-a9c12c2517aa admin admin] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:47.303372 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd4a92-6426-4f04-a111-a9c12c2517aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:47.303681 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd4a92-6426-4f04-a111-a9c12c2517aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:47.304379 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd4a92-6426-4f04-a111-a9c12c2517aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:47.305982 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd4a92-6426-4f04-a111-a9c12c2517aa admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:47.316706 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1443/2904] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:47.324361 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447de620-c748-4f92-8bf1-46f27e126722 admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:47.334656 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447de620-c748-4f92-8bf1-46f27e126722 admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:47.339279 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b077c5-2adb-4be8-91df-bc3ad3610ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:47.339882 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b077c5-2adb-4be8-91df-bc3ad3610ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:47.340167 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b077c5-2adb-4be8-91df-bc3ad3610ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:47.340444 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b077c5-2adb-4be8-91df-bc3ad3610ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:47.341145 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b077c5-2adb-4be8-91df-bc3ad3610ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:47.342776 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b077c5-2adb-4be8-91df-bc3ad3610ee6 admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:47.353499 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1462/2905] 10.222.0.60 () {58 vars in 1122 bytes} [Thu Aug 4 02:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:48:47.357555 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd4a92-6426-4f04-a111-a9c12c2517aa admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:47.368386 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd4a92-6426-4f04-a111-a9c12c2517aa admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:47.373031 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1cf00-bddf-4f4b-8371-c8651c992cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:47.373684 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1cf00-bddf-4f4b-8371-c8651c992cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:47.373965 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1cf00-bddf-4f4b-8371-c8651c992cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:47.374248 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1cf00-bddf-4f4b-8371-c8651c992cd5 admin admin] PATH_INFO: `/v3/projects/2ae8a7ecf5e2431cb44a0dded02fa3f1/users/0c633d4f37f149b9b79d521ef8233469/roles/b83f9277d44246c5983fe3b6d7d5af96` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:47.389807 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1cf00-bddf-4f4b-8371-c8651c992cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae8a7ecf5e2431cb44a0dded02fa3f1, user_id=0c633d4f37f149b9b79d521ef8233469, role_id=b83f9277d44246c5983fe3b6d7d5af96)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:47.392866 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1cf00-bddf-4f4b-8371-c8651c992cd5 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:47.519405 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1444/2906] 10.222.0.60 () {60 vars in 1483 bytes} [Thu Aug 4 02:48:47 2022] PUT /identity/v3/projects/2ae8a7ecf5e2431cb44a0dded02fa3f1/users/0c633d4f37f149b9b79d521ef8233469/roles/b83f9277d44246c5983fe3b6d7d5af96 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:48:47.532109 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850a01b-fa4d-416e-9735-626a2670f7c2 None None] REQUEST_METHOD: `POST` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:47.532450 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850a01b-fa4d-416e-9735-626a2670f7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:47.532730 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850a01b-fa4d-416e-9735-626a2670f7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:47.561204 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.auth.core [None req-1850a01b-fa4d-416e-9735-626a2670f7c2 None None] MFA Rules not processed for user `0c633d4f37f149b9b79d521ef8233469`. Rule list: `[]` (Enabled: `True`). {{(pid=80641) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:48:47.562539 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-1850a01b-fa4d-416e-9735-626a2670f7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:47.626980 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1463/2907] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:48:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:48:47.638678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1cf00-bddf-4f4b-8371-c8651c992cd5 admin admin] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:48:47.640536 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-71d1cf00-bddf-4f4b-8371-c8651c992cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:48:47.717671 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1cf00-bddf-4f4b-8371-c8651c992cd5 admin admin] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:48:47.721941 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1a3f5-4393-4e21-91d3-42dd6e0d8012 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10bd2ed69b324e85b8166135f045b840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:48:47.722581 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a3f5-4393-4e21-91d3-42dd6e0d8012 service glance] REQUEST_METHOD: `GET` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:48:47.722867 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a3f5-4393-4e21-91d3-42dd6e0d8012 service glance] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:48:47.723139 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1a3f5-4393-4e21-91d3-42dd6e0d8012 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:48:47.731302 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1a3f5-4393-4e21-91d3-42dd6e0d8012 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:48:47.732739 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1a3f5-4393-4e21-91d3-42dd6e0d8012 service glance] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:48:47.742063 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1445/2908] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:48:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:48:57.623735 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:48:57.738165 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:49:11.837486 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850a01b-fa4d-416e-9735-626a2670f7c2 None None] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:49:11.899692 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850a01b-fa4d-416e-9735-626a2670f7c2 None None] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:49:11.904314 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:49:11.904948 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:49:11.905234 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:49:11.905512 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] PATH_INFO: `/v3/users/0c633d4f37f149b9b79d521ef8233469` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:49:11.906711 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c633d4f37f149b9b79d521ef8233469)` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:49:11.908634 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:49:12.095964 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c633d4f37f149b9b79d521ef8233469'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:49:12.175186 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c633d4f37f149b9b79d521ef8233469'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:49:12.182816 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c633d4f37f149b9b79d521ef8233469'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:49:12.183843 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c633d4f37f149b9b79d521ef8233469'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:49:12.184133 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.notifications [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c633d4f37f149b9b79d521ef8233469'} {{(pid=80641) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:49:12.201825 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1464/2909] 10.222.0.60 () {58 vars in 1224 bytes} [Thu Aug 4 02:49:11 2022] DELETE /identity/v3/users/0c633d4f37f149b9b79d521ef8233469 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:49:12.206352 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dea1a1-cfd9-4922-901e-801a74cd72dd None None] REQUEST_METHOD: `POST` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:49:12.206881 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dea1a1-cfd9-4922-901e-801a74cd72dd None None] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:49:12.207017 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dea1a1-cfd9-4922-901e-801a74cd72dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:49:12.226557 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.auth.core [None req-81dea1a1-cfd9-4922-901e-801a74cd72dd None None] MFA Rules not processed for user `41158534548d42db82795c2a83978403`. Rule list: `[]` (Enabled: `True`). {{(pid=80642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:49:12.227750 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-81dea1a1-cfd9-4922-901e-801a74cd72dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:49:12.286575 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1446/2910] 10.222.0.60 () {58 vars in 958 bytes} [Thu Aug 4 02:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:49:12.296977 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:49:12.298610 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:49:12.356659 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373be6c6-46f5-41d2-b4dc-a066833005ab admin admin] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:49:12.360264 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eb01a-3161-4277-91f7-d5a593a21754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ac08ad57a8e442d89ba1881abf43cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:49:12.360875 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eb01a-3161-4277-91f7-d5a593a21754 service neutron] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:49:12.361160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eb01a-3161-4277-91f7-d5a593a21754 service neutron] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:49:12.361437 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eb01a-3161-4277-91f7-d5a593a21754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:49:12.370287 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3eb01a-3161-4277-91f7-d5a593a21754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:49:12.371785 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3eb01a-3161-4277-91f7-d5a593a21754 service neutron] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:49:12.381160 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1465/2911] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:49:12.775205 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dea1a1-cfd9-4922-901e-801a74cd72dd None None] Authenticating user token {{(pid=80642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:49:12.776801 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.fernet_utils [None req-81dea1a1-cfd9-4922-901e-801a74cd72dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:49:12.789880 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dea1a1-cfd9-4922-901e-801a74cd72dd None None] Validating token access rules against request {{(pid=80642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:49:12.795235 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cb549-706d-4a86-99a7-6861e10c53b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41158534548d42db82795c2a83978403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa60e5b58354576a0cb898fee2dc9ca', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:49:12.796062 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cb549-706d-4a86-99a7-6861e10c53b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:49:12.796354 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cb549-706d-4a86-99a7-6861e10c53b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:49:12.796637 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cb549-706d-4a86-99a7-6861e10c53b3 admin admin] PATH_INFO: `/v3/projects/2ae8a7ecf5e2431cb44a0dded02fa3f1` {{(pid=80642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:49:12.797858 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100cb549-706d-4a86-99a7-6861e10c53b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae8a7ecf5e2431cb44a0dded02fa3f1)` {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:49:12.800678 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100cb549-706d-4a86-99a7-6861e10c53b3 admin admin] RBAC: Authorization granted {{(pid=80642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:49:12.905339 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-100cb549-706d-4a86-99a7-6861e10c53b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae8a7ecf5e2431cb44a0dded02fa3f1', 'request_id': 'req-100cb549-706d-4a86-99a7-6861e10c53b3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:49:12.911105 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-100cb549-706d-4a86-99a7-6861e10c53b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae8a7ecf5e2431cb44a0dded02fa3f1', 'request_id': 'req-100cb549-706d-4a86-99a7-6861e10c53b3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:49:12.978885 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-100cb549-706d-4a86-99a7-6861e10c53b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae8a7ecf5e2431cb44a0dded02fa3f1', 'request_id': 'req-100cb549-706d-4a86-99a7-6861e10c53b3'} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:49:12.990814 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-100cb549-706d-4a86-99a7-6861e10c53b3 admin admin] The token cache is being invalidate because project 2ae8a7ecf5e2431cb44a0dded02fa3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:49:12.991110 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-100cb549-706d-4a86-99a7-6861e10c53b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:49:12.991747 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG keystone.notifications [None req-100cb549-706d-4a86-99a7-6861e10c53b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:49:12.993261 dv-cinder-740146-17-smb devstack@keystone.service[80642]: [pid: 80642|app: 0|req: 1447/2912] 10.222.0.60 () {58 vars in 1233 bytes} [Thu Aug 4 02:49:12 2022] DELETE /identity/v3/projects/2ae8a7ecf5e2431cb44a0dded02fa3f1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:49:22.376940 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:49:22.987181 dv-cinder-740146-17-smb devstack@keystone.service[80642]: DEBUG dbcounter [-] [80642] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:50:42.696971 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eb01a-3161-4277-91f7-d5a593a21754 service neutron] Authenticating user token {{(pid=80641) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:50:42.698554 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-0c3eb01a-3161-4277-91f7-d5a593a21754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:50:42.767993 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eb01a-3161-4277-91f7-d5a593a21754 service neutron] Validating token access rules against request {{(pid=80641) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:50:42.827956 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d61616-934b-4022-b985-21316b8dc68a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '423ac00601f84e3d9c6cc6ee20eee6ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fae65363f2fb415b834ac367a6c4b7ad', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80641) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:50:42.828578 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d61616-934b-4022-b985-21316b8dc68a service placement] REQUEST_METHOD: `GET` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:50:42.828865 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d61616-934b-4022-b985-21316b8dc68a service placement] SCRIPT_NAME: `/identity` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:50:42.829146 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d61616-934b-4022-b985-21316b8dc68a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80641) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:50:42.830968 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.fernet_utils [None req-06d61616-934b-4022-b985-21316b8dc68a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80641) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:50:42.843095 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d61616-934b-4022-b985-21316b8dc68a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:50:42.844677 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d61616-934b-4022-b985-21316b8dc68a service placement] RBAC: Authorization granted {{(pid=80641) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:50:42.854567 dv-cinder-740146-17-smb devstack@keystone.service[80641]: [pid: 80641|app: 0|req: 1466/2913] 10.222.0.60 () {60 vars in 1365 bytes} [Thu Aug 4 02:50:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:50:52.850354 dv-cinder-740146-17-smb devstack@keystone.service[80641]: DEBUG dbcounter [-] [80641] Writing DB stats keystone:SELECT=58 {{(pid=80641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}